Accio Open-Sources CommerceAgentBench for E-Commerce AI Agents
Accio, the commerce agent team inside Alibaba International, has open-sourced CommerceAgentBench: 107 long-horizon business tasks running against fourteen offline replicas of real software, each in a fresh container, each graded on the state the agent actually changed. This breakdown covers the task mix, the grading design, the three-harness leaderboard led by Claude Opus 5 at 66/107, the twelve-task swing that a harness alone can produce, the caveats the README discloses about managed endpoints and unmatched reasoning effort, the two-licence split, the sibling Business Arena benchmark, and what any of it should change if you are buying agents this quarter.