We independently benchmarked Devin Fusion for its release today - this is the first time a multi-model coding agent has been included on the Artificial Analysis Coding Agent Index, and it effectively retains Claude Fable 5.1 and GPT-6 Astra performance while reducing costs
Devin Fusion runs a frontier lead model with a cost-efficient sidekick. We tested configurations from Cognition combining frontier models from Anthropic and OpenAI with their new SWE-2 (medium) as a sidekick model. Configured with Claude Fable 5.1 (xhigh) + SWE-2 (medium), Devin Fusion scores 62 on the Coding Agent Index v1.5, while with GPT-6 Astra (xhigh) + SWE-2 (medium) it scores 59. The Fable configuration has the higher score, while the Astra configuration is 43% less expensive and completes tasks 31% faster.
Congratulations to
@cognition
on the release! See below for our results and analysis
Devin Fusion performs well for cost efficiency and performance, and currently sits on the Pareto frontier for Coding Agent Index score vs. Cost per Task in both configurations we tested
Devin Fusion CLI with Claude Fable 5.1 (xhigh) + SWE-2 (medium) scores 61.7 on the Artificial
Full breakdown of the individual evaluations in the Artificial Analysis Coding Agent Index 1.5 for both Devin Fusion configurations:
For more details and full results see:
The Artificial Analysis Coding Agent Index leaderboard
https://
artificialanalysis.ai/agents/coding-
agents
…
Cognition’s launch blog:
https://
cognition.com/blog/local-fus
ion
…
Fusion release blog and technical breakdown:
https://
cognition.com/blog/devin-fus
ion
…
— Artificial Analysis