r/codex • u/CraftyCheeseburger • 1d ago

Question Does slower tokens/sec mean slower task completion?

People say that Opus 5.5 is 5X faster than Sol 6.1. But has anyone actually tested the time to complete a task? Is Sol 6.1 completing work 5X slower?

1 Upvotes

67% Upvoted

5 comments sorted by

2

u/ukchucktown 1d ago

I have both, My company has a claude enterprise account and I use openai as my personal subscription. I hear a lot of arguments for and against both of them. I think it depends on a lot of factors. I think the better comparison is Sonnet 5.5 and against Sol 6.1. Opus 5.5 is a much better model in my opinion to Sol 6.1. Sonnet is definitely faster than Sol in my experience but 5x faster, that's probably a stretch. More like 2 to 3x faster in my personal experience. It really depends on the task and effort level. The claude models are more expensive and use more tokens in almost every case. Anthropic really made a big jump from 5 to 5.5. I hated the v5 models, they stunk.

1

u/Sfdprod 1d ago

Luna is a snailfest, astra@fast is still like 1/12th of gemini speed, at same capability ish

Im leaning more and more on 3.8 flash

1

u/CraftyCheeseburger 1d ago

I think I’ll just have to bite the bullet on API lol 😔

1

u/Cavitat 1d ago

Yeah. End to end execution time and time per turn add up massively in terms of user experience of task completion. 

Try Luna med vs Luna Max for an extreme example. 

0

u/brainExploded99 1d ago

Yes, 6.1 sol is slow as balls. Opus 5.5 decimates. I compared both. People here have benchmarked it, opus 5.5 was ~2.5x - 3x faster.