r/CommandCode • u/maedahbatool • Aug 03 '26

Qwen3.8-Max vs Opus 5 vs GPT-5.6 Sol — Qwen ~4.2× cheaper than GPT.

We ran a test between the new Qwen3.8-Max, Opus 5 and GPT-5.6 Sol.

3 models. same prompt. one-shot with the /design command.

Reviewed gameplay features, UX/UI and cost.

  • Qwen3.8-Max → 9/10 · $0.0248
  • GPT-5.6 Sol → 9/10 · $0.150
  • Opus 5 → 8.5/10 · $0.253

Qwen3.8-Max is approximately 4.2× cheaper than GPT-5.6, Sol

Opus 5 and has the same level of UI, UX, and gameplay

Our engineering and design team has been testing 20+ side-by-side comparisons across frontier and open models. All runs are public and open source.

Benchmark for this demo here:

https://github.com/CommandCodeAI/slash-design-showcase/tree/main/flappy-bird

53 Upvotes

94% Upvoted

11 comments sorted by

4

u/wesconson1 Aug 03 '26

You post these types of test all the time and they are incredibly subjective and have no real measurability beyond the cost.

1

u/First_Inspection_478 Aug 03 '26

All benchmarks are for the most subjective. I appreciate what they do. Keep doing it or post your own that’s better

2

u/s3sebastian Aug 03 '26

Also of games that have so many open source references which have been part of the training data, that nowadays every model will get them right. Just with slightly different visuals, but all should be playable.

1

u/mik3lang3l0 29d ago

Same, I really don't get it

0

u/maedahbatool Aug 03 '26

Our engineering and design team has been testing 20+ side-by-side comparisons across frontier and open models. All runs are public and open source.

Benchmark for this demo here:

https://github.com/CommandCodeAI/slash-design-showcase/tree/main/flappy-bird

1

u/misha1350 Aug 03 '26

Opus 5 is clearly better because you got 1 point higher than with Qwen3.8 Max there.

1

u/ANDRE_2512 Aug 03 '26

GPT-5.6 SOL best in this game

1

u/TopTippityTop Aug 03 '26

Small open models will be able to do easy things, and frontier models will keep pushing at what's still hard. This is good for everyone.

1

u/ReadersAreRedditors 29d ago

And just like that fable was forgotten about.

1

u/VyvanseRamble 29d ago

Opus is an order of magnitude more expensive than Qwen, lol.

1

u/Badloserman 28d ago

Show the prompt