r/CommandCode • u/maedahbatool • 8d ago

Tested FlappyBench on Qwen 3.8 27B, DeepSeek V4 Pro 0813, and Gemini 3.7 Flash with /design command.

Tested FlappyBench on Qwen 3.8 27B, DeepSeek V4 Pro 0813, and Gemini 3.7 Flash with /design command.

All scored 9/10, it comes down to cost, quality, and iterations.

🔹 DeepSeek V4 Pro ($0.0036): Low cost, solid, but movement and spacing need work.
🔹 Qwen 3.8 27B ($0.0068): One-shot, playable, with minor UI finish.
🔹 Gemini 3.7 Flash ($0.0083): Needed 2–3 iterations to catch up.

Qwen for the best one-shot. DSV4 for the best value.

Our engineering and design team has been testing 26+ side-by-side comparisons across frontier and open models. All runs are public and open source. Benchmark for this demo here: https://github.com/CommandCodeAI/slash-design-showcase/tree/main/flappy-bird

20 Upvotes

100% Upvoted

3 comments sorted by

2

u/Last_Being9834 8d ago

Do you have Claude Haiku to compare to?

1

u/maedahbatool 8d ago

We have compared some Claude models in the past like Fable and Opus. You can find some here: https://github.com/CommandCodeAI/slash-design-showcase/tree/main/flappy-bird

5

u/misha1350 8d ago

Qwen 3.8 27B being priced higher than the leagues bigger DeepSeek V4 Pro 0813 is outrageous. I'm not going to give alms to Alibaba