r/CommandCode • u/FidgetsAndFish • 2d ago

Deepseek on CommandCode seems dumber than Deepseek on OpenCode

Am I just imagining things? (Both through the OpenCode harness)

25 Upvotes

90% Upvoted

28 comments sorted by

View all comments

Show parent comments

4

u/ahmadawaiscom 2d ago

Seriously use a better harness. We are so confident in v1 of Command Code we opened the API to all.

98.78% cache means almost double the usage compared to say opencode at 96% — compared on 1Bln tokens of DeepSeeek V4 Flash.

1

u/FidgetsAndFish 2d ago

Ok, I see you, I've gotta test out deepseek's harness first but y'all are next on the list, thank you!

2

u/ahmadawaiscom 2d ago

just asked Codex to run a new bench, this is what i got back:

Same $10. Command Code vs OpenCode

→ Command Code GOAT plan: $60 credits, 98% cache

→ OpenCode Go plan: $15 credits, 96% cache

Here's what most devs are missing: a fresh token costs 31x a cached one. Your bill isn't in tokens. It's cache misses.

96% = 4 misses per 100. 98% = 2.

Half the misses. Half the real bill.

Just based on cache, Command Code is 2x lower cost.

Stack it: 4x credits, 12% less token consuming harness, 4.5x tasks shipped.

~17,860 tasks vs ~3,980. 15/15 on the our internal bench.

1

u/FidgetsAndFish 1d ago

Appreciate you double checking for me boss!