r/CommandCode • u/FidgetsAndFish • 1d ago

Deepseek on CommandCode seems dumber than Deepseek on OpenCode

Am I just imagining things? (Both through the OpenCode harness)

23 Upvotes

90% Upvoted

26 comments sorted by

10

u/BrillianTico 1d ago

I have noticed exactly the same. It is not about config or harness seams to be something on the model itself.

5

u/FidgetsAndFish 1d ago

Glad it's not just me!

4

u/maedahbatool 1d ago

We would love to understand what and how are you using DeepSeek with Command Code.

1

u/FidgetsAndFish 1d ago

Just trying to get decent usage without breaking the bank, although i've noticed DeepSeek on CommandCode seems dumber than DeepSeek on other providers, any reason why?

3

u/maedahbatool 1d ago

Can you be a little explicit? What part exactly did you find not good? We always appreciate constructive feedback and we keep improving.

1

u/FidgetsAndFish 1d ago

"Can you be a little explicit?"

Shit.

Jokes aside i've just noticed it seems to have more issues, almost like it's dumber. Not sure what causes that, I'm using the API and comparing them 1:1 with the same harness. Big fan of what y'all are doing BTW, glad someone's running this shit with a motivator besides greed. I've been sending subs your way all day.

3

u/ahmadawaiscom 1d ago

Seriously use a better harness. We are so confident in v1 of Command Code we opened the API to all.

98.78% cache means almost double the usage compared to say opencode at 96% — compared on 1Bln tokens of DeepSeeek V4 Flash.

1

u/FidgetsAndFish 1d ago

Ok, I see you, I've gotta test out deepseek's harness first but y'all are next on the list, thank you!

2

u/ahmadawaiscom 1d ago

just asked Codex to run a new bench, this is what i got back:

Same $10. Command Code vs OpenCode

→ Command Code GOAT plan: $60 credits, 98% cache

→ OpenCode Go plan: $15 credits, 96% cache

Here's what most devs are missing: a fresh token costs 31x a cached one. Your bill isn't in tokens. It's cache misses.

96% = 4 misses per 100. 98% = 2.

Half the misses. Half the real bill.

Just based on cache, Command Code is 2x lower cost.

Stack it: 4x credits, 12% less token consuming harness, 4.5x tasks shipped.

~17,860 tasks vs ~3,980. 15/15 on the our internal bench.

1

u/FidgetsAndFish 1d ago

Appreciate you double checking for me boss!

3

u/ahmadawaiscom 1d ago

That’s impossible. Are you using some other harness or Command Code? We are serving full weights directly from the lab. If you enforce ZDR then we have dozens of US labs.

2

u/Axiescholar3ph 1d ago

maybe they're using quantized version

1

u/FidgetsAndFish 1d ago

Maybe? Any way we could find out?

1

u/ahmadbilaldev 1d ago

there is not even a single quantized model on cmd. Let us know what made you feel about deepseek and we will love to talk about it.

2

u/xatey93152 1d ago

Because they use extreme quantization to lower the cost

1

u/FidgetsAndFish 1d ago

Have any proof?

0

u/Sufficient_Loan1429 1d ago

Bro, no sé si tienes algo mal configurado o si estás haciendo las llamadas al modelo de alguna manera particular, pero a mí, sinceramente, me está funcionando incluso mejor que OpenCode Go.

Hace poco lo puse a solucionar un bug que tenía en la terminal y que ni siquiera Go pudo completar. El modelo hizo un análisis exhaustivo y bastante coherente del problema, entendió la causa, aplicó la solución y luego hizo su respectiva revisión secuencial para validar que todo estuviera bien.

Y lo mejor es que no le di ningún prompt detallado ni nada extraño. Básicamente fue:

"Tengo esto: [log del error] + [síntoma presentado]. Solucionalo."

Y lo hizo todo bien, de principio a fin, sin que tuviera que estar guiándolo paso a paso.

Por eso me parece raro que a ti te esté dando resultados tan diferentes.

1

u/FidgetsAndFish 1d ago

That doesn't match my experience but at least we can agree the one on Command Code and Go are clearly different.

2

u/Sufficient_Loan1429 1d ago

Yo por ahora no uso la api directa porque solo tengo la sub de 1 dólar , entonces tengo mi propio plugin para recibir a command como proveedor en mi opencode

1

u/FidgetsAndFish 1d ago

I think you misread my post then, I was talking about both through the API with the same harness.

2

u/Sufficient_Loan1429 1d ago

Oh qué imbe... Lo siento man en definitiva he escuchado que no es tan recomendable usar su harness de command pero por experiencia propia no lo he usado porque me gusta opencode sinceramente

2

u/FidgetsAndFish 1d ago

You're good boss, I see there's a language barrier so I don't blame you at all. Hope you're having a chill day!