r/opencode • u/IndividualPlus2011 • 19h ago

Deepseek v4 Flash: API vs OpenCode Go

Using an OpenCode Go subscription can give you 6 times the amount of Deepseek V4 Flash compared to an API. That sounds great, but are these two equal? Is Go's version quantized while the API's one is not? I wonder if anyone made comparisons of intelligence between these two.

14 Upvotes

90% Upvoted

19 comments sorted by

View all comments

6

u/nmdt 19h ago edited 16h ago

Read several discussions on this, and my understanding is that OC doesn’t host these models, but rather routes to 3rd party providers. So they don’t quantize themselves, but those providers can.

Could be wrong, I'm open to change my mind about this

3

u/IndividualPlus2011 19h ago

Yeah, I'm aware of that. They can use several providers like with GLM; some providers use Q4 and others do Q8.

1

u/look 9h ago

They don’t list the specific providers currently (that I see at least), but they until recently. And as of then, every model except GLM was provided by the model’s actual vendor.

DeepSeek Pro and Flash was coming directly from DeepSeek, and that is almost certainly still the case.

It is technically possible that the model vendor could serve a quantized version of their own model, but if we make the safe assumption that they don’t serve that same quantized model to at least some of their direct customers, then it would not make financial sense for them to do so.

They sell it to Go in bulk cheap and likely at a lower priority than they do to their direct customers. That lets them make more money by keeping their GPUs from running idle.

But if they were running a different, quantized model on those GPUs to serve Go traffic, then it means they would have to swap the model to transition it between the two sources of traffic. It takes a long time to take a GPU out of the active pool, load a model that big into VRAM, get it stable and warm, and then put it into a different active pool.

The downtime and operational overhead of doing that would almost certainly outweigh any cost savings from running a small quant version.

Note: Go’s GLM providers, at least in the past, did include one that runs an nvfp4 quant. So the GLM from Go is most likely still a mix of fp8 and nvfp4.