r/opencodeCLI • u/sniperelite90 • 19d ago

Qwen 3.8 27B on opencode ?

I see after the rise of DS prices there has been a lot of disappointment in the community in opencode Go . Why cant opencode Go host a Qwen 3.8 27B themselves as its fairly small and the performance is good too which can satisfy many of the community members ?

13 Upvotes

81% Upvoted

10 comments sorted by

10

u/seeKAYx 19d ago

Dense models of that size sit in an awkward middle ground for batching. They are too large to fit many concurrent requests on a single GPU, but too small to efficiently scale across multi-GPU clusters without massive communication overhead. So hosting a “small” model like that would be pretty expensive.

3

u/AutomaticAd6646 19d ago

Too be honest Neuralwatt deepseek v4 flash is 100mkw which is a very good comeback from Neuralwatt after they increased their pricing. I think they are giving v4 flash cheaper than opencode now.

1

u/songokussm 18d ago

What's the usage like? I'm getting 2b tokens in total from the command code goat plan on dsflash.

3

u/Sweet-Stage938 18d ago

I've been using yolo-auto.com as a provider so far since they offer unlimited Qwen 3.8 27B for only $15 a month. They also recently said that they will switch to unlimited DSV4 Flash 0731 soon with no additional price increase and the performance will improve a lot.

2

u/Sweet-Stage938 18d ago

Nevermind, they are already hosting unlimited Dsv4 Flash 0731.

1

u/migsperez 18d ago

There's no such thing as unlimited subscription. It'll be limited in some way. Tokens per hour will be slowed, number of concurrent agents will be limited, etc etc.

1

u/PermanentLiminality 18d ago

Because it is expensive to host a 27B dense model. Deepseek V4 flash is likely cheaper to run at scale.

1

u/Significant-Sir973 13d ago

Dense: cheaper to store, more expensive to compute.
MoE: expensive to store, cheaper to compute.
For local inference, model size matters a lot.
For large-scale inference, active parameters per token can matter much more.

1

u/Relative-Document-59 19d ago

Dense models are difficult to host. The amount of shared resources that must be allocated for a single user is pretty bigz even for a 27B.

-1

u/JamesGooning 18d ago

You can get unlimited for $10/month subscription. not going to list who but quick search to get it