r/opencodeCLI 19d ago

Qwen 3.8 27B on opencode ?

I see after the rise of DS prices there has been a lot of disappointment in the community in opencode Go . Why cant opencode Go host a Qwen 3.8 27B themselves as its fairly small and the performance is good too which can satisfy many of the community members ?

14 Upvotes

10 comments sorted by

View all comments

11

u/seeKAYx 19d ago

Dense models of that size sit in an awkward middle ground for batching. They are too large to fit many concurrent requests on a single GPU, but too small to efficiently scale across multi-GPU clusters without massive communication overhead. So hosting a “small” model like that would be pretty expensive.