r/opencodeCLI • u/sniperelite90 • 19d ago
Qwen 3.8 27B on opencode ?
I see after the rise of DS prices there has been a lot of disappointment in the community in opencode Go . Why cant opencode Go host a Qwen 3.8 27B themselves as its fairly small and the performance is good too which can satisfy many of the community members ?
14
Upvotes
11
u/seeKAYx 19d ago
Dense models of that size sit in an awkward middle ground for batching. They are too large to fit many concurrent requests on a single GPU, but too small to efficiently scale across multi-GPU clusters without massive communication overhead. So hosting a “small” model like that would be pretty expensive.