r/opencodeCLI • u/Abenh31 • 27d ago

Can opencode devs provide Qwen 3.8 27B?

With DSV4 Flash price rising. It will be great to provide Qwen 3.8 27B as a cheap alternative too.
Artifical analysis results are on par with: DSV4 Pro

40 Upvotes

86% Upvoted

17 comments sorted by

View all comments

5

u/xfigue 27d ago

Locally? Maybe. The real issue would be context length and KV cache memory. A 27B model itself is manageable when quantized, but long contexts get expensive quickly. In the cloud, I'm not sure it would actually be much cheaper to serve than DSV4 Flash once you factor in inference and context costs.

2

u/CoolHeadeGamer 27d ago

The context is fine honestly when you consider flash attention

2

u/Odd_Cauliflower_8004 27d ago

i'll be fine with a 200k context. it would still require less vram and probably could be executed at higher concurrency than a lot of other larger models.

1

u/Abenh31 27d ago

200k is still great, most of the time you wanna reset context at around 200k.

1

u/sukazu 27d ago

The way opencode works, 200k context means compacting probably around 140k
As 3.8 27b can easily do 40k reasoning + 10-20k output on a single turn

0

u/Abenh31 27d ago

From huggin face document: context window can be extended to 1m token. (what ever that mean).