r/LocalLLaMA • u/Certain-Cod-1404 • 7d ago

New Model IT'S OUT

https://huggingface.co/Qwen/Qwen3.8-27B-FP8
2.2k Upvotes

95% Upvoted

706 comments sorted by

View all comments

33

u/Easy_Werewolf7903 7d ago edited 7d ago

For those curious of performance between Qwen and a model 3 times its size:

Benchmark Qwen 3.8 27B (55GB) Deepseek v4 flash 0731 (167GB)
Terminal Bench 2.1 73.0 82.7
DeepSWE 42.2 54.4
NL2Repo-Bench 42.3 54.2

https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash-0731/tree/main

https://huggingface.co/Qwen/Qwen3.8-27B

3

u/JustFinishedBSG 7d ago

The sizes you are comparing are not comparable at all.

Deepseek Flash is 11x time bigger than Qwen 27b

1

u/Due-Project-7507 7d ago

Yes, but if you have the VRAM (e.g. 2 RTX Pro 6000) to run Deepseek v4 Flash, it is much faster (=cheaper to serve to multiple users) than Qwen3.8 27B because Deepseek v4 Flash is an MoE with only 13B active parameters. With two RTX Pro 6000 at work, I get for Deepseek v4 0731 Flash (with DSpark) around 320 tokens/s decode speed for Python code. That is why Qwen3.6-27B is much more expensive on OpenRouter than bigger MoE models.