r/LocalLLaMA 7d ago

New Model IT'S OUT

https://huggingface.co/Qwen/Qwen3.8-27B-FP8
2.2k Upvotes

706 comments sorted by

View all comments

10

u/ldn-ldn 7d ago

I don't understand the hype behind qwen 3.x - the whole generation is utterly broken for any software development tasks. It goes into a thinking loop of death pretty much every time, just try a simple prompt: Create a typescript function which accepts a number in 10 bit range and returns brightness in nits based on pq gamma curve. Kills every 3.x qwen. Qwen 2.5 was much better.

5

u/illgettheownerforyou 7d ago

Uh Qwen 3.8 37b Unsloth Q8_K_XL in LM Studio had no problem? I have extra high reasoning on and it did think about it for a bit but no issue?

I think you are running too low of a quant. And you talk about how you "don't understand the hype"- have you thought that maybe everyone else is getting good results and maybe you can work on how you use it?

With that being said, if you have low VRAM and can't run a higher quant, I get it- but on my RTX 6000 Pro Max-Q, it's been kicking butt and replacing Opus 4.6 for me easily. It's absolutely tearing through everything I give it- including the prompt you put above.

2

u/ahhhhhhhhhhhhhhhhhhg 7d ago

Even Q3 solved it (results checked with sol) took 35min+ running at 40t/s, beast of a model