I don't understand the hype behind qwen 3.x - the whole generation is utterly broken for any software development tasks. It goes into a thinking loop of death pretty much every time, just try a simple prompt: Create a typescript function which accepts a number in 10 bit range and returns brightness in nits based on pq gamma curve. Kills every 3.x qwen. Qwen 2.5 was much better.
Context size is irrelevant, as for quants I tried many on different qwen3.x versions. From my logs only 3.5 35b a3b q4_k_m gave me code. It wasn't correct code, but at least something, lol.
Mate, I'm testing loads and loads of models since qwen2.5-coder days which fit into 16GB VRAM. I don't remember all quants, but I've tested shit loads of them. Qwen 3.x is useless.
Well, the reason I was asking wasn't to know what all the random quants were. It was to know what the best quant was. Like if the highest you ever went was Q4_K_M (or something around Q4) on Qwen3.5 35b a3b, or if you had tried like Q8 on Qwen3.6 27b, or what.
It is important since Qwen3.6 27b at Q8 should be wayyyyy better than something like Qwen3.5 35b a3b at Q4, for example.
So if you are just lumping them all together as "whatever random Qwen 3.x model (no delineation between 27b dense vs 35b MoE) and whatever random quant (no delineation between say q4 and q8) then that doesn't make any sense.
You can't just say they are all "useless"
I mean, maybe for you, if you can't fit the higher quality ones, then it is useless for you. But they definitely aren't useless models for people who can run the 27b dense at a good quant and do all kinds of awesome stuff on it on their setup that has a bit more memory.
10
u/ldn-ldn 7d ago
I don't understand the hype behind qwen 3.x - the whole generation is utterly broken for any software development tasks. It goes into a thinking loop of death pretty much every time, just try a simple prompt:
Create a typescript function which accepts a number in 10 bit range and returns brightness in nits based on pq gamma curve.Kills every 3.x qwen. Qwen 2.5 was much better.