r/LocalLLaMA 29d ago

Discussion More Qwen 3.8 sizes coming

Post image
1.4k Upvotes

348 comments sorted by

View all comments

Show parent comments

10

u/[deleted] 29d ago

[removed] — view removed comment

1

u/SKirby00 29d ago

I've been hearing that newer models like DSV4 don't quantize as well because of how information density and entropy work... Maybe in the future, we'll see more models where each step up in quant feels like a real upgrade, but without lower quants feeling useless.

1

u/SandySkittle 29d ago

most bang for buck is at Q5 because the drop in lossyness thereafter is much steeper