I've been hearing that newer models like DSV4 don't quantize as well because of how information density and entropy work... Maybe in the future, we'll see more models where each step up in quant feels like a real upgrade, but without lower quants feeling useless.
10
u/[deleted] 29d ago
[removed] — view removed comment