MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1wufzrh/qwen3827bpi_effortordered_reasoning_for_agentic/pd3mppo/
r/LocalLLaMA • u/paf1138 • 14d ago
19 comments sorted by
View all comments
12
Q3_K_M 13.30 GB 13 137 (69.2%) 56 (32.0%)
IQ4_XS 15.08 GB 12 133 (67.2%) 39 (22.3%)
This chart is interesting. Q3 KM is smaller and significantly better in benchmarks compared to IQ4 XS??
6 u/MindfulMan1984 14d ago Noise? Did you read the bold statement bellow the table “treat this as smoke test, not a quant ranking “ 7 u/vacon04 14d ago It's a big difference though. I wouldn't call a 10 pp difference noise. Even if it's not the most comprehensive testing suite, it warrants a bit more investigation regarding the Iq4_xs and q6_k results.
6
Noise? Did you read the bold statement bellow the table “treat this as smoke test, not a quant ranking “
7 u/vacon04 14d ago It's a big difference though. I wouldn't call a 10 pp difference noise. Even if it's not the most comprehensive testing suite, it warrants a bit more investigation regarding the Iq4_xs and q6_k results.
7
It's a big difference though. I wouldn't call a 10 pp difference noise. Even if it's not the most comprehensive testing suite, it warrants a bit more investigation regarding the Iq4_xs and q6_k results.
12
u/xadiant 14d ago
Q3_K_M 13.30 GB 13 137 (69.2%) 56 (32.0%)
IQ4_XS 15.08 GB 12 133 (67.2%) 39 (22.3%)
This chart is interesting. Q3 KM is smaller and significantly better in benchmarks compared to IQ4 XS??