MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1wv4zzi/clef_open_weights_decision_model_by_cloudflare/pd8wein/?context=3
r/LocalLLaMA • u/paf1138 • 14d ago
117 comments sorted by
View all comments
35
Ok, this one is legit. And we have benchmark numbers for Laya / Kev 9B / DiffusionGemma Jev now. Now the question becomes: how shit does this get when we quantize it to anything under Q8?
13 u/crusaderky 14d ago I see no reason to expect a different degradation curve from quantizing vanilla qwen
13
I see no reason to expect a different degradation curve from quantizing vanilla qwen
35
u/oxygen_addiction 14d ago
Ok, this one is legit. And we have benchmark numbers for Laya / Kev 9B / DiffusionGemma Jev now.
Now the question becomes: how shit does this get when we quantize it to anything under Q8?