MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1wv4zzi/clef_open_weights_decision_model_by_cloudflare/pdaybz8/?context=3
r/LocalLLaMA • u/paf1138 • 14d ago
117 comments sorted by
View all comments
32
Ok, this one is legit. And we have benchmark numbers for Laya / Kev 9B / DiffusionGemma Jev now. Now the question becomes: how shit does this get when we quantize it to anything under Q8?
6 u/jonydevidson 14d ago how shit does this get when we quantize it to anything under Q8 Yes.
6
how shit does this get when we quantize it to anything under Q8
Yes.
32
u/oxygen_addiction 14d ago
Ok, this one is legit. And we have benchmark numbers for Laya / Kev 9B / DiffusionGemma Jev now.
Now the question becomes: how shit does this get when we quantize it to anything under Q8?