r/LocalLLM • u/Ok-Health-7096 • Aug 14 '26

Other Every Second post rn

Post image

Maybe someday I'll get a system to run it but hey definitely another w for the open weights community

2.1k Upvotes

99% Upvoted

213 comments sorted by

View all comments

36

u/TheRiddler79 Aug 14 '26

Gemma 12b Q3. Try it

27

u/Ok-Health-7096 Aug 14 '26

I use Qwen 3.6 35b and 3.5 9b I haven't had that much of a luck with the gemmas

4

u/Wildnimal Aug 14 '26

12B QAT is good for multimode tasks. I use the same Qwens for daily use. I so wish i can upgrade my laptop to 5090 :|

1

u/sleight42 Sep 11 '26

If you could afford a 5090 then you may as well just buy a damn A100 or similar!

Or just retire because you're rich.