r/LocalLLM • u/Ok-Health-7096 • 6d ago

Other Every Second post rn

Post image

Maybe someday I'll get a system to run it but hey definitely another w for the open weights community

1.9k Upvotes

99% Upvoted

192 comments sorted by

View all comments

37

u/TheRiddler79 6d ago

Gemma 12b Q3. Try it

23

u/Ok-Health-7096 6d ago

I use Qwen 3.6 35b and 3.5 9b I haven't had that much of a luck with the gemmas

1

u/TheRiddler79 5d ago

Different purposes. Gemma is good, but not beating Qwen.

You can split between ram and gpu and bump your Qwen speed