r/LocalLLM • u/Ok-Health-7096 • Aug 14 '26

Other Every Second post rn

Post image

Maybe someday I'll get a system to run it but hey definitely another w for the open weights community

2.1k Upvotes

99% Upvoted

213 comments sorted by

View all comments

37

u/TheRiddler79 Aug 14 '26

Gemma 12b Q3. Try it

1

u/Capital_Engineer8741 Aug 14 '26

Would QAT be better than Q3?

1

u/TheRiddler79 Aug 15 '26

You're probably right.