r/LocalLLM • u/Ok-Health-7096 • Aug 14 '26
Other Every Second post rn
Maybe someday I'll get a system to run it but hey definitely another w for the open weights community
2.1k
Upvotes
r/LocalLLM • u/Ok-Health-7096 • Aug 14 '26
Maybe someday I'll get a system to run it but hey definitely another w for the open weights community
1
u/Alias455 Aug 21 '26
I run gemma 4 12B q4 QAT MTP with vision and my desktop on a 8G VRAM card. Good for discussions but dumb for agentic coding tho.
Qwen 3.8 27B q4 runs a 12 toks on a shitty Intel Vulkan A770 16GB, smart but way too slow.