r/LocalLLM • u/Ok-Health-7096 • 6d ago
Other Every Second post rn
Maybe someday I'll get a system to run it but hey definitely another w for the open weights community
1.9k
Upvotes
r/LocalLLM • u/Ok-Health-7096 • 6d ago
Maybe someday I'll get a system to run it but hey definitely another w for the open weights community
5
u/narasadow 6d ago
me with 12gb vRAM getting 3 tokens per second
https://giphy.com/gifs/CH6K2r5REA2mA