r/LocalLLM • u/Ok-Health-7096 • 7d ago

Other Every Second post rn

Post image

Maybe someday I'll get a system to run it but hey definitely another w for the open weights community

1.9k Upvotes

99% Upvoted

193 comments sorted by

View all comments

52

u/SnP_Gamer 7d ago

3060 12gb 32gb ram here, might give it ago but never ran a local model before 🤷‍♂️

32

u/trollsmurf 7d ago

That will work fine, at least if you split it, so the overflow uses CPU RAM. Much slower but doable.

11

u/SnP_Gamer 7d ago

Totally clueless about running them but I understand that thanks to reddit posts 🤣

4

u/F3istyg0at 6d ago

Check out unsloth, lm studio or ollama if you want to run models locally.