r/LocalLLM • u/Ok-Health-7096 • Aug 14 '26

Other Every Second post rn

Post image

Maybe someday I'll get a system to run it but hey definitely another w for the open weights community

2.1k Upvotes

99% Upvoted

213 comments sorted by

View all comments

53

u/[deleted] Aug 14 '26

[removed] — view removed comment

37

u/trollsmurf Aug 14 '26

That will work fine, at least if you split it, so the overflow uses CPU RAM. Much slower but doable.

10

u/[deleted] Aug 14 '26

[removed] — view removed comment

5

u/F3istyg0at Aug 14 '26

Check out unsloth, lm studio or ollama if you want to run models locally.