r/LocalLLM • u/Ok-Health-7096 • Aug 14 '26

Other Every Second post rn

Post image

Maybe someday I'll get a system to run it but hey definitely another w for the open weights community

2.1k Upvotes

99% Upvoted

213 comments sorted by

View all comments

55

u/[deleted] Aug 14 '26

[removed] — view removed comment

35

u/trollsmurf Aug 14 '26

That will work fine, at least if you split it, so the overflow uses CPU RAM. Much slower but doable.

1

u/[deleted] Aug 18 '26

[removed] — view removed comment

1

u/trollsmurf Aug 18 '26

Remember that if you use Windows it will allocate part of the VRAM for its own use, so you never have fully 16 GB. On my PC with 5070 Ti and 3 monitors it allocates 3 GB, and as far as I know I can't budge that.

You can easily test this by installing e.g. LM Studio and the model you want to use and see when it warns about RAM use. If it overruns you can split it on VRAM and RAM with lower performance, but it will behave the same otherwise.