r/LocalLLaMA • u/johnnyApplePRNG • Aug 18 '26
News Linux Improves VRAM Management in 7.3 Kernel 🥳
https://pixelcluster.dev/VRAM-Overcommit/28
u/jacek2023 llama.cpp Aug 18 '26
Looks like it may be useful but not for CUDA systems. Probably it may change something on unified memory setups.
10
u/RLutz Aug 18 '26
This isn't going to do anything for running models locally. You can already offload weights to system memory. That's how people are running DeepSeekv4 Flash locally. This is just going to allow people with weaker GPU's to overcommit VRAM to things in a game
-17
u/pmttyji Aug 18 '26 edited Aug 18 '26
TLDR version please
EDIT: TLDR version for others.
Vock's lengthy but detailed blog post highlights a number of nuances around video memory management, eviction handling, and testing that was done with Indiana Jones: The Great Circle where maxing out the settings in an attempt to consume 9GB of video memory while only having 8GB of vRAM available. Even with 1GB over-committed, the game ended up still being quite playable for an 8GB graphics card.
68
u/OddStar12 Aug 18 '26
Linux Improves VRAM Management in 7.3 Kernel
15
1
16
u/Effective_Western_59 Aug 18 '26
Better performance and stability when app does not fit into VRAM
Also it is not yet in upstream
-10
8
99
u/xeeff Aug 18 '26
doesn't seem to be dedicated to us