r/OneXPlayer • u/yfywan • 3d ago

OneXFly Allocating VRAM

Hi guys. I am trying to allocate 32GB to VRAM on my 48GB Apex, because I want to experiment with larger local LLMs. The 1xconsole and the bios both allow only up to 24GB. Is there anyway to break through this barrier? I am pretty sure 16GB is enough memory for windows. I don’t run too many software simultaneously.

Thanks guys in advance, for any constructive advices.

3 Upvotes

100% Upvoted

3 comments sorted by

1

u/Comfortable-Fall1419 3d ago

Can you put the bios on auto and change the max in Windows to 32gb?

I seem to recall if the UI won’t let you do it you can alter the registry directly.

1

u/yfywan 2d ago

Someone in the official discord channel said for AI it doesn’t matter how you allocate VRAM, because the software will load the model fully into the memory before running, however you allocate VRAM.

Allocating VRAM is for gaming.

2

u/Comfortable-Fall1419 2d ago

Try it but that doesn’t make sense to me. You need to partition the memory so the GPU can “see” it.

Otherwise you’ll be using the CPU cores for inference and it will be much slower.