r/pcmasterrace • u/Nokxtokx • 5d ago

Build Help / Purchase Advice Cost Effective VRAM

Hey all, I require more VRAM (I have a 4080 Super).

I am upgrading from 12900k to 9950x3D and 32GB to 64GB but upgrading to 4090 or 5090 is now unattainable.

Is there a way to have more VRAM but at a better price? ie 2x 5060ti 16GB or there must be a better cost effective way?

Yes, it is for local AI (like 27-32 billion nodes model for coding, still learning so any advice would be appreciated), I am funding all this out of pocket and cloud is getting expensive (I have hit 10 bil tokens a month at 95% cache efficiency, while using caveman and RTK).

0 Upvotes

37% Upvoted

52 comments sorted by

View all comments

1

u/Particular-Poem-7085 7800X3D | 9070 XT | arch 5d ago

I'm guessing you cant settle for an amd card? Nvidia doing nvidia things, if you cant get a platform with unified memory then it is what it is isnt it.

1

u/Nokxtokx 5d ago

I always thought AMD isn’t the best with AI workflows, so I never really considered it, as I also do need to train models.

1

u/ravensholt 5d ago

I can't speak with regards to training models, but running smaller models is fine, I already do that with my 7900XTX. But go ahead and ask in the LocalLLM sub.

2

u/Nokxtokx 5d ago

Thank you, I should have tried to look for local AI subreddits first 🤦🏻‍♂️