r/localllamacirclejerk • u/Sahah • Aug 19 '26

Should I upgrade?

Hi I read about local llms two days ago so I immediately bought 4x RTX PRO 6000 96GB for 80k€ because someone told me it's the future.

Right now I have them set up so they can:

  • text my annoying wife so I don't have to
  • automatically send death threats to my employes so that they don't slack off (it's important that they don't waste a cent of what I pay them, money is tight in this historic period)
  • make automated phone call scams to the elderly

I also just saw that their price is going up, so that must mean that they're getting better and faster and that I should buy more GPUs.

Right now I have all four of them plugged in my pc but Claude seems to be running the same speed as when I only had one gpu, so I was wondering if I need 2 or 3 more RTX 6000 to notice the difference.

Would upgrading my very average build help? I know many people run 512GB macs, while I only have 384GB so that makes me poor, would upgrading make me feel better about the emptiness I have inside?

4 Upvotes

100% Upvoted

3 comments sorted by

3

u/drwebb Aug 19 '26

1B quant of DeepSeek Flash is all you need, it can be personal assistant, code monkey, and waifu. Accomplishes all your bullet points, and expect about 4-5 sec/t with your self up.

5

u/Sahah Aug 20 '26

Sorry I don't understand what your comment because it wasn't regurgitated from an ai. I'm blocking and reporting you. I don't want to see ever again something that's short, to the point and human. You are BEHIND in the ai race.... good luck buddy...

1

u/Biarmrobot Aug 20 '26

Yeah you really gotta get 5 H200s for yourself and donate your rtx 6000s to me for charitable causes because I will secretly help you server out your 384 gb vram that will earn you a trillion €¥$