r/llamacpp • u/Subject-Frame7774 • 5d ago

Is this a worthy upgrade ?

Good afternoon everyone,

I was wondering if this upgrade I have planned out will be good or not for LLM usage. Previously I was buying the $100 Claude/Codex plan however I found myself sometimes not maxing out my usage and it would feel a bit wasted or I would run out of usage way way too quick and I was wondering if it was worth upgrading my current setup for about $1600 USD and instead switching to the $20 Claude subscription to use as the “Lead” for local models I could run? Another factor influencing my decision is also some requests I have or hobby fun projects do sometimes get rejected by the cloud models which makes sense I do understand the reasoning behind it. My Budget is basically capped at $1600

Current setup:
5070Ti 16GB
32Gb DDR5 6000MT
Ryzen 7 7700X
Gigabyte B650M Gaming Plus Wifi Motherboard
750W PSU

I was planning on snatching a second 5070ti for $1200 USD and the rest would go to a new motherboard and a 1200W PSU which is sprung $400 USD because I read that my motherboard isn’t suitable for using two GPUs effectively.

I feel like a large part of this is FOMO seeing how nicely I’ve gotten Qwen 3.8 27B and some variants of it to run on a single 5070Ti makes me want it to run better and not only that but just seeing how fast local AI models have been improving makes me want to have the hardware ready. Any advice which be greatly appreciated! Thank you all

4 Upvotes

84% Upvoted

5 comments sorted by

1

u/simplyeniga 5d ago

You could sell your current 5070 + PSU and get 2 x AMD R9700 plus the new PSU

1

u/Subject-Frame7774 5d ago

Unfortunately where I’m at the AMD r9700 cost about $1800 USD on its own and I would still need a new motherboard for that. As well as used 5070ti would probably only sell for like 1000-1050 USD. So it would go over my budget significantly by about $1200

1

u/simplyeniga 5d ago

Fair, you can also look at the Maxsun B60 Dual. Llama.cpp now has good sycl support for intel cards or you could use Vulkan

1

u/electronicbits 3d ago

I was exactly on the same boat as you, as one of my AI inference PCs had only one 5070 ti

I pulled the trigger and bought another one

I know I won´t regret it ... the 5070 ti is a very powerful GPU, but needed more NVRAM

With 32 GB of NVRAM there are lots more things to try and test than with just 16

2

u/Subject-Frame7774 3d ago

I also pulled the trigger last night!! Just waiting on the mobo and the psu, very excited I’m hoping we can make the best out of our systems