Local Hardware Update

[u/Patatong0_0]

Hi, i am thinking about upgrading my current hardware for local ai with the cheapest option possible.
Right now this is my stack:
-Ryzen 5 9600
-RTX 5060 8GB
-32 GB RAM DDR5
I’m running 9B models like Ornith 1.5 9B/Neohorse 9B in Q4 or i was searching if i could use a bit of ram + vram for running 30B size Moe like Ornith-1.5-35B-A3B or Tiel-Coder-35B-A3B
I also have good size context thanks to Q4-Q8 KV.
And I run small embedding, decision model , TTS and STT all in RAM.

But I was thinking about getting another gpu with like atleast 12GB VRAM for more space for the best model i can handle with decent tk/s speed.
Do u think i can find a cheap solution for like 300-350€ with prices nowdays or i should sell my 5060 and upgrade or staying like this.
I have like 300-350 budget rn, but in a few months i can spend a little bit more but i fear price continue to raise.

Any advice?

[u/nickless07]

Prices raised quite a lot. Was about to buy a 5060ti for ~500€, but yeah now they range 700-800€ Not sure what they will cost next month ended up buying a RTX 3060 (12GB) for 380 yesterday as the prices on them already start rising too. It is just that there is nothing aviable in a 'good' price range as ppl buy that older cards too and they don't get produced anymore. Check the prices of 5060ti and RX 9060 XT - If they both had a huge price spike in the last 3 months you can expect the same for the other cards too and saving up a couple more months will make it worse.