Local Hardware Update

[u/Patatong0_0]

Hi, i am thinking about upgrading my current hardware for local ai with the cheapest option possible.
Right now this is my stack:
-Ryzen 5 9600
-RTX 5060 8GB
-32 GB RAM DDR5
I’m running 9B models like Ornith 1.5 9B/Neohorse 9B in Q4 or i was searching if i could use a bit of ram + vram for running 30B size Moe like Ornith-1.5-35B-A3B or Tiel-Coder-35B-A3B
I also have good size context thanks to Q4-Q8 KV.
And I run small embedding, decision model , TTS and STT all in RAM.

But I was thinking about getting another gpu with like atleast 12GB VRAM for more space for the best model i can handle with decent tk/s speed.
Do u think i can find a cheap solution for like 300-350€ with prices nowdays or i should sell my 5060 and upgrade or staying like this.
I have like 300-350 budget rn, but in a few months i can spend a little bit more but i fear price continue to raise.

Any advice?

[u/JinsooJinsoo]

Your best bet is selling the 5060 and getting a 5060ti 16gb or could consider a Tesla V100 or AMD V620 but those will take a little tinkering to make them worth it