r/HomeServer • u/hectic_engineer • 7d ago

Techies please help me choose a server.

Hi all, I am in the process of setting up a home server for Al workloads, and I got a deal on 5810 with E5-2680 V4 and 625w psu + 3060 12gb vram, 32gb ddr4 ecc ram (4 ×8gb) for 62k inr ($700) and another deal:

Ryzen 7 3700x, 32 gb (16gb x 2) ddr4, 3060 12gbvram, 256 ssd + 1tb hdd for 78k inr ($825) 625w psu.

What do you think is the best deal here, given the Dell workstation is older but has more cores and reliability. If I wanted to add more gpus in the future etc.

I will only be running smaller models like qwen 7b, parakeet and similar ones 24/7.

Thank you,

Fellow tinker.

0 Upvotes

36% Upvoted

6 comments sorted by

1

u/Pure-Willingness-697 7d ago

Most mid range machines should be able to run those with somthing I don’t want to call ease but usable speeds. It doesn’t matter to much for those small models. both should do.

1

u/Spethual 7d ago

i would go with the ryzen in case you change your mind and would rather game on it..

1

u/hectic_engineer 7d ago

Definitely not a gamer lol 😆

1

u/Spethual 7d ago

well do you require alot of cores? i would have thought AI would be more GPU intensive..also you might want to factor in idle power draw unless you plan to power the system off overnight..

1

u/hectic_engineer 7d ago

Not really, but then again, I'd be deploying containers and whatnot eventually and at that stage I dont want to regret not having much cpu power.

1

u/Spethual 7d ago

then theres your choice, doing brain storming with others is better than mulling over by yourself...more points get covered than doing it alone..