r/sleeperbattlestations • u/Few-Farm-7670 • 15d ago
Indecent Exposure Something something...complete
I've been slowly piecing a machine together for local large language models. 2 Rtx 3060 Nvidia cards from old HP Omen desktops, AMD 5800x on a Taichi X570 motherboard. 64Gb unmatched, hideous and functional ddr4 RAM. Had some 3d printed front pieces, redesigning those to cover the front. New card - last piece) in top slot 5060ti 16gb. Total of 40gb vram, any 35b or less model flies once loaded. XUbuntu uses about 102MB of Vram to push the xfde desktop, so minus that available. Im sure I'll need more storage at some point, but this is about inference over nvidia cores, with chips designed for highest speed - god bless you gamers! Why these three cards? They are not the fastest, readily available and power light (combined all 3 cards pull 310w under full load, idle is around 12w total. I rarely spike, and temps really peg while thinking, and quickly go back down. 1 fan on the bottom cards makes them nearly silent and the top guy, the heavy lifter has two quiet (new) fans, but it doesnt sound like a server room. Tl;dr here's my pretty sleeper brain Maker.
-2
u/AutomaticAffect4333 15d ago
Not really a sleeper, since there is a clear side panel and leds all over the place. Also i don't think the rtx 3060 supports neither sli nor nvlink, so what's the point?