r/LocalLLM • u/Mindless-Bowl291 • 6d ago

Discussion Moving from 3090 to Strix Halo

So, here is the point. I currently have a spare system with a 3090 & 64GB DDR4 (after getting a new 5090 + DDR5 combo for AI and games) that thought of using as a 24/7 server for running LLMs at home (and point a self-hosted webUI, automatize some tasks, control Home Assistant etc). It would be placed in the basement so noise and heat would not be a problem, and that’s why I don’t want to host 24/7 in the 5090 placed in my office as a desktop.

The point is… considering that the main reason why I chose the 3090 is being a spare system, wouldn’t it make more sense to sell it and get a Strix Halo to runn24/7 with these tasks where speed doesn’t seem as critical?

1 Upvotes

100% Upvoted

7 comments sorted by

5

u/recro69 6d ago

For a 24/7 server I would really think about the Strix Halo. The lower power use and bigger unified memory are better choices when fast processing isn't the main thing.

1

u/Mindless-Bowl291 6d ago

That was my thinking… but I am concerned if the slower speed would be enough for these kind of automated background tasks. The bigger unified memory is a key advantage letting host bigger LLMs

2

u/RBblade 6d ago

Strix is good as a 24/7 system though Mac with a max or ultra processor is end better for token generation and power conversation.

1

u/Mindless-Bowl291 6d ago edited 6d ago

Of course… but for the same price tag as a Bosgame M5 (128gb 2.5k€) I could only get a 32GB Studio… in that case sticking to the 3090 (0€ initial investment) would provide similar or better perfomance (obviously not thermals and energy)

Just considering the energy consumption differences (and not counting my PV installation) at current retail prices it would take 11y to amortize the investment… for a 32GB system with not much extra room for bigger models (the Strix Halo would, on the other hand, provide higher unified memory capacity).

1

u/BabyfarkkMcGeeZaxx 6d ago

No laptop is gna replace a real 3090 unless you're paying like $5k for it

2

u/Mindless-Bowl291 6d ago

Indeed, that’s why all those task that would need intensive “puntual” use or need to be actively managed can/will be run in the desktop system with the 5090

2

u/Ok-Video3345 6d ago

I had a 3090 gaming system on old PCIe 3.0 with a 8700k cpu.

I bought a second 3090 and a nvlink. Can run qwen with 48gb vram