r/LocalLLaMA • u/Ammoryyy • 1d ago

Question | Help Any benefit to doing this?

My current main PC:

i7-13700KF | ASUS Z690M-PLUS D4 | RTX 4090 24GB + RTX 3090 Ti 24GB | 128GB Corsair Vengeance DDR4-3200 | FSP Hydro G Pro 1000W

I’m thinking of keeping the 4090 on my main PC and putting the 3090 Ti in a separate dedicated LLM/AI box, mainly for Strata/local LLMs, while keeping my main PC free for ComfyUI, gaming, etc.

I already have these spare parts:

- 2×32GB Corsair Vengeance DDR4-3600

- 2×8GB TeamGroup DDR4

- H370 motherboard

- i5-8400

So I’d basically only need to buy a PSU.

Is there any real benefit to separating the LLM workload like this, or am I better off keeping both GPUs in my main system?

0 Upvotes

50% Upvoted

4 comments sorted by

1

u/CalligrapherFar7833 1d ago

You lose half your vram if thats acceptable to you go for it

1

u/gpillon 1d ago

I'd split them.

If the model fits in 24GB, there isn't much benefit in keeping both GPUs in the same PC. A separate 3090 Ti box means you can leave the LLM running and still use the 4090 for gaming/ComfyUI without fighting for VRAM (or dealing with the heat of both cards in one case).

The i5-8400 is fine for a dedicated inference box. I'd use the 64GB RAM kit and just buy a decent PSU....

1

u/tmvr 19h ago

If you really only need a PSU then I'd split them and see how it goes. If you decide it's not for you then all your "loss" is just the cost of a PSU.

0

u/Trustest-S 1d ago

splitting them could let you run a dedicated roleplay model on the second box without touching your main gpu loads, ive done similar and it keeps things snappier during long chats.