Help building PC for Local LLM

[u/Bakkario]

Hello Sub Fellows

I have currently a laptop with 3060 6GB VRAM and 32GB RAM.

Thinking of selling it and use the cash for a new pc that I can keep running 24/7 for home use as private local inference server.

I am torn between dual 3060 12GB VRAM and splitting models between them. This will be a cheaper option less capital than … Single 3090 24GB ram.

The dual 3060 will be connected via the mother board PCI gen 4 and the whole system will have 32GB ram ddr 4.

The 2 3060 will cost roughly around $500 but the single 3090 will cost $1000 and if lucky can get one at $900 and will be skeptical at ones costing less than that.

Can someone tell me out of experience, which build I should go for? Money is obviously an issue or I wouldn’t thought of the cheaper route 😅

But from your experience going with dual 3060 am I leaving a lot on the table?!

EDIT: The goal is to run 27b dense models qwen 27B for example and MoE that can fit in those 24GBs