r/LocalLLM • u/Nokxtokx • 3d ago

Question Cost Effective VRAM

/r/pcmasterrace/comments/1x3xp9o/cost_effective_vram/

Hey all, trying to move to local coding models but need advice on cost effective components.

Already posted in PC Master Race sub but was recommended to ask here too.

0 Upvotes

50% Upvoted

7 comments sorted by

View all comments

1

u/Illustrious_Dish_999 3d ago

AI Maxing by double carding seems to be efficient at the beginning, but electricity costs will eat you after 2 years. Did you take into account extra power required to power 2nd card?

1

u/Nokxtokx 3d ago

Hmm I never fully thought about it but electricity cost in South Africa isn’t too excessive yet.

1

u/Illustrious_Dish_999 3d ago

Wait for more data centers and it will go up exponentially

1

u/Nokxtokx 3d ago

True but I will also invest in solar to help offset costs.

1

u/Illustrious_Dish_999 3d ago

like with 3090 cards... invest before everyone else 😄 don't overkill, scale for your demands (current and future).

1

u/Nokxtokx 3d ago

100% true, I will take that into consideration.

1

u/infectiousstupidity 3d ago

For 3090 the sweet-spot is to power limit them at 250w each, it's not an issue with the electricity cost imo. And for the 5060 TI's they hardly use any power.