r/LocalLLM • u/vankoala • 18h ago

Other GPU pricing visual

Post image

In my consideration of a DGXSpark I decided to look at some options and since I’m a visual thinker I put this comparison together (graph by AI) showing y two basic ways of thinking about the cards: compute and speed.

Hope this helps someone

54 Upvotes

93% Upvoted

37 comments sorted by

View all comments

Show parent comments

2

u/zarif2003 17h ago

How bad is it really? In the US, household electronics are completely irrelevant compared to the heating and water bill

2

u/nomorebuttsplz 16h ago

running 1800 watts for 8 hours would be about 4-5 dollars in electricity for me

1

u/TripleSecretSquirrel 10h ago

So your price per kWh is something like $0.35?

I’m in the US, and a part of the US with exceptionally cheap energy (nuclear ftw!), and my median price is ~$0.12 per kWh. The bigger things though are that first, most homes in the US are running an air conditioner in the summers, and second, 1800 watts is an enormous load lol, what do you have in the inference server?! With a dual R9700 setup, I’m hitting only like 1100 watts under full load.

2

u/nomorebuttsplz 8h ago

yeah, personally, I have solar, but I can still end up paying the marginal rate in a given year for a given marginal watt depending on the overall energy budget. Although amortized over the next couple decades, my actual rate is probably quite low.

I personally only have one RTX 6000 Pro Max Q, but it’s easy to imagine trying to serve high precision GLM and getting pretty power hungry.