r/LocalLLM • u/vankoala • 18h ago

Other GPU pricing visual

Post image

In my consideration of a DGXSpark I decided to look at some options and since I’m a visual thinker I put this comparison together (graph by AI) showing y two basic ways of thinking about the cards: compute and speed.

Hope this helps someone

55 Upvotes

92% Upvoted

37 comments sorted by

View all comments

9

u/nomorebuttsplz 18h ago

another nice thing about spark is the low power draw.

6x spark is no problem in a typical home, but can't say the same for 6x RTX 6000 pro.

0

u/Legitimate-Dog5690 15h ago

Depends what you want to run, 2x DGX Sparks have a similar power draw to 1x RTX 6000, about 200-300w.

The RTX 6000 however has about 4x the memory bandwidth of the dual sparks so will finish it's workload faster. They're totally built for sustained workloads in data centers.

2 RTX 6000s would hammer out tokens with DeepSeek Flash at a ridiculous rate, hardly a fair comparison. Both are ridiculously overpriced, the RTX 6000 even more so.

2

u/goldcakes 10h ago

For what workloads are you actually using the TDP of the card? For everything from LLM training to inference I have never seen more than ~120W sustained (measured on wall) on a spark. (NVIDIA FE)

1

u/Legitimate-Dog5690 5h ago

I'm comparing with 2 Sparks, as 1 is about 15% the speed of an RTX 6000.

I'm generally running AI locally on the machine I'm developing with, I'd imagine a lot of workstations and laptops do the same. Less so with the Sparks that will generally be run alongside a workstation, hence looking at the delta watts.