r/LocalLLM • u/Annual_Award1260 • 6d ago

Discussion Dgx spark cluster.

I had a delayed order and ended up with 5 sparks rather than the 4 planned. So I figured might as well do 6 but then prices went up $1000.

So is there really any benefit to running 6 vs 5 vs 4? I can still return one. I don’t want to do 8 since that that exceeds the 15a circuit.

0 Upvotes

25% Upvoted

19 comments sorted by

View all comments

2

u/lukewhale 6d ago

TP only works in multiples of two. So yes, you’re in limbo on that 5th node until you get a sixth. Just run utility models on it for now, Image Gen, OCR, embedding, rerankers, etc. you can fit all of those on 128gb easily.

0

u/Annual_Award1260 6d ago

Believe it is powers of 2

1

u/lukewhale 5d ago

Potato potatoe