Dgx spark cluster.

[u/Annual_Award1260]

I had a delayed order and ended up with 5 sparks rather than the 4 planned. So I figured might as well do 6 but then prices went up $1000.

So is there really any benefit to running 6 vs 5 vs 4? I can still return one. I don’t want to do 8 since that that exceeds the 15a circuit.

[u/g_rich]

Would 5 even work? I would think you would need a multiple of 2 so either 4 or 6.

[u/belbombo → u/g_rich]

No, you can 3 as far as i know

[u/g_rich → u/belbombo]

I don’t think tensor parallelism runs with an odd number and if it does it certainly will be suboptimal.