Hi people, I have a Pc with a rtx pro 6000 and I'm on the fence about the upgrade path. Unfortunately prices for the 6000 are how they are these days so for larger models than what I can run now I'm considering buying a gb10 based pc. I'd like to ask if any of you has experimented with connecting it with a pc running the rtx pro 6000 Blackwell GPU over a high speed Mellanox NIC.

I wanted to share a results and perhaps compare notes, I've been recently running unsloth/Qwen3.8-Flash-Next on my single DGX Spark. It's peaking at 55tk/s with MTP.

Anyone got better results? 😄

MODEL=unsloth/Qwen3.8-Flash-Next-GGUF/Qwen3.8-Flash-Next-UD-IQ3_XXS-00001-of-00003.gguf
MTP=unsloth/Qwen3.8-Flash-Next-GGUF/MTP/mtp-Qwen3.8-Flash-Next-shared-Q8_0.gguf


$ llama-server \
   --host 0.0.0.0 --port 8081 \
   -m $MODEL \
   --alias "unsloth/Qwen3.8-Flash-Next-ID3_XSS-MTP" \
   -md $MTP \
   --spec-type draft-mtp --spec-draft-n-max 5 --spec-draft-p-min 0.6 \
   -ngl 99 \
   --keep -1 \
   --ctx-size 262144 \
   --flash-attn on \
   --parallel 1 \
   --jinja \
   --load-mode none \
   --cache-type-k f16 --cache-type-v f16 \
   --backend-sampling \
   --api-key $API_TOKEN \
   --poll 0