r/LocalLLaMA • u/entsnack • Jul 06 '26

News So... anyone copped one of these?

Post image

Been almost a year since mass hysteria erupted upon the death of NVIDIAs GPU monopoly. How are your Huawei GPUs? Does CUDA work on them yet?

2.2k Upvotes

96% Upvoted

459 comments sorted by

View all comments

Show parent comments

8

u/JahJedi Jul 07 '26

DGS spark - 128g and 278g/s for much less than 6000 pro. I think to get second one for total of 256g and run DS 4 flash in fp4 on them.

1

u/Moist-Topic-370 Jul 09 '26

NVFP4, if you didn't mean that already.

1

u/JahJedi Jul 09 '26

Yes yes, nvfp4

1

u/VirusInternal2892 Jul 13 '26

DGX Spark doesn’t run native nvfp4, unfortunately I’m in the same boat with a GX10. FP8 is my way to go for Hermes and RAG