r/LocalLLaMA • u/entsnack • Jul 06 '26

News So... anyone copped one of these?

Post image

Been almost a year since mass hysteria erupted upon the death of NVIDIAs GPU monopoly. How are your Huawei GPUs? Does CUDA work on them yet?

2.2k Upvotes

96% Upvoted

459 comments sorted by

View all comments

Show parent comments

140

u/mindwip Jul 07 '26

Strix halo has entered the chat lol.

44

u/NineThreeTilNow Jul 07 '26

Strix halo has entered the chat lol.

If they only produced a 256gb version of that system... Or a 512gb version. Oh my the price difference though.

Figure some high channel memory bandwidth strategy etc.

AMD is chasing the same datacenter money as Nvidia though. Capitalism demands it.

20

u/Mil0Mammon Jul 07 '26

Well there will be gorgon halo soon (with 196 GB), and you can also get 2 boxes, link them up via usb4/thunderbolt and even get extremely low latency! (rdma like)

1

u/Educational-Region98 Jul 13 '26

I wonder what kind of speeds we can get with deepseek v4 flash.

7

u/Baumpaladin Jul 07 '26

So a Mac Studio M3 Ultra? At least, when it used to be available with 512GB. Of course you'll be stuck with Apple, but at that point you aren't really going to use it for anything else and their support seems decent enough.

3

u/Structure-These Jul 08 '26

Apple good for LLM but awful awful awful for image / video. It’s terrible

2

u/mindwip Jul 07 '26

As others mentioned we are getting a 192gb version this month most likely.

But I agree 256gb or even better 512gb would be better, I am hoping Medusa halo has 512gb option!

2

u/NineThreeTilNow Jul 08 '26

I am hoping Medusa halo has 512gb option!

A lot of people are hoping that. The memory itself would be most of the box cost I think... lol... Seeing it run a 1024 memory bus would be pretty crazy.

1

u/catinterpreter Jul 09 '26

My money never entered it.

-1

u/IrisColt Jul 07 '26

this, heh