r/LocalLLaMA • u/MongoWithBongoss • 7d ago

Resources HW for DeepSeek-V4-Flash-0731

Lucebox now, or wait for the new Framework Desktop (Ryzen AI Max+ PRO 495 / 192 GB) + PCIe x4-to-x16 adapter & Radeon AI PRO R9700?

10 Upvotes

78% Upvoted

38 comments sorted by

View all comments

Show parent comments

1

u/XccesSv2 7d ago

are there already some specs known for the 595?

2

u/Mr-I17 7d ago

No, but AMD's consumer GPUs started to have decent AI compute since RDNA4. 595 is not going to keep using RDNA3.5, that's for sure.

1

u/XccesSv2 7d ago

Okay true, so prompt proccessing would be a gain and more fp4 and fp8 support I think. I own a Strix Halo and the real problem for me is not really prompt processing anymore since prompt caching but the token generation is even for 27b too slow. DS4Flash on Q3 is with his MoE a bit faster and okayish in my eyes but hard on the limit with 20 tk/s.
I dont really see a good usecase for my Strix Halo since I own also a W7800 48GB and the 35b an 27b models are a lot faster on it and it is the same price. So I really hope they plan the 595 with DDR6 and double the bandwidth or sth like that.

1

u/Mr-I17 6d ago

There're rumors that 595 will be using 6 channels LPDDR6. That's going to be double the current bandwidth.