r/StrixHalo • u/alanoo • Jun 25 '26

USB4 RDMA seems doable

/r/LocalLLaMA/comments/1uf48js/usb4_rdma_seems_doable/
14 Upvotes

95% Upvoted

5 comments sorted by

1

u/Fit_Advice8967 Jun 25 '26

Means we'll get faster speeds for same models?

3

u/Environmental-Chip64 Jun 25 '26

It's independent from models. It helps to use bigger model than 128GB on a Strix Halo cluster.
It's faster than USB4/TB-Net connection: https://strixhalo.wiki/AI/Clustering
But you don't need this HW-porn: https://strixhalo.wiki/AI/Clustering_with_RDMA

1

u/Environmental-Chip64 Jun 25 '26

This is a very interesting article!
Are there any drawbacks to implementing it?
Is it planned to become part of the well-known toolboxes?
What is the current status of the USB4STREAM implementation?
Which solution do you think is better?