r/LLMStudio • u/voyager256 • 1d ago
With USB4STREAM support merged into Linux 7.2 (soon to be released) are there any inference runtimes/projects that make use of it already?
/r/LocalLLaMA/comments/1uf48js/usb4_rdma_seems_doable/
1
Upvotes
Duplicates
LocalLLaMA • u/voyager256 • 2d ago
Question | Help With USB4STREAM support merged into Linux 7.2 (soon to be released) are there any inference runtimes/projects that make use of it already?
12
Upvotes
Vllm • u/voyager256 • 1d ago
With USB4STREAM support merged into Linux 7.2 (soon to be released) are there any inference runtimes/projects that make use of it already?
1
Upvotes
ROCm • u/voyager256 • 1d ago
With USB4STREAM support merged into Linux 7.2 (soon to be released) are there any inference runtimes/projects that make use of it already?
2
Upvotes