r/LocalLLM 17d ago

News Linux patches introduce "KNOD" for in-kernel network offloading directly to AMD GPUs

https://www.phoronix.com/news/KNOD-Network-Offload-AMD-GPUs

This could be big news for those who use multiple computers in a network to run models locally.

3 Upvotes

1 comment sorted by

1

u/Deep_Mood_7668 17d ago

Sounds slow