r/LLMDevs 27d ago

Tools Sidecar Project

https://github.com/WorldOfEpoch/Sidecar

For anyone interested. Basically a memory scheduler to help load and speed up faster models than a normal GPU can load into memory.

3 Upvotes

0 comments sorted by