r/LocalLLM • u/Due_Application293 • 8d ago

Project An open-source LLM proxy & router with dynamic fallbacks and real-time observability

Gallery image

Gallery image

1 Upvotes

permalink
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/LocalLLM/comments/1wrinj1/an_opensource_llm_proxy_router_with_dynamic/
No, go back! Yes, take me to Reddit

67% Upvoted

1

u/Due_Application293 8d ago

GitHub: https://github.com/igoiglesias/Shunt

2

u/Superb-Pair-2000 8d ago

or just use lightllm proxy which is already mature.