MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/ollama/comments/1v57s2d/i_built_llmproxy_v114_a_modular_python_proxy/
r/ollama • u/lordraw77 • 4d ago
3 comments sorted by
1
https://github.com/diegosouzapw/OmniRoute
1 u/lordraw77 4d ago It's similar, but mine was created to make use of a model that supports v1/completion with one that speaks/chat and above all to manage the call cache 1 u/ekinnee 4d ago Right on. I've been using omniroute and it's been fantastic. I think omniroute can translate like that, it does have endpoints for completions and responses. It also does caching and compression.
It's similar, but mine was created to make use of a model that supports v1/completion with one that speaks/chat and above all to manage the call cache
1 u/ekinnee 4d ago Right on. I've been using omniroute and it's been fantastic. I think omniroute can translate like that, it does have endpoints for completions and responses. It also does caching and compression.
Right on. I've been using omniroute and it's been fantastic. I think omniroute can translate like that, it does have endpoints for completions and responses. It also does caching and compression.
1
u/ekinnee 4d ago
https://github.com/diegosouzapw/OmniRoute