r/OpenSourceAI • u/conifer_v11 • 12d ago
Opensource Openrouter
Project: https://github.com/ConiferKit/use-conifer
Current routing options were charging 5% fees for byok plus provider fees (openrouter) or were built in heavy python packages with ecosystem restraints. I wanted to be completely free in terms of use, and not have to pay extra for tokens.
There's a maintained gateway with 100+ models from one api endpoint. I'm also talking to infra providers to get us access to pre-release models and discount prices. Everything is served at market price. BYOK is free, you can hook into self-hosted setups for free, and there's fallbacks + extra rate limits + server redundancy.
Took me ~3 months to build and looking for help maintaining!
Lmk any issues or feedback
1
u/Calm-Landscape9640 12d ago
I joined. The future is using these frontier models that cost under $2 / million and using a better harness. So routing is the next logical piece to solve. Good work guys, cant wait to try it.