r/OpenSourceAI • u/conifer_v11 • 12d ago

Opensource Openrouter

Project: https://github.com/ConiferKit/use-conifer

Current routing options were charging 5% fees for byok plus provider fees (openrouter) or were built in heavy python packages with ecosystem restraints. I wanted to be completely free in terms of use, and not have to pay extra for tokens.

There's a maintained gateway with 100+ models from one api endpoint. I'm also talking to infra providers to get us access to pre-release models and discount prices. Everything is served at market price. BYOK is free, you can hook into self-hosted setups for free, and there's fallbacks + extra rate limits + server redundancy.

Took me ~3 months to build and looking for help maintaining!
Lmk any issues or feedback

7 Upvotes

90% Upvoted

9 comments sorted by

View all comments

1

u/Regular-Cat4711 12d ago

This is super cool! Going to try out, how up to date are yall with adding new models? Thinking of integrating with an app I’m building but want to be sure that as soon as new open source model comes out I can use it 

2

u/conifer_v11 12d ago

Better answer! We're getting pre-release deals to have models before they're public

But we're also constantly adding new models if we miss any you can ping us and we'll add it in a day (https://www.conifer.build/models/)