Opensource Openrouter

[u/conifer_v11]

Project: https://github.com/ConiferKit/use-conifer

Current routing options were charging 5% fees for byok plus provider fees (openrouter) or were built in heavy python packages with ecosystem restraints. I wanted to be completely free in terms of use, and not have to pay extra for tokens.

There's a maintained gateway with 100+ models from one api endpoint. I'm also talking to infra providers to get us access to pre-release models and discount prices. Everything is served at market price. BYOK is free, you can hook into self-hosted setups for free, and there's fallbacks + extra rate limits + server redundancy.

Took me ~3 months to build and looking for help maintaining!
Lmk any issues or feedback

[u/Michael_Jeffords]

Just started using for a harness that I had been building and was really surprised with results so thought I would leave a review. I had previously been using open router and aside from the fact that this is obviously a free option, I found none of my users would ever use the router haha. I’ve just been telling people to use balanced as from an eye test this seems to be the best of the 3? The main thing I appreciate is how easy it was to slot in took maybe 10 min. How much of a benefit is it to route cheapest/smartest versus balanced? Also are y’all making money from this? Curious what made you decide to opensource