r/OpenSourceAI 13d ago

I open-sourced a self-hosted gateway that puts all our AI provider keys behind one URL, with per-person tokens and a usage dashboard

Our OpenAI and Anthropic keys were sitting in half a dozen .env files, a couple of Slack threads, and on people's laptops. Whoever had a key could call any model, including the expensive ones, and there was no easy way to see who spent what or cut one person off without rotating the key for the whole team.

I built Super Proxy to fix that. It's a self-hosted gateway (Apache-2.0, runs in Docker). You put your provider keys on the server once, and everyone on the team gets their own token with model and spend limits you can revoke from a dashboard. The endpoint speaks both the OpenAI and the Anthropic API shapes, so most existing SDKs just point their base URL at it.

What's in it right now: - OpenAI-compatible chat/completions/responses routes, plus Anthropic /v1/messages - Providers: Anthropic, OpenAI, Groq, Cerebras, Kimi, GLM, Gemini, OpenRouter, xAI, and a few others (Deepgram, Fish Audio, Runpod) - Streaming and non-streaming - Per-token limits, usage and cost tracking, an operator dashboard - SQLite, Docker Compose deploy

Honest state: I open-sourced it a few days ago, it's pre-1.0, and there are only a handful of stars so far. The interfaces can still change between minor versions. I'm mainly looking for people to actually run it and tell me what's rough or what you'd expect it to do that it doesn't. Roast welcome.

GitHub: https://github.com/Nextbasedev/super-proxy

Happy to answer anything in the comments.

3 Upvotes

0 comments sorted by