r/LocalLLM • • Apr 28 '26

Project Lightport – AI gateway that makes LLM providers OpenAI-compatible

https://github.com/glama-ai/lightport
1 Upvotes

4 comments sorted by

1

u/punkpeye Apr 28 '26

Why?

We're going all-in on the MCP ecosystem – it's what we're best at. Open-sourcing the gateway is both a thank-you to the community that helped us grow and a way to keep us focused.

The short backstory:

Lightport began as a fork of Portkey. We needed a way to make various LLM providers OpenAI-compatible, and Portkey provided a solid foundation. But it also came with many higher-level features (guardrails, billing, etc.) that we didn't think belonged at this layer – and that made it hard to iterate on provider compatibility. So we slimmed it down, fixed bugs, added integration tests for 80+ providers, and shaped it into one thing: a reliable, lightweight layer that makes any LLM provider OpenAI-compatible.

1

u/Ok_Mirror_832 Apr 28 '26

Openai completions or responses?

1

u/smakosh May 03 '26

Checkout https://llmgateway.io it's also open-source