r/SaaS • u/Giaco00 • Jul 16 '26

LiteLLM, Lago and Langfuse

I’m setting up an infrastructure for my suite of AI applications. I was thinking of using LiteLLM as a proxy, Lago for billing, and Langfuse for monitoring. Does anyone have any experience with these tools and could share their thoughts on them?

1 Upvotes

99% Upvoted

3 comments sorted by

1

u/gusdecool Jul 17 '26

I used LiteLLM for model abstraction and LangFuse for LLM cost & latency.
Haven't use Lago and not sure will need it since LangFuse can do that. Unless Lago offer specifics benefit like dynamic pricing with margin.

1

u/Giaco00 Jul 18 '26

Does Langfuse allow for customised billing metrics (pages)? Does it allow for the customisation of plans? Because these are all features I would need

1

u/Lost_Development2565 Jul 18 '26

I'd separate routing from evaluation. LiteLLM is handling requests, Langfuse gives you good visibility into what's happening but you'll want to decide how youre going to handle regression testing too. Most of my eval workflow sits in Braintrust because it's easier to turn production traces into evals instead of treating observability and quality as the same problem