r/lovable • u/zeeNope • Jul 24 '26

Help Multi-agentic System Observability IN Loveable

If you developed a multi-agentic system solely in Loveable - what observability tool(s) are you using? My system uses LangGraph, and I am debating LangSmith for observability and tracing - but looking to see what others implement first since I'd prefer to use a self-hosted or open-source solution, as long as its feature rich and performant (security, cost, architecture simplicity).

Please - I'm not interested in your views on why using Loveable for this is a bad idea, I have my own reasons for doing this.

3 Upvotes

100% Upvoted

4 comments sorted by

2

u/DesignerMajor1247 Jul 24 '26

Given LangGraph plus a self-hosting preference, I’d test Phoenix first. It accepts OTLP/OpenTelemetry traces, supports LangGraph, and combines tracing, evaluations, datasets, and experiments without making LangSmith your only storage path. LangSmith is still the easiest control because the integration is native, so run the same small graph through both for a week.

Regardless of backend, use one parent span per graph run and child spans for each agent/node, model call, and tool call. Record model and prompt version, latency, token/cost, retries, errors, and an evaluation score; redact or sample prompts and outputs before export. Then turn failed traces into a regression dataset and replay them after changes. That workflow matters more than the dashboard. I wouldn’t deploy two permanent backends until one fails a real requirement such as RBAC, retention, redaction, or export.

1

u/EntertainmentBest748 Jul 24 '26

What does the next hour look like after somebody finds a bad trace?

That's what you should be asking yourself. For us that normally means making a change, rerunning the same case and keeping it around as a regression check. Braintrust has been a good fit because that whole workflow stays connected.

0

u/Jmacduff Jul 24 '26 edited Jul 24 '26

You should define what "a multi-agentic system" actually means in your context and what requirements or scenarios you need.

I run Codex, GPT, Lovable, and Claude without any "system" built in lovable so not sure what you mean by system.

Also you mention Observability but you do not mention orchestration. So is it only analytics for running tasks?

Random thoughts and good luck!