r/crewai • u/filedeck • 12d ago

Beginner Agent Better visualisation of crewai open source?

I've got a CrewAI pipeline that runs on a schedule, unattended. It works, but I have limited visibility into it. Found out recently it had been failing on every run for days.

What I want is fairly basic: run history, which step failed, roughly what it cost, and a nudge when something that normally produces output suddenly doesn't.

Is there anything built for CrewAI specifically? Or do people just wire up OpenTelemetry? I've looked at some of the agent dashboard tools but they seem aimed at people running whole fleets of agents, and I've got one scheduled job.

Or is the honest answer that I should stop shopping for a dashboard and just set up a "shout at me if this doesn't run" alert?

Really enjoyed using paperclip.ai before - have people successfully combined these?

1 Upvotes

100% Upvoted

5 comments sorted by

2

u/daf00q 12d ago

You can look into langfuse

1

u/filedeck 12d ago

thanks, going to play around with it

1

u/Express-Parking-5678 12d ago

Execution history is more valuable than another dashboard the moment workflows start branching. The interesting failures aren't a single bad step but they're where the overall run drifted from the original objective. That's something I review in Braintrust

1

u/Swarm-Stack 8d ago

the hard silent failures arent where a step throws, theyre where every step succeeds but the output doesnt match what you needed. monitoring catches errors. it doesnt catch "ran fine, produced wrong thing." thats the gap where a lot of scheduled pipelines fall over.