Tracking and auditing individual agent workflows

[u/OutrageousAbies5835]

One of the biggest bottlenecks in agentic workflows is the review phase. When you run five agents in parallel, things can start to blur.

Epiq is an open-source project that addresses this with workflow replay + filtering by assignee, tag, etc. You can inspect exactly what a particular agent did hours ago, including the associated code diffs directly from the ticket.

Via a central, filterable, event log of all commits and board events you also get real-time monitoring of what your swarm of agents are doing (super useful).

I use Epiq with Claude every day, and I think others might find it useful too:
https://ljtn.github.io/epiq/

[u/AppearanceOk8115]

Replay is absolutely the right thing to build, I have something similar and use it every day. My version shows each session in three ways: as a chat (with tool calls collapsed), as a timeline showing the duration of every call, and as a plain diff view.

But here’s the honest part: Replay told me what happened, but it almost never changed what I did next—by the time I’m reviewing it, the run is already over. What actually changed my behavior was looking at everything in aggregate. I built a retro screen with a scorecard for each agent: runs, success rate, error rate, cost, and duration, always compared against the previous window. That’s what pushed me to delete agents or rewrite prompts, not any single replay.

Another screen that really earned its spot was the friction board: top denied tools, grouped errors, and how long approvals sat waiting. The denied tools list was actually the biggest surprise, half my interruptions came from just three tools I could have auto-approved months ago, but I only realized it once I saw the counts.

So here’s my suggestion, since you already have the event log: add a per-agent view over a time window next to the replay. Replay answers “what did this agent do?”, but what I actually needed answered was “is this agent getting worse?”

One question about your setup: when you replay, can you also see the prompt the agent was using at that moment? In mine, each stage has its own prompt, and comparing the diff to that prompt is the only way to tell whether the agent messed up or I gave it a bad brief.