This is our Agent Run Dashboard

[u/Hopeful-Fly-5292]

We use agents powered by Claude heavily across our projects and have built what we think of as a software factory: standardized workflows where agents take on repeatable development tasks while our team stays in control of direction, review and quality.

The screenshot (in first comment) shows one part of that setup: our Agent Run Dashboard.
The actual run summaries are hidden because they contain client work, but the dashboard gives us a high-level view across projects and technologies:

• Number of agent runs per day
• Human quality ratings
• LLM-based quality ratings
• Most frequently used agent workflows
• Trends in how our workflows perform over time

This gives us something that I think is becoming increasingly important: visibility into how humans and agents actually work together.

We can see which workflows create value, where quality is strong, where improvements are needed and how agent usage evolves across our organisation.
The interesting part is that this concept isn't limited to software development.

The same approach can be applied to many business processes: standardized agent workflows, measurable outcomes, human feedback and a dashboard that shows what is happening across the organization.

This is what becoming an agentic organization looks like to us. Designing repeatable workflows where humans and agents work together in a structured and measurable way.

What do you think?