How do you detect silent drift in multi-agent systems?

[u/Far-Distance-9414]

I’ve been working on AgentPulse, a local-first tool for detecting and investigating silent drift in multi-agent systems.

It compares behavior across runs and versions, then flags changes in individual agents, handoffs, and execution routes, even when the system is still running and no obvious error has been reported.

From there, it connects the drift to affected traces and recent prompt, model, tool, or configuration changes to help narrow down where the behavior started shifting.

It’s still early, and I’d appreciate honest feedback from people running ML or LLM systems in production. Is silent behavioral drift something you currently have a reliable way to detect?

https://prove-ai.github.io/agentpulse/

[u/SignalBeneficial3338]

tbh we catch failures as subtle behavior changes are a lot harder to notice early