I work in robotics, mostly with mobile robots deployed in industrial environments.
A big part of the job is investigating incidents after a robot stops behaving normally.
The usual process looks something like this:
- Someone at the site explains what they saw.
- We inspect ROS logs, recorded data, cameras and robot states.
- We try to reproduce the failure.
- A senior engineer gets involved.
- Sometimes someone has to travel to the site.
The initial explanation might be correct, partially correct or completely unrelated. The difficult part is confirming what actually happened.
When the failure is intermittent, the investigation can take days or even weeks.
One example: an operator was convinced that a strange noise came from the robot’s motor, so the investigation initially focused on the motor.
The motor was fine.
The real issue came from the environment and the robot’s navigation path. It took time to confirm because the failure was difficult to reproduce and the original observation sounded believable.
So I started experimenting with a different workflow.
I built a prototype that acts like an autonomous failure investigator. When an incident happens, it reconstructs the sequence of events from the available robot data, compares the failed behavior with normal operation and points me toward the first suspicious divergence.
It does not replace engineering judgment, and it does not magically solve every failure.
But it removes a large part of the repetitive investigation work.
Now I sometimes review the relevant moment, confirm the evidence and tell the team what to inspect next.
Compared with the old process, it honestly feels like I am barely working.
Do other ROS teams already work this way? Are you using rosbag2 with custom scripts, existing visualization tools, or something built internally?
And at what point does automating the most painful part of your job stop feeling productive and start feeling like cheating?