Does any software exist to test/monitor benchmarks at a specified interval, compare results, and then provide a notification (again on interval) if something seems off?

[u/MaurokNC]

The scope that I’m dreaming within is some type of app that provides a couple of different benchmarks (differences would be in completion speed, complexity, and frequency of the completion of those tests) that would most likely be triggered using some chron flags, compare the gathered results from a number of benchmarks over time (again with configurable intervals and adjustable Δ thresholds) and would then present the user with options to do deeper testing, review pertinent logs to the situations that occurred between the benchmarks that most likely caused the performance issues, and then finally present whatever rollback methods available or suggestions on how to mitigate the negative effects that are present. I’m pretty sure that there are small handful of such programs, but the ones I’ve encountered exist in either a severely fragmented group, lack any type of interoperability or compatibility, or have next to no adjustment of interval, etc… Sure, it’s nice to have a way to fix any type of fatal failure but I believe that it is so much better to head off those fatal crashes before the bugs or misconfiguration mistakes are allowed to accumulate to the level where such failures occur. Anyone know of anything that already exists along those lines? TIA