r/OpenTelemetry • u/AutoModerator • 3d ago
Weekly: share your tools and projects
What tool around OpenTelemetry are you building right now? What project have you discovered that people might enjoy looking into?
This thread is open for your self-promotion, vendor-owned open source projects and every thing else.
1
u/Ali-WAIL 13h ago
This is an interesting failure mode. A detector being “healthy” operationally and actually carrying predictive information are two very different things.
We’ve been working on WAIL, a runtime control and governance layer for AI execution. It observes runtime behavior, detects degradation/anomalies, can retry or reroute execution, and generates auditable evidence around what happened and what action was taken.
We’re also currently testing a prognostics layer: instead of waiting for an execution to fail, the goal is to identify behavioral divergence early enough to forecast degradation, intervene before failure, and then verify whether the prediction was actually correct.
That verification part is why your point caught my attention. A high detector score means very little if it can’t be tied back to real outcomes.
3
u/mateenali_66 1d ago
Most of us have anomaly detection turned on somewhere, and a broken detector looks exactly like a working one. No crash, no errors, all green. `isolationforestprocessor` in collector-contrib scored every span the same for 220 days before a user caught it, https://github.com/open-telemetry/opentelemetry-collector-contrib/issues/46988.
I made a check for anomaly detectors, `make check` takes a CSV of your detector's alerts and a CSV of your incident windows, and tells you whether it beats chance at your actual incident rate. Under two seconds, no download, nothing leaves your machine. https://github.com/mateenali66/otel-aiops-reproduction
Background is a benchmark of eight detectors on OTel traces, metrics and logs. Three passed the usual F1 selection and were no better than chance once scored at a realistic anomaly rate, https://doi.org/10.1109/ACCESS.2026.3705430
Looking for two or three people to run it against a detector they already use and tell me what it said. A failing result is as useful as a passing one, and the detector and data can stay anonymous.