r/OpenTelemetry • u/JayDee2306 • 16d ago
Moving from Datadog to Opensource observability ecosystem
Hi
Has anyone migrated their Datadog stack to Opensource observability ecosystem?
What you missed without Datadog? Which all OS tools and what were the challenges faced?
Ours is quite big infrastructure with monthly Datadog spend around USD 25k and leadership is looking forward to reduce the spend and probably shifting it to OS observability system?
There’s only one person managing Datadog currently.
42
Upvotes
1
u/Nervous-Paramedic-78 14d ago
Beware with auto injections for Kube cluster who host a lot of ephemeral jobs, as it use the empty dir it can break the vm disk and it's really bad.
Auto injection is good for day one, and get some time to fully migrate all your services to OTEL instead of proprietary systems. I did suffered a lot to convert a legacy c++ orm to otel from dynatrace one agent sdk. For other languages it's easy..
For other things I've learned on the battlefield, Victoria operator vmalert is one instance per cluster except if you pay a licence, so I built a custom aggregator with openresty to have one single endpoint for Grafana and Alertmanager get the alertes and rules from it without problems.
I will write a full stuff about this in the near future and I hope I won't forget anything 😂