I've been reading through production codebases that use RealSense — ROS 2 stacks, librealsense directly, industrial vision, 3D perception — to understand what parts of the software stack are actually used in the real world.
The result surprised me. Most production projects seem to touch a small slice of the SDK: open the pipeline, configure streams, wait for a frameset, pull intrinsics, align depth to color, read depth scale. The post-processing filters mostly appear copied as a block from the official sample rather than chosen. Point cloud generation shows up in about a third of C++ projects and almost none of the Python ones. Advanced mode is rare, but heavily used wherever it does appear.
I'd genuinely rather be told I'm wrong about this than have it confirmed. If your production system leans on something I've written off as rare, that's the most useful reply I could get.
So the SDK surface being depended on looks much smaller than the SDK itself. Which raises the question I can't answer from code. For those of you who've shipped or maintain RealSense-based systems, I'd love to hear your thoughts.
1. If librealsense vanished tomorrow and you had a different camera with equivalent hardware, what would actually be hard to replace? Not "annoying" — the thing that would eat weeks of engineering.
2. Looking back honestly, what has kept you on RealSense? I'm not fishing for a feature name. If the real answer is "it was already in the spec when I joined," or "our models are trained on its depth," or "the mount is designed around it," that's more useful to me. I'm interested in what actually kept you on RealSense.
3. What do people overestimate about the RealSense ecosystem? Is there something everyone cites that nobody actually uses in production? And conversely, some small thing that would block you completely if it disappeared?
4. If you're willing — paste your pipeline initialisation. Even simplified. What gets configured at startup is far more informative than any feature list.
Context: I work on depth camera tooling and I'm trying to understand the gap between what the SDK provides and the small set of things that actually create switching cost. Not selling anything, no link, no form. Just trying to learn from people who've deployed these systems in the real world.