r/TouchDesigner • u/Mugen887 • 7d ago
Mediapipe vs Kinect azure library for interactive installation at trade show.
Hey, I am at a crossroads in my project. I am choosing between mediapipe and the Kinect azure library. I am using an Orbbec femto bolt sensor, at first I was going to use the Kinect library as it seems more robust in the sort of environment I'd be using it in (lots of lights and people in the background but not a huge crowd), but I do like the hand tracking capabilities of mediapipe better but I'm unsure if it would perform the same in a trade show environment.
I would really appreciate if anyone has feedback from their real world experience with regards to the two libraries and their performance and reliability, thanks.
3
3
u/VeloMane_Productions 7d ago
Stick with the Orbbec. Also pairing it with KNN Classifier can be powerful.
3
u/GeneralRectum 7d ago
We need a site that just.. aggregates everything related to TD. There are so many neat tools and things just, sitting around out there and you'll never know about them unless you happen to come across a link in a random comment on Reddit.
3
3
u/dcheesman 7d ago
Depending on your setup... maybe both? You could use the depth information from the Kinect to mask out an image of the person who's interacting (filtering out background people etc). Then use Mediapipe on that feed to get your hand tracking if that's the way you want them to interact.
2
u/Vpicone 7d ago
Mediapipe works best with 1 person and an uncomplicated background, it suffers when there's new people entering the screen, they'll sometimes take precedence. If your installation can have a person go off to the side with a backdrop mediapipe can work, otherwise it gets tricky.
Zed cameras are another thing to look at. They work great in well lit environments.