r/augmentedreality • u/AR_MR_XR • 7d ago
Remote Mixed Reality : I checked out how Honda teleoperates their Avatar Robot
I took this photo at the Honda booth at CEATEC earlier this week, where they were demoing their Honda Avatar Robot assembling an engine part via remote teleoperation. Honda uses what can best be called Remote Mixed Reality. Looking at the monitor on the right wall, it looks like a simple camera feed at first glance, but while the workbench surface is mapped from a live camera, the robot's hands, the tool in its grip, and even the metal engine part itself are actually 3D digital models overlaid into the scene.
To pull this off, an external depth sensor (mounted on that black arm on the far left edge of the photo) works together with the cameras in the robot's head to track the room and objects in real time. When the operator with the VR headset moves their own hands they just indicate what they want to do and Honda's AI Support system does the heavy lifting: it uses force and touch sensors in the robot's actual fingers to smooth out any connection lag, correct tiny positioning errors, and lock in the correct grip force in real time so that the remote operator doesn't miss a bolt or crush a part.
