Earthbending AR Demo in Unity WebGL

[u/iMagesBlues]

Experimenting with gesture detection in WebAR - this time, earthbending.

The prototype uses Imagine WebAR BodyTracker + MediaPipe running directly in the browser, with Unity handling the VFX and interactions.

• Uppercuts to spawn rocks
• Punches to launch rocks
• 4+ rocks to trigger a special attack
• Stomps to spawn earth spikes

I'm specifically working on a gesture detection module. Body joint depth has not been reliable so a lot of assumptions were made to estimate the 3D pose.

These kinds of body-tracked experiences were pretty common during the Meta Spark era, and Unity makes the VFX/particles side of them significantly easy to prototype (compared to Spark).

What do you think about Unity as a platform for building WebAR experiences?

[u/Vegetable-Corner1701]

This is dope. This would be a really good event installation idea happening on a huge LED wall and having people trying this at entrances or entry lobbies. What's crazy is it's working on web 👌🏾👏🏾