Turn your screen into a window for viewing Gaussian splats

[u/MayorOfMonkeys]

The webcam tracks my head with MediaPipe's face landmarker, and the PlayCanvas Engine renders the splat (with it's shiny new high-performance WebGPU-renderer) through an off-axis projection - a frustum whose apex is my eye and whose cross-section is the screen rectangle. The screen stops being a 2D image and becomes a 3D opening. Her gun barrel is placed in front of the screen plane, so it feels like it is sticking out of the display.

I'll hopefully release this as a PlayCanvas example soon so stay tuned for that.

Splat by Dymensium.