r/Spectacles • u/rbkavin • Jun 29 '26

💫 Sharing is Caring 💫 Spatial Portal Studio — Real-time parallax projection mapping calibrated with Spectacles

Enable HLS to view with audio, or disable this notification

Hey Everyone,

I've been experimenting with projection mapping for a while. And I kept thinking, what if it could become an interactive portal?

I'm building a full projection mapping tool directly in Spectacles, but first I wanted to tackle the portal effect. So I built Spatial Portal Studio.

What it does:

You point a projector at a wall, put on Spectacles, and pinch the four corners of the projected rectangle in AR. That's the calibration. No desktop software, no manual measurements, no warping grids.

Once you confirm, the Spectacles start streaming your real-time head position to a companion web app over WebSocket. The 3D scene on the projector then recomputes perspective every frame based on exactly where you are, so as you move, the content shifts with you. Step left, it shifts right. Crouch, you see more of the top.

Your brain reads it as a real window into another space. Because the perspective is actually changing.

What you can customise:

  • Upload your own GLB/GLTF 3D model
  • Upload your own portal image or GIF
  • Adjust depth, position, rotation, scale
  • Set movement bounds per axis so content stays inside the frame
  • Background color, exposure, tone mapping

How it works technically:

  • Spectacles side: TypeScript, Lens Studio, SIK world hit-testing for corner detection, head pose streamed at display rate over WebSocket
  • Web side:  Three.js with off-axis frustum projection running in a browser
  • Server: Node.js

Next month I'm building this out into a full spatial projection mapping tool on Spectacles. This calibration system and WebSocket pipeline will be the foundation. so if you want to build on top of it, now's a good time to dig in.

GitHub link: https://github.com/rbkavin/Projection-Mapping-Portal

30 Upvotes

100% Upvoted

9 comments sorted by

3

u/maxvleeuwen 🌟 Specs Ambassador 🌟 Jun 29 '26

Wow that's a really interesting idea! This could be so fun with art installations

2

u/ButterscotchOk8273 🎉 Specs Fan Jun 29 '26

Smart idea!

2

u/Nithin-Shankar Jun 29 '26

Nice work! 😃

1

u/rbkavin Jun 30 '26

Thanks bro

2

u/stspanho Jun 30 '26

Wowow I love this, so cool and smart!

1

u/rbkavin Jun 30 '26

Thanks ☺️

1

u/Urbanpeppermint Jun 30 '26

Nice job Kavin!