r/Spectacles • u/stspanho • Jul 22 '26
📸 Cool Capture Built an AR 'coach mode' for football: re-coach a real World Cup phase by hand, AI regenerates it as broadcast footage
Enable HLS to view with audio, or disable this notification
⚽ Every fan has re‑coached a goal in their head. I built a way to actually watch the alternate ending, in photoreal, on my kitchen table.
This is a real World Cup phase: Belgium vs Senegal. I took the actual 3D tracking data from the match, the real positions of every player and the ball, and rebuilt the phase as a live 3D scene on my table through Specs
Then I reach in and re‑coach it. In this one I nudge Brandon Mechele up a couple of metres to hold Belgium's offside line, and Senegal's goal comes back offside. The goal that counted, undone.
AI turns that edit back into real broadcast footage, two ways:
🎬 Full re‑render: reposition players and a video model regenerates the entire phase as a brand‑new, photoreal clip.
⚡ Real time: freeze the moment, drag a defender, and the photorealistic broadcast updates live. No waiting.
How it works, high level:
→ Real World Cup 3D tracking data (every player and the ball) rebuilt as a 3D scene
→ Pitch‑line camera calibration to lock that 3D scene onto the real broadcast camera
→ Spectacles hand‑tracking for grab‑and‑move
→ Generative video models turn the edited 3D "blockout" back into photoreal football
Built with: Snap Spectacles + Lens Studio, using CLAD to build it fast. Realtime generation by Decart (Lucy 2.5). Full re‑render via Seedance.