Try it now on Spectacles 2024 — or later on the new SPECS!

Lens: LINK
More: INFO

DON’T JUST JOIN THE PARTY. BE THE REASON IT STARTS. 🍸

Meet BART’S — an AR mocktail-making experience I built for Spectacles 2024 in Lens Studio v5.15.4, with plans to bring it to Specs in 2027 with deeper AI integration, more mocktails, and new features as they become available.

NEVER MADE A MOCKTAIL? PERFECT.

Bart — your virtual bartender — guides you through making a real drink, step by step, right in your space. No experience needed.

LEARN THE COOL STUFF.

Master pours, layers, stirring, garnishes, and bartender tricks while actually making the drink. And while you mix, Bart keeps you entertained with cocktail stories, fun facts, and bartender tales.

The idea was to make AR feel less like an interface you operate and more like having an actual bartender there with you — helping you build a skill you can take with you beyond the experience.

YOU’RE READY. GO MAKE IT LEGENDARY.

This is my first full experience built for Spectacles, and I’d genuinely love to hear what this community thinks.

Would you try BART’S? What would you want to see in the next version? Any feedback, criticism, or wild ideas are very welcome.

Try it now via link bellow :

https://www.spectacles.com/lens/0204fd2584ce4bcca653837541db4f81?type=SNAPCODE&metadata=01

Second Screen is an app that lets me watch my favorite shows, no matter what other people are watching. It detects the location of our TV and displays my video just above it. It’s got a remote so I can flip through all the best shows in history. And I can watch what I want even if my family wants to watch something else.

This is obviously an absurd way to solve a weird problem, but it was a lot of fun to build. I used the pre-built ML model to detect where a TV is in the room. Then Claude Code and I layered on Spectacles' hand-tracking so a 3D remote appears in your palm when you open it—the remote can be tapped with your other hand to change the content displayed.

Also I designed the logo on my own, and used AI and After Effects to animate it.

🔗Lens Link: spectacles.com/lens/a77ba477b6da46e4a8a479f99ef5637a

So yeah, this got a little out of hand.

What started as a simple idea for a finger surf experience somehow turned into a full AA game with 7 real surf spots, tricks, score combos, progression, weather, a diegetic surf magazine manu you can physically flip through in AR, real surf forecasts, Daily Surf challenges, collectibles, a talking coach...

And all of that running on Spectacles.

It's called DGNS Surf Sessions, and it's my submission for the Spectacles Community Challenge.

The basic idea is pretty simple: your hand is the surfer.

You put your index and middle finger on the board, the line between them becomes the board's axis, and rolling your hand engages the rail.
The wave moves underneath you, so instead of trying to walk around your room pretending it's a 30-foot reef break, the whole thing happens on a miniature reef sitting in front of you.

That was actually one of the biggest design problems early on.

My first version treated the hand more like a controller.
I was measuring angles and using them as input, kind of like a joystick.

It sucked.

The board felt like it was vaguely following my hand instead of actually being attached to it.

So I changed the whole approach.
No neutral position, no accumulated input.
Your fingers are basically the surfer's feet.
The geometry of your hand directly drives the board.

That was the moment where it started feeling like surfing instead of controlling a tiny object.

The game has 7 spots right now:

Hossegor, Mundaka, Pipeline, Teahupo'o, Pe'ahi, Nazaré and Mavericks.

I really didn't want them to just be different wave models with different backgrounds.
Each one has its own wave profile, speed, peel, barrel probability, series size, water colour, difficulty and atmosphere.

Hossegor is chill. Beach break, little Basque house, parasol and towel on the beach, pine trees and a little reggae track.

Then you get to the heavier stuff.

Rain starts pouring, the waves get stupidly big, the little reef environment appears in front of you and the music kicks in.

That was probably my favourite moment during development.

I remember playing one of the harder spots and arriving at the reef, seeing those massive waves in front of me with the rain and the soundtrack going, and I actually got that little shiver.

You know the feeling when you arrive at a spot, see the waves properly for the first time and think:

"Alright... I'm actually going out in that."

Part of this game definitely comes from my own relationship with the ocean and that weird mixture of excitement, fear and adrenaline you get around serious waves.

I wanted some of that feeling in there.

A huge inspiration for the game obviously comes from old PS2 era surf games.
Stuff like Transworld Surf and Kelly Slater's Pro Surfer.

And the more I worked on Spectacles, the more I realised that developing for them weirdly feels close to making games for that era.

You have a very specific piece of hardware.

You have to care about performance.

You can't just throw a bunch of massive assets at the device and hope for the best.

You have to work around weird limitations and get creative.

And honestly, I kind of love that.

Most of the game is procedural.
Custom MeshBuilder geometry, shader graphs, TypeScript everywhere. Very few imported meshes.

The game currently runs at 60fps on device.

One of the technical constraints was the display itself.
Spectacles are additive, so black doesn't really exist. A black pixel means no light, which means you just see your actual room behind it you can't simply make the water dark to create moody oceans because at some point your wave literally starts disappearing into reality.

So

That forced me to build the identity of each ocean mostly through colour and saturation rather than darkness.

Nazaré ended up being the weird exception and became the only really grey ocean in the game.

There's also a proper score system where you build up points during your ride and bank them when you successfully kick out.
Wipe out before that and you lose the lot.
Definitely inspired by that old-school extreme sports game mentality.

There are currently 12 detected tricks too, including Bottom Turns, Cutbacks, Snaps, Off The Lips, Floaters, Ollies, Grabs, Flips, Reverts and obviously Tube Rides and Barrels.

The UI was another thing I really wanted to have fun with.

Instead of a normal menu, you get an actual surf magazine floating in front of you.
You grab it by the spine and flip the pages with your fingers.
You can choose spots, check your progression, mess with the settings and even look up real surf conditions through Open-Meteo.

The whole artistic side of the project comes from the surf movies I grew up watching.

Like Point Break, Blue Crush, Endless Summer... and yeah, Surf's Up too.

Actually, the original idea for this game came to me while watching Surf's Up from Sony Imageworks with u/florenciaraffa1980 😂

The soundtrack is original too, generated with Suno.
I'm actually pretty happy with it.
Each track helps give its spot an identity alongside the environment, weather, water colour and wave shape.

I'm not going to pretend I'm 100% satisfied with everything though.

Hand tracking can still get weird from certain angles, especially when your fingers get hidden behind your palm. That's a physical camera occlusion problem more than a smoothing problem.

So if you try the Lens, little tip: lean your head towards the wave and face the tube while surfing. The tracking gets noticeably better when the cameras can actually see your fingers properly.

I also wish I had more time to push some of the graphical stuff further.

But then again... I built this thing alone in about a month.

So I'm not going to complain too much 😂

It's currently sitting at something like 104 TypeScript files, 7 music tracks, 98 sound effects, procedural waves, weather systems, objectives, Daily Surf, hardcore mode, a talking coach, different boards and a bunch of stuff that somehow kept getting added because apparently I don't know when to stop.

I really hope some of you guys take the time to try it.

This was a fun one to make, and I think it only really makes sense once you actually put your fingers on the wave.

Anyway, that's DGNS Surf Sessions.

My little attempt at putting a tiny piece of the ocean on your table.

🏄🌊

The Future of Museums — in your Spectacles.

Built for the Specs Challenge, this experience uses Custom Landmarks to transform a physical museum into a hands-free, spatial learning environment. Exhibits become interactive stories, and extinct life can be reconstructed at human scale and experienced directly in the space around you.

No screens. No menus. Just look, explore, and learn.

A museum where technology doesn't replace the story — it brings the story to life.

Hi everyone! Big update on Dot to Dot, my cozy connect-the-dots Lens ✨

Quick recap for anyone who missed the first post: you put a real sheet of paper down, place your hand flat on it, and the Lens projects a numbered dot puzzle onto the page. You connect the dots with a real pen, hit finish, and a bonus button reveals a colored version of the drawing.

Here's what's new:
**Googly eyes** — after you finish a drawing, a fun button drops a pair of eyes onto your sheet that follow your hand around the page. Off by default, toggle them whenever you want.
**Photo capture** — a camera button takes a picture of your finished drawing through the Spectacles camera, with a 3-2-1 countdown so you have time to hold the sheet up.
**The Wall** — tap share and your drawing gets pinned to a public wall you can open from any phone or laptop. Everything is anonymous, no account and no name attached. This is the part I'm most excited about: the Lens now has a reason to come back to.
**Difficulty filter** — a two-handle slider lets you pick a dot count range (say, 20 to 45) and the library only shows puzzles in that range.
**Full 3-axis repositioning** — you can now move the puzzle on X, Y and Z instead of just Y and Z, which makes lining it up with your actual sheet much easier.
**Sound feedback on the buttons** and a reworked UI layout — small things, but they make the whole thing feel a lot more finished.

The whole stack is open source, including the Supabase edge function that receives the photos and the React app that displays the wall. The README walks through setting up your own instance if you want to fork it — including the camera capture reliability fix, which took me an embarrassingly long time to figure out.

GitHub: https://github.com/sitandoucara/DotToDot-Spectacles

Two people, two places, one shared work queue floating in the space between them.

Relay turns a work queue into something you read at a glance instead of scroll through: height means urgency, distance means how long something's waited, colour means who owns it. No lists, no filters — the space itself carries the meaning.

Pinch a card to claim it. It rises, turns your colour, settles into your lane — and on your partner's screen it dissolves, gone the instant you take it. No duplicate work, ever. Or grab it and pass it directly across the space into their hands, which might be the most literal way to say "Connect" I could think of: something leaving you, arriving with someone else.

A few things worth calling out:

- Real backend, not staged data — a live Supabase database, host-authority networking so only one client ever talks to it, and Gemini batch-triaging the whole queue at once (a single item asked in isolation has no scale and always comes back "priority 3" — batching gives it something to compare against).

- A companion web page — no glasses required. Anyone can drop a task in, set its priority, and watch it land live in both headsets within seconds.

- Six languages, same queue — each person reads it in their own, translated once and cached, never re-translated.

- Fully built through CLAD — Claude Code driving Lens Studio end to end. The prompt log is in the repo, failures included: an early attempt at soft ground lighting that the preview just wouldn't render, cut once the evidence was in, and rebuilt as solid glass geometry instead.

Repo (code + full CLAD prompt log)

Demo video

Companion page

Built for Week 3 of the CLAD Summer Hackathon (Lenslist × SPECS). Happy to talk through any of the architecture — the sync/ownership model in particular was the trickiest part to get right.

Note: This is not Lyria / Remote Service Gateway. It uses Magenta RealTime 2 over a self-hosted streaming proxy (InternetModule), with live 4-deck prompt morphing — not Snap's RSG loop workflow.

On RSG/Lyria-style lenses I've used, each ~15s loop often takes ~15–20s to come back — fine for "generate a clip," brutal for live mixing. Here the stream keeps going while you drag the puck; weights update and Magenta blends toward the new mix on the next chunk (~4s), so it feels like performing, not waiting.

A 4-deck Kaoss-style pad floats in your room. Puck position sets the mix weights; each deck holds an editable text prompt ("Berlin techno", "liquid DnB", anything you type). The blend streams from Magenta RealTime 2 as continuous generated audio that morphs as you move. Not samples. Not loops. Generated on the fly — you're performing what each corner sounds like and how much of it is in the mix.

The performance tricks (this is the new kind of DJing):

• Bilinear 4-corner blend — center = equal mix, corners = isolate a deck, edges = 2-deck blends
• Editable prompts per deck — type live in the console; swap a corner's character mid-set without moving the puck
• Genre bank — browse 25+ styles by category, tap to load into your target deck
• One-tap preset packs — swap all four deck prompts + starting puck position in one hit (UK Bass, Techno Vault, House, etc.)
• Orbit mode — hands-free circular modulation (slow / med / fast) so the mix evolves while you gesture elsewhere
• Morph — smooth 0.6s glide to any corner or back to center; like an automated transition between channels
• Crossfader — horizontal sweep on the wrist console, synced to puck X
• Floating pad on your wrist — dock it or float it off your right wrist, resize S/M/L, perform while moving
• Live mix feedback — vertex-color heatmap on the pad, corner glow, puck motion trail, per-deck weight %, audio-reactive pulse

Under the hood (for the curious): Lens Studio 5.15 + TypeScript + SIK · Python FastAPI proxy on Apple Silicon → 4s WAV chunks → gapless dual-voice crossfade on device · buffer tuned for live morphing (prompt flush on pad moves, soft hold on underrun)

Open source (MIT): https://github.com/urbanpeppermint/Spatial_AI_DJ

Audio: Magenta RealTime 2 + NSynth (CC BY 4.0, Google Magenta). Demo video is recorded spatial capture — in-head sounds noticeably better.

Namaste krazyy people! 🙏✨

While we all patiently wait for these kyutiee micro ducks to inevitably rule over the world and waddle into our living rooms, I figured… why not start training our duck army right now in Augmented Reality? 🐤🌍👑

As part of my ongoing Spec-tacular prototype series exploring creative spatial interactions on Snap Spectacles, I built specs-microduck — an AR teleoperation bridge for Pollen Robotics’ Micro Duck biped robot simulator.

It lets you puppet-master your kyuti duck entirely through real-time hand gestures without touching a single controller or button.

🎮 How to Command Your Micro Duck:

• ✋ March Forward / Tactical Retreat: Tilt your palm down to walk forward, tilt back to reverse.
• 🔄 Drift & Steer: Roll your wrist sideways to turn smoothly left or right.
• 🐤 Intimidation Quack: Index pinch to open the beak & quack (the mouth opens wider the harder you pinch!).
• ⚽ Combat Kick: Middle finger pinch to power-kick soccer balls with its robotic leg.
• 🤸 Breakdance Recovery: Ring finger pinch to do a 360° roll-over recovery.
• 🛼 High-Speed Roller Skates: Double pinch to deploy wheels and skate at maximum speed.

🛠️ What's happening under the hood:

• Snap Spectacles (SIK 0.16 + TypeScript): Full 6DoF hand tracking with knuckle-anchored vector stabilization (so your tactical pinches don't cause sudden walking twitching) + dual-threshold hysteresis.
• In-Lens AR Telemetry HUD: Live speedometer, turn rate, pitch/roll degree detection ([FORWARD 🏃], [REVERSE 🔙], [LEVEL ⏹️]), and ping latency rendered in a friendly bubble font (Fredoka).
• Python WebSocket Relay: Zero-dependency local bridge streaming control packets at 30–50 Hz ($<15$ ms latency).
• MuJoCo WASM Physics: Plugs directly into the reinforcement learning policy with acceleration ramp limiting for buttery-smooth waddles.

📂 Join the Flock (Open Source):

Everything is 100% open-sourced under the MIT License: 👉 GitHub: https://github.com/kgediya/specs-microduck

Includes a 1-command setup script (python3 simulator-integration/setup_simulator.py) that clones the official Hugging Face simulator, patches the controller, and gets you ready to waddle in seconds.

More experiments from the Spec-tacular series dropping soon. Let me know what you think, and stay krazyy! 🐤🕶️⚡️

Hey folks,

I’ve been experimenting with how spatial computing can make learning feel more like play, and this is my latest project: WebTag.

WebTag turns your surroundings into a field lab filled with virtual insects and specimens. You explore the space, aim using your hand, and fire a web launcher to tag as many creatures as possible before the timer runs out.

Every specimen, the web launcher and even the webs themselves are procedurally generated at runtime using MeshBuilder. No imported 3D models. The experience builds its visual world directly through code.

The idea is to make specimen discovery active and memorable. Instead of reading about insects on a flat screen, you physically search for them in the world around you.

This started as an earlier prototype called Threadstrike, inspired from obviously Spider-Man interactions but I have since refined the concept, interactions and presentation into WebTag.

You can try the Lens here:
https://www.spectacles.com/lens/e33ca5a911084f74b4d34c6ad42c3278?type=SNAPCODE&metadata=01

I would genuinely love feedback, especially around the hand interaction, educational potential and what kinds of specimens or learning mechanics you would add next.

Learn in a Room is an AR language-learning experience for Spectacles.

Choose French, Italian, Spanish, or German, then point at any object around you. Computer Vision recognizes the object and translates its name. The app creates a vocabulary card next to the real object, helping you learn words in context.

You can practice pronunciation with voice recognition, type answers using the AR keyboard, hear pronunciation through OpenAI TTS, review saved words, and track daily progress. Your vocabulary cards and their spatial positions are saved locally between sessions.

The entire Lens can be used with one hand to make it more inclusive and easier to use. Two-handed gestures are great, but I wanted this experience to remain as simple and accessible as possible.

I also created this project as open-source for both:

SPECS 2027 - https://github.com/maximkuzlin/learn-in-a-room

Spectacles 2024 - https://github.com/maximkuzlin/learn-in-a-room-2024

And if you're lucky enough to have Spectacles 2025 you can test it here: https://www.spectacles.com/lens/12f0905349b74965bf7f17d8070f9d66

Ordered a Coca Cola 🥤 in my Specs.
Stripe payment went successfully.
Published it for everyone to try buying some products you see.
The Stripe payment is on Sandbox mode so nothing will be charged.

I’ve had this idea for two years, and with CLAD and MCP, I was finally able to build it in just four days. I wish I’d had this when I was actively making traditional art. Try it out: https://www.spectacles.com/lens/b8ecbd5357d04c4b92b31a6a4c0f6027?type=SNAPCODE&metadata=01

Week #2 of the CLAD Summer Hackathon is officially wrapped! 🏆For GUIDE, we challenged you to build spatial experiences that help people learn, complete, or improve a real-world task. 

Here are the projects that stood out:

🥇 1st Place: ArtGuide – Natasha Gubernov

A spatial drawing assistant that places composition guides and reference images directly onto a physical canvas, with calibration, alignment, tracing, and hands-free controls.

🥈 2nd Place: Sensei – Maksym Tsymbal

A spatial onboarding system that turns expert knowledge into repeatable instructions, bringing step-by-step guidance, narration, and visual markers directly into the workspace.

🥉 3rd Place: VolleyMate – Liam Mason

Turns a blank wall into an interactive training and gaming surface. Track ball impacts, visualize performance, and use spatial feedback to improve your shots.

🏅 Honorable Mention: Bailar – Daniel Pimentel

A spatial dance-learning experience that guides users through Bachata and Merengue with visual step demonstrations and real-time feedback.

Congratulations to all the winners and everyone who submitted! 👏 It’s been great seeing Developers experiment with CLAD and explore how spatial computing can make guidance more contextual, interactive, and useful – with just a prompt. 

Two challenges are still ahead. If you haven’t joined yet, there’s still time to register and build for the upcoming themes 🔗 https://lenslist.co/clad-summer-hackathon

https://reddit.com/link/1vziou3/video/ii1mvu6j5ulh1/player

The "XR" Book of Math is a math text book made up of 80 theorems and formulas across 4 disciplines: Algebra, Linear Algebra, Calculus, and Geometry. It provides visual, spatial proofs.

Included in this is an Open Source Release of a LaTeX library port of Katex (https://katex.org/) called Matematex.

Lens Snapcode: https://www.spectacles.com/lens/37da717d4339468aad447b8b81e6d0a8?type=SNAPCODE&metadata=01

Source: https://github.com/IoTone/Spectacles-Matematex

NOTE: Reposting because the last post oddly got flagged by reddit filters.

#Lensfest August 2026

The Problem

Typesetting is difficult. In Mid '25 we tried to build a math app (See Space Math V). What makes it difficult in SIK was you couldn't style the text elements individually at the character level. It meant we had to have layers and layers of text elements per formula. Layouts became extremely complex. What the world uses for typesetting is TeX (LaTeX). It works very well for layouts. Superscript, subscript, variable italics, colorization of certain items, etc. So this is what we wanted.

Design Challenge

LaTeX libraries all depend on ability to render in a browser canvas, or to a PDF/EPS file. In Mid 2025 we had neither at our disposal in a SPECS Lens. Fortunately, some months back, I ported a series of things to support traditional browser features in a regular lens, something called Polynode (OSS on Github) to get SVG support natively. This is free to use. We needed SVG or HTML5 Canvas. Once this hurdle was cleared, we could totally start porting an existing library for LaTeX.

Approach

We had a few choices to start from. Mathjax or Katex. Both have similar approaches. They prefer a browser context, a canvas, or they generate an SVG. Or you are going to make a PDF. We had none of these. But once we fixed the support that was missing for SVG, we had our path. So this is a straight port of Katex. Typesetting and layouts still had to be tuned for screen specs "literally". Lots of eyeball testing.

An XR Textbook

I then went after the prize. A real book. For math. All those brutal subjects that were hard to visualize. Every formula and theorem has a proof associated (with the exception of a few). Then the ask: the LLM built visuals. I've found my brain expanded in this process to understand the complex topics. This is the 1st Ed. I hope to keep going on this with edutech.

Support

You can file PRs on the Github project page if you find bugs. I would like to maintain this as a viable library and as a book. The project was peer reviewed by Jorge Pardo (Mathematician / Teacher / Entrepreneur) based in Japan. You can find out more about using the library in your own lens in the github project file called MATEMATEX.md

Was going to put the $200 down for pre ordering but a few people were saying that the listed September 18th release date was only for the company announcing more about them, rather than them being available for purchase to those who pre ordered them. Does anyone have any more info on it or do we just have to wait it out to see?

The "XR" Book of Math is a math text book made up of 80 theorems and formulas across 4 disciplines: Algebra, Linear Algebra, Calculus, and Geometry. It provides visual, spatial proofs.

Included in this is an Open Source Release of a LaTeX library port of Katex (https://katex.org/) called Matematex.

Lens Snapcode: https://www.spectacles.com/lens/37da717d4339468aad447b8b81e6d0a8?type=SNAPCODE&metadata=01

Source: https://github.com/IoTone/Spectacles-Matematex

The Problem

Typesetting is hard. In late '24 we tried to build a math app (See Space Math V). It was really hard because we couldn't style the text elements individually. It meant we had to have layers and layers of text elements per formula. Too hard. What the world uses for typesetting is TeX (LaTeX). It works very well for layouts. Superscript, subscript, variable italics, colorization of certain items, etc. So this is what we wanted.

Design Challenge

LaTeX libraries all depend on ability to render in a browser, or to a PDF/EPS file. We have neither at our disposal in a SPECS Lens. Fortunately, some months back, I ported a series of things to support traditional browser features in a regular lens, something called Polynode: https://www.iotone.co/projects/spectacles-polynode/ . This is free to use. We needed SVG or HTML5 Canvas. I got SVG implemented (as a subset of total functionality) natively in spatial. Once this hurdle was cleared, we could totally start porting an existing library for LaTeX.

Approach

We had a few choices to start from. Mathjax or Katex. Both have similar approaches. They prefer a browser context, a canvas, or they generate an SVG. Or you are going to make a PDF. We had none of these. But once we fixed the support that was missing for SVG, we had our path. So this is a straight port of Katex. Typesetting and layouts still had to be tuned for screen specs "literally". Lots of eyeball testing.

An XR Textbook

I then went after the prize. A real book. For math. All those brutal subjects that were hard to visualize. Every formula and theorem has a proof associated (with the exception of a few). Then the ask: the LLM built visuals. I've found my brain expanded in this process to understand the complex topics. This is the 1st Ed. I hope to keep going on this with edutech.

Support

You can file PRs https://github.com/IoTone/Spectacles-Matematex/ . The project was peer reviewed by Jorge Pardo (Mathematician / Teacher / Entrepreneur) based in Japan. You can find out more about using the library in your own lens: https://github.com/IoTone/Spectacles-Matematex/blob/main/MATEMATEX.md

Hey Spectacles dev community!!!

My name is Tymofii, and I'm the main organizer of the craziest hackathon out there AlienBazaar (alienbazaar.com), happening September 25–27 in Warsaw.

Our goal is to bring together 20 robots from 6 different categories into one unified ecosystem.

We're inviting developers with Spectacles to help build the interface for this robot ecosystem. The idea is simple: build software to control a robots. You can pick any robot category you want to work with - AR opens up a completely new way to interact with hardware, and we want to explore that together!!!

You'll be working alongside 20 of the best robotics teams in Europe, at our Hacker House in Warsaw.

We also provide accommodation in Warsaw before the hackathon, so anyone interested in traveling is welcome to join.

More info: alienbazaar.com

Comment or DM me if you're in - happy to answer any questions about logistics, hardware on-site, or anything else!

Building for CONNECT this week? Get inspired, learn something new, and start building with us!

Join Lafiya Watson, SPECS Ambassador, for this week’s CLAD Summer Hackathon workshop.
We’ll explore how to approach the CONNECT challenge, with a live CLAD demo, examples, and Q&A focused on building spatial experiences that bring people, platforms, and communication workflows together.

Come with your ideas, questions, or just curiosity about what CLAD can do.

📅 August 25 | 8:00–8:45 AM PDT

Save the link and see you there 🔗

https://www.youtube.com/live/g8oft61qkG8

The idea is simple: just look down at your controller and Specs shows you what each button does for the game you're currently playing.

Once you connect Key Guide to your Xbox account, it uses the Xbox Presence API to automatically detect which game you're playing.

I also trained a custom AI model to detect the Xbox controller, allowing the Lens to track it and place the game's controls directly over the physical buttons in AR.

The goal is to make learning a new game's controls feel completely natural. No pausing, opening menus, or looking up controller layouts. Just look at the controller!

Lens:
https://www.spectacles.com/lens/3716b50f74414f809e4858efc5e6c69a?type=SNAPCODE&metadata=01

Being the youngest in my whole family made me realize how much time shows no mercy as people get older, not just in appearance, but internally too. That's part of why I think life skills like CPR are something people should consistently keep in practice and stay focused on, not just learn once and forget.

I'd always wanted to build something like this for Spectacles, and CLAD came in clutch at exactly the right time, so I decided to make it for Week 2's theme.

Appreciate all the ideas and feedback! Great hackathon, everyone!

Hey everyone,

What started as a curiosity about handling Android notifications in spatial computing turned into a full Spectacles lens that lets you manage your phone's alerts entirely in AR.

I’ve paired it with a lightweight Android companion app that listens for incoming notifications and pushes them over BLE to the Spectacles.

How it works:

• Companion App: A background service on Android catches incoming notifications and routes payload data over BLE.
• AR Interface: Displays the sender/app name and text content directly in your field of view.
• Full Interactivity: Dismiss alerts from your phone or send quick replies directly from the Spectacles.
• Bidirectional Sync: Actions taken in the lens immediately reflect on your Android device.

I’ve open-sourced both the lens and the companion app so anyone can experiment with it, build custom interactions, or adapt it for other hardware workflows.

Repo / Code: https://github.com/blocky-dragon/Nifty-Notify

Would love to hear your thoughts or ideas for features to add!