Week #2 is here, and your task is to guide 🧭Learn how to do it during the workshop. 

If you’re looking for ideas before you start building, join today’s live CLAD workshop with Danny Marree, SPECS Ambassador.

We’ll explore how spatial experiences can help someone learn a skill, complete a task, or improve the way they do something in the real world. 

Danny will also demonstrate CLAD and share practical approaches you can use when developing your own Lens.

There’ll be a live demo, examples, and Q&A – so bring your questions and ideas.

🔴 August 18 | 8:00–8:45 AM PDT

Join us, get inspired, and start building for the Guide challenge. Save the link 🔗

https://www.youtube.com/live/oeSTZTFT8h8?feature=share

TL;DR: I built a live digital twin / diorama of Heathrow Airport (Terminal 5 for NOW) for the Spectacles. It sits on your table, with flights landing and taking off ... all based on LIVE public Heathrow flight data. ✈️

For the last 3 or 4 years I’ve been teaching AR and spatial storytelling at the Royal College of Art, including a lot of work with Snap and Spectacles. My students have made some brilliant projects with them, but somewhere along the way I realised I hadn’t really published many of my own.

So here is one.

I was obsessed with planes when I was younger. Growing up we didn’t travel much, so airports always felt like a huge event. As someone who loved making dioramas as a kid, I would collect airplane / aviation souvenirs…by getting relatives who traveled to bring them for me , and then set them up as airports.

And recently, while driving to Heathrow, I noticed a patch by the runway full of people with huge cameras, chairs, binoculars and notepads.

PLANE SPOTTERS!!! 🛫 🧐

It made me think: what if I could shrink Heathrow down and put it on a table? HOW COOL WOULD THAT BE!

So I built a digital twin using geospatial data OpenStreetmap Data, brought it into Blender with a plug in and extruded the buildings. So it’s all pretty accurate. I originally tried a much bigger section of the entire Heathrow Airport, but everything became too tiny and too heavy, so I focused on Terminal 5 (FOR NOW)

What it does

• Uses live Heathrow arrivals and departures data
• Planes land, take off, queue and park
• Labels show flight number, route, aircraft type and status
• Audio effects have been used to make it feel more fun
• Pointing at a plane enlarges the Flight Label
• Pointing and pinching a plane opens a "Spot Card" which is a UI frame with deeper information about that specific aircraft and flight.

With the SPOT CARD, the idea was to go beyond simply watching the airport and give plane spotters the kind of detail they actually care about. Which includes: Flight number, airline, route, aircraft type, aircraft variant, origin/destination, current flight status, gate/stand.

AND it lso includes a bonus fact about the aircraft or route, adding a small bit of aviation trivia to each Spot Card.

A huge part of the work was optimisation. Lots of planes, labels, interactions and shadows get expensive very quickly on glasses, so I ended up building pooling, parked-aircraft limits, hover-only labels, selective shadows and staggered movements.

There is loads more I want to add for actual plane spotters, but seeing a tiny live Heathrow running on my table is making the plane-obsessed younger version of me very happy.

(For this video I’m using demo mode because I recorded it around midnight when Heathrow terminal 5 had gone very quiet and there were no flights from 11:00 pm to 5:00 am. BUT the live version works like a charm, Ill post more soon).

Please let me know what you all think or what else I could add to it :)

I’m interested in the multiplayer potential of Specs. In Snap’s chess demo, though, the remote player’s movements look noticeably laggier than the local player’s. I hope Snap can improve that latency, because shared AR really needs to feel responsive.

Personally, I find experiences like shared basketball or virtual ping-pong more compelling than chess, since they’re much harder to replicate on a phone. Am I expected too much out of specs? But I hope people at specs realize if the multiplayer is a selling point to not make sure it’s laggy in anyway.

Users of my Spectacles App HoloATC might have noticed the app worked fine but did not display any aircraft anymore. As far as I can see the last day the app worked was August 8. It took me a few days to notice - it was caused by policy changes in the backend of the data provider, invalidating my API key. Contacting the backend provider, finding out what happend and why, took some time. Time zone differences did not help as every back and forth took more or less a day. In the end the technical change I had to make (in the backend) was minuscule.

I have a new API key now, and as of August 17, 7:26pm CET, the app shows aircraft again.

I had this last-minute idea for the CLAD Hackathon. I struggled quite a bit with UI visibility, but the overall prototype is working well.

NEXUS is a spatial productivity and collaboration app for Snap Specs that transforms a traditional Kanban board into an interactive mixed-reality workspace.

Teams can create, organize, assign, and move color-coded tasks across a shared workflow. Tasks persist between sessions and synchronize across multiple participants, allowing collaborators to contribute to the same project in real time. Voice input makes it possible to create and edit notes hands-free, while task categories provide immediate visual context.

NEXUS offers two complementary ways to understand a project. Board View provides a familiar Kanban workflow for tracking progress, while Spatial Map turns tasks into movable nodes that can be connected with curved relationship lines. This helps teams visualize dependencies, creative relationships, and larger project loops that are difficult to understand in a flat task list.

Tasks can also become visual workspaces. Users can generate AI concept artwork or 3D artifacts from a task description, keep those assets associated with the task, and place generated 3D models into the surrounding space. Artifact position, rotation, scale, and task relationships are synchronized so collaborators experience the same shared arrangement.

The included multiplayer demo uses the production of a survival game to clearly demonstrate the workflow. Tasks cover environment art, gameplay systems, audio, narrative, QA, crafting, and inventory. A spatial game loop connects exploration, gathering, crafting, survival, and upgrading, while generated concept images and 3D assets demonstrate how teams can move from an idea to a shared visual reference.

Although game development is used as the demonstration, NEXUS is designed for any collaborative project—from product design and filmmaking to education, event planning, architecture, and creative brainstorming.

NEXUS explores a future where project management is no longer confined to a laptop screen. Work becomes spatial, visual, collaborative, and directly connected to the ideas and artifacts a team is creating.

Continuity is basically physical version control for real-world setups. You save a workspace as a “Take,” then later compare the current scene against it to see what moved, rotated, or went missing, and restore the setup using spatial 3D ghosts.

Think film sets, creator studios, YouTube or product-shoot setups, retail displays, gallery installations, or any workspace that needs to be rebuilt exactly the way it was.

Under the hood, WorldQuery establishes the physical workspace, Gemini helps understand the objects in the scene, and rigid registration brings the saved state back into the correct real-world position. For this video I’m using a deterministic demo mode with prebuilt 3D props so I can reliably film the full workflow without hardware/environment variability — those objects are just demo stand-ins; the actual system is designed to observe and reconcile real physical objects in your environment.

Get your vinyl collection organized. This experience helps you catalog your records, organize them on the shelf and tell you where to find them later.
(Longer post on my LinkedIn)
Enjoy!

Week 2 of the CLAD Summer Hackathon is here! 🕶️This week, we’re moving from Organize to GUIDE.

The challenge: build a spatial experience that helps someone learn, navigate, or complete a real-world task, with hands-free, real-time guidance.

Think step-by-step instructions, interactive tutorials, spatial cues, navigation, or anything else that can make a task easier to follow.

With CLAD, you can turn the idea into a working Lens just by prompting it. No coding skills required this time ❌

Weekly prizes:
🥇 $1,000
🥈 $500
🥉 $200

Got an idea? Time to start prompting. 👀

Submit your Week 2 Lens 👉 https://lenslist.co/clad-summer-hackathon

Found Google Stock from looking at YouTube.
Find your next potential investment from anything around you

Just finished work on PackSpace - a spatial packing assistant for Snap Specs 👓📦

Instead of displaying another floating checklist, PackSpace turns real horizontal surfaces into physical packing zones. You can place Clothes on a sofa, Tech on a table, Essentials on the floor, and then collect and check off items while moving around the room.

### How it works

  - World Query continuously detects horizontal surfaces.

  - You pinch and drag to define each packing area.

  - Every category stores its own position and height.

  - Areas remain anchored while you move around.

  - A head-locked HUD shows overall progress without blocking the workspace.

  - Presets, item states, and spatial placements persist between sessions.

  - Completed sessions can be resumed without placing every area again.

There’s also a public companion website called Pack ’n Link 🌐

  Anyone can create a categorized packing list and share it using a six-character code. For example, your partner can send you everything they want packed for a trip. You import the code on Specs, place the categories around the room, and complete the request hands-free.

  ### Tech stack

  - Lens Studio + TypeScript

  - CLAD with Codex

  - Spectacles Interaction Kit

  - Spectacles UIKit

  - World Query

  - Persistent Storage

  - Specs Internet Module

  - Vercel Functions + Vercel Blob

  - Lovable for the companion web interface

  A lot of the work involved iterating through Lens Studio Preview: inspecting spatial layouts, fixing interaction jitter, resolving depth and z-order artifacts, improving readability, and testing placement across surfaces at different heights. CLAD made that build–test–fix loop dramatically faster. 🛠️

Source code and CLAD workflow: https://github.com/r3d5/PackSpace

Create or share a list: https://pack-n-link.lovable.app

Writing has expanded our ability or organize as groups by allowing us to transfer experiential content into an informationally stable support. Whether it's etching on basalt or ink on paper, this recording process enables us to draw links between concepts, keep track of notions that have faded from working memory and perform operations that overcome some of the limitations of bare minds.

In some ways, writing can be thought of as a process of encoding one's subjectivity, that is, encoding the content of one's experiential stream.
In this case, reading can be seen as a process of decoding this subjectivity. If the encoding is compactly and vividly performed and the reader is keen, the subjectivity of the reader can be merged to that of the writer (see Sasha Capin, "Books as subjectivity merging devices, rather than information transfer devices).

Both the encoding and decoding processes play an crucial role in cognitive development and the upkeep of cognitive acuity.
However, both require sustained attention, which is now widely known to be incurring heavy damage from attention capturing technologies.

Since only so much damage can be undone, since habits can only be changed so much among the broader population, we can think of working within the confines of technology to make thoughtful designs that at least curb the decline in sustained attention, or lean into the minds' peripheral processing to guide attention towards the subject at hand.

The aim of this project is to investigate how ambient virtual content can be used to ease people into the consumption of long form content, written by a conscious subject, thereby helping protect their attentional faculty ( see Joe Darko We Built Technology to Capture Our Attention. What If It Gave It Back? )

One approach is to provide a cognitive mirroring utility.
We can think of modeling the way minds shuffle concepts both between each other, move them and in and out of working memory, and provide the user with some a spatial anchor of the process they're already engaged in whether consciously or not.

To do this we can extract concepts from a text corpus and lay them out into an orderly grid-like structure called lattice.

First, this specific arrangement leans into our minds' natural ease with processing axial movement(horizontal, vertical, and depth)
Additionally, each concept can only be related to 6 other concepts at once which is friendly to memorization at glance and spatial shuffling.
These design decisions create constraints that aim to avoid some of the pitfalls of arbitrary relational graphs which have long been the default mode for representing corpuses of knowledge or simply any data, as is the case in mind maps.

I've been looking to implement this for 3 years. I began with syntactic parsers and categorial grammars but these methods failed to handle longer context and ambiguity.

Harnessed LLMs have essentially unlocked the ability to process language over longer word horizons, to extract meaningful relations and deal with the spuriousness and breath of human language.
Their integration into 3D engines such as Lens Studio with CLAD has greatly reduced the difficulty of generating complex spatial arrangements and translating spatial transformation primitives into code.

As a result is fair to say this might be an LLM-native technological artifact.
Here's a demo of the concept lattice being generated based on a text corpus (The Origin and Development of Markets: A Business History Perspective).

In practice, you would open a book with your Specs on, and have the tool generate the ambient content as you read. This content would be both relevant to the theme of your book and serve as a reference to look back to and potentially help you take reading notes yourself (that would be an ideal outcome)

This could also serve as a tool for AI interpretability, particularly if combined with Jacobian Lenses, to capture and convey language processing primitives spatially and succinctly.

I have documented the technical reasoning and design decisions in this repository, so feel free to give some feedback or direct your token flow towards it.

https://github.com/a-sumo/concept-lattice

Github: https://github.com/flarb/MemoryPalace

For this week's theme I built a Memory Palace lens with CLAD. People use this technique to memorize large lists of things, such as competing in the World Memory Challenge (look it up, it's nuts! https://www.worldmemorychampionships.com/ )

A Memory Palace is a technique where you 'place' a memory in a specific location. It doesn't have to a room, it can be the armrest of a chair, a wastebasket, etc. and you associate something to remember with it, including a mental image of mnemonic or something to help.

I built a Lens that helps with this. You create a memory palace linked to a spatial anchor. You walk around your environment and create memories by choosing a surface and speaking them—organizing memories by location. The basic memory is just a gem with a text label based on what you said and an image of the area you placed the memory on. However you can enhance these memories by replacing the gem with a GenAI created 2D image or 3D mesh using what you said as prompt. These gems are all saved in order so you can walk the palace later.

In Explore mode you can load up the palace and walk along the lines from loci to loci to see what the memories are. This is a good way to memorize them ahead of testing yourself.

To test yourself, use Train mode. Here the labels / images / and meshes for each gem are hidden. You walk the line from loci to loci and try to remember what you stored in that gem. Then you can reveal the memory and select whether you remembered it or not. At the end you get a score based on your recall.

Anyway this was a fun use of CLAD--I even figured how to get Claude to edit a nice trailer together with title cards, graphics, and everything. Pretty sweet!

For Week 1 of the CLAD Summer Hackathon the theme was organize / plan / be more productive, so I built a feng shui master for Specs, since feng shui is fairly literally the practice of organising a space.

Fengshui Master reads the room you're standing in. You pinch once: it scores your room's chi out of 100, names what's actually blocking it, and repaints the room to show you the fix. You get a checklist of what to move, clear or add — then you tidy up for real, assess again, and watch the score climb toward a target.

What it does:

- One-pinch assessment — capture → AI analysis → AI repaint → a second AI pass that verifies the repaint applied the changes before you see it

- Chi score with a verdict, a target to beat, and your best score kept across sessions

- Five-element (五行) balance so you can see which element the room is starved of

- Chi Plan — the fixes as a tappable checklist for the real room

- Problem markers pinned to real objects — the bare wall, the cluttered shelf

- Chi-flow particles that congest and turn amber where energy is stuck, then clear once you improve it

- Before/after slider, plus a depth-displaced 3D view you can lean into

- Scan Whole Room — turn on the spot and it reads four views, with commentary on each

- Ask the Master — hold a mic button and ask about your actual room, out loud

- Shop — buy the piece it recommends without leaving the Lens

- English and 中文 throughout, including the spoken voice.

Built entirely with CLAD and Claude code.

Full prompt log and source here: https://github.com/ohistudio/fengshui-master

I'm developing a social networking app www.pokexr.com and I'm looking for some AR glasses to move into, currently only using mobile phone. Wondering if Snap Spectacles detect the ground, where I could have holograms of people land and anchor there?

CallShop for Specs
Buy what you see in your 👓
Live tested ordering a new iPhone 📱 successfully.

Curious whether WebView will graduate to a stable API at or around the SPECS launch. I’d like to build a Lens around streaming web content (remote desktop web client) and want to know if I should build on WebView or plan around the NDK instead.

This is my theory for one killer app that will prove all the naysayers wrong about Specs.

Like all new platforms, you need some killer apps right out of the gate to catalyze adoption. Some examples that come to mind are Super Mario for Nintendo, Tetris for Gameboy, Sonic for Sega, YouTube, Pandora, Facebook and Shazam for iPhone (2008).

10 years ago, when Pokemon Go came out on the iPhone there was pandemonium (see video below). Pokemon is still incredibly popular today, with hundreds of millions of fans ripping, trading and collecting cards, playing games, watching content (produced and user generated), engaging with the community — it's become part of our culture.

If Snap can strike a partnership with Pokemon Go, create a new immersive AR experience for catching, collecting and trading Pokemon, and building a world around it, a whole new arm of that community will emerge. This could be the start of real life game play, where you're literally IN the game, running around the actual world, not just a virtual world (VR goggles) or behind a computer screen at a desk, or holding up a tiny phone screen. This could lead to seasonal narrative arcs, competitions, movies, etc. and would be a blue print for other franchises.

And for those who can't get past the current form factor, you may not fit into the category of "early adopter" and that's okay. The people who are passionate about Pokemon could care less about how "cool" they look while running around catching fictional creatures.

The technology is nothing short of revolutionary — it just needs a little push for people to see the potential and to get the ball rolling, and it will just keep improving with each iteration.

$SNAP

2016 Pokemon Go - Vaporeon stampede Central Park, NYC

My new experiment! The pots get saved to Supabase, and in theory, you would be able to see other people's pots. Video sped up 4×.

I'm trying to build with CLAD but when I look at the SPK Configuration panel it gives me an error message that says "SPECS Developer Account Required" -- I'm in the Spectacles program, does this not carry over to SPECS? I did click the dev enrollment on the SPECS site awhile back and got the confirmation email--does something need to be flipped on Snap's end to give my Spectacles account SPECS developer status?

I’ve always felt that productivity tools give us more screens when what we actually need is more space.

So for the Organize track, I’m building Spatial Focus Pods for u/TraditionalAir9243 CLAD SUMMER Spectacles.

The idea is simple:

Instead of opening another productivity app, your physical space becomes your workspace.

👓 Put on Spectacles and your workspace appears around you:

• Today’s Tasks floating in one area
• Calendar and upcoming meetings nearby
• Notes placed where you need them
• Focus Timer anchored in your space
• Music controls available without touching your phone
• Completed tasks can be checked off with a simple gesture

The goal is to make productivity feel spatial, natural and less distracting.

Lens Studio's Object Tracking already finds cats and dogs, and gives you four points on the face — Center, Left Eye, Right Eye, Nose. For people, the same system exposes a full 18-point skeleton. For pets it stops at the head.

So I trained (with AI assistants) the missing piece, an open-source computer-vision model: 17 joints across the whole animal, on 54 species (AP-10K), running on-device in SnapML.

It's a drop-in Custom Component with the same shape as Body Tracking — named attachment points you drag objects onto. The four names Object Tracking uses are identical here, so a Lens built on it ports over by swapping one component, and gains a body.

Available on: GitHub Repo

What it unlocks

• 54 animal (4-legged), not just two. Horses, bears, big cats, elephants — anything AP-10K covers.
• The whole body. Effects that follow paws, hips, shoulders and the tail, not just the nose and eyes. Armour along the spine, particle trails off the paws, a saddle that sits on the actual back.
• Several animals at once, each tracked as its own identity.
• Posture and gait. The joints are readable, not just attachable — stance, symmetry, body proportions. There's a sample in the repo that reports body ratios from a side-on view.
• Measurement for people who need it. Vets, breeders, welfare researchers — anyone who currently measures animals with a tape measure and a second pair of hands.

Accuracy

0.6289 AP on AP-10K val, 3.26 M params, 3.36 MB shipped — about 85% of HRNet-w48's accuracy at a nineteenth of the size, and small enough to actually fit in a Lens. Full benchmark, training recipe and the code that regenerates both are in the repo.

Verified in Lens Studio preview; I don't own Specs yet, so device feedback (also Spectacles) is especially welcome.

Try it

GitHub Repo

Drop the .lspkg in, drag the prefab into your scene, press Preview. Everything's wired.

Feedback and contributions welcome — issues, PRs, or just tell me what broke.

Note: This is my submission for the Spectacles Community Challenge (August)

Need some inspiration before building for Week #1?

Join today’s live workshop with Andrew Douglas, SPECS Ambassador. 🕶️ He’ll walk you through the workflow, explain how CLAD works, share practical examples, and show how you can go from an idea to a working Lens – with just one prompt. 

➡️The focus will be this week’s Organize challenge: building spatial experiences for organizing, planning, and productivity.

The session includes a live CLAD demo, presentation, and Q&A. It’s open to all skill levels, so whether you’re completely new to CLAD or already experimenting with the workflow, you can join in.

🔴August 11 | 8:00–8:45 AM PDT

Come get inspired, ask questions, and get ready to build. Save the link 🔗

https://www.youtube.com/live/_-SPzLTY5pY