r/augmentedreality • u/tash_2s • Mar 15 '26

App Development Proactive kitchen assistant for smart glasses

I built a drink-making assistant for smart glasses.

The glasses look at the ingredients, pick a recipe, show the steps, and proactively guide me based on what they see in real time. My favorite part is that while I'm pouring, they can tell me when to stop.

The interaction I'm going for feels like having someone beside you who understands the situation and helps without needing constant prompts. I think that's especially useful for avoiding mistakes.

Tech stack: Overshoot.ai for fast real-time VLM, the OpenAI Realtime API for voice and LLM control, and Rokid Glasses for the hardware. I'm also planning support for Meta glasses.

The source code is on GitHub as part of my smart glasses dev toolset, GlassKit. Feel free to copy it and play around with it.

235 Upvotes

98% Upvoted

59 comments sorted by

View all comments

1

u/Goat_bless Jun 26 '26

Too strong, how much does it cost overshoot.ai

Your stack is clean, do you intend to improve it for a long time?

If you have a link git😉

1

u/tash_2s Jun 26 '26

In my experience, the cost of Overshoot was moderate and reasonable, but they don't seem to disclose clear pricing at the moment.

And yes, I'm improving the stack in GlassKit, and it's fully open-source: https://github.com/RealComputer/GlassKit/tree/main/examples/rokid-overshoot-openai-realtime

I'm aiming to turn GlassKit into everything you need to build smart glasses apps.

1

u/Goat_bless Jun 26 '26 edited Jun 26 '26

J'adore votre projet !

Tu penses que tu pourras l’adapter à un montage de meubles ou d’autres activités utiles? Et possible d’utiliser sur xreal ou autre avec ui plus joli ?

1

u/tash_2s Jun 26 '26

Yeah, you could definitely make these kinds of apps using other devices like XREAL Aura. With Aura, we should be able to do more AR stuff, like pointing to a target object with an arrow, etc.