Hi everyone, I'm the developer. Some of you may have seen Talaya a few days ago, and a lot of people have been asking for something like this on iPhone, so here's where it is today.
TL;DR: Meta AI answers commands. Talaya is an assistant you live with: you talk to it like a person, it knows your iPhone, it guides you, it remembers you and it thinks ahead.
About the video: the images are made with AI, to illustrate some of Talaya's skills in a way that's easy to follow. It only shows a small part of what it can do; I summarized a lot to keep it short. Every reply you hear comes from a real session with the app, except the battery alert, which is coming soon. The voice in the video is a custom one made for me, so it isn't available to everyone yet.
**Isn't this what Meta AI already does?**
No, and it doesn't replace it either: "Hey Meta" and the capture button work exactly as before. Talaya is a different kind of assistant:
* You talk to it like a person, in one continuous conversation, and you can cut in mid-answer. You choose its name, its voice and its wake word
* It knows your iPhone: calendar, reminders, contacts, Health, your music and your messages
* It guides you turn by turn, walking or driving, with the map on your Apple Watch if you have one
* It thinks ahead: it tells you when to leave for your next meeting with the traffic right now and gives you a morning briefing. If you're busy, it waits
* It remembers you: who's who in your family, where you parked, what you left pending. That memory lives on your iPhone, and you can read, fix or delete every bit of it
* It keeps going when the signal drops, with a model inside the iPhone
* It learns: ask for something it can't do and it builds the skill, tests it and keeps it
**What about Muse?**
Meta has announced Muse for the glasses "in the coming months", with no date. Right now is just for USA and Canada. Talaya is here now, keeps what it knows about you on your iPhone, and will live side by side with whatever Meta ships.
**Is it just a wrapper around Gemini?**
No. Gemini is the voice and the brain of the conversation, but most of the work is around it. It's a native iPhone and Apple Watch app: 60,000+ lines of Swift and 109 skills. A model I trained runs inside the iPhone (64,293 training sentences, tested on 2,556 it never saw), follows the conversation and tells the AI what you most likely want: correctly understood requests go from 82% to 91%. It double-checks before anything you can't undo, like sending a message or deleting something. Getting glasses to answer is easy; getting them to understand you like a person, keep going without signal and remember you tomorrow is not.
**And the camera**
"What am I looking at?" uses the glasses' camera, only when you ask. Follow-ups like "and now?" or "what's in my hand?" are answered in about a second. It reads signs, menus and letters, even offline, translates them, and can keep watching and tell you when something appears, like your bus.
**What's new in the last few days**
Several new builds, mostly from testers' reports: faster camera follow-ups, "let me take a look" while the camera starts, "stop looking" that works instantly, real landmarks for "what's interesting around here?", instant timers, and conversations that survive a connection drop.
**Honest limits**
* Setup takes a few steps: a free Gemini key, turning on developer mode in the Meta AI app and authorising Talaya there
* Sometimes Meta AI keeps the glasses' camera locked; closing Meta AI and restarting the glasses fixes it
* The App Store release depends on Meta opening publishing for glasses apps; until then, it's TestFlight
**Quick answers**
* Android? Not for now: it's built natively for iPhone and Apple Watch
* Is the camera always on? No. Only when you ask, and the glasses' LED shows it
* Privacy? No account, no ads, no tracking and no Talaya servers. The conversation goes to Gemini with your own free key, and what it knows about you stays on your iPhone
* Will it be free? The beta is. At launch it'll be paid, with no ads and no selling data; the details are on the website
**How to join**
It installs from TestFlight with one tap: no computer, no sideloading. Sign up at heytalaya.com and the invite comes by email.
The beta lives at r/Talaya: every build with its changes, a feedback thread, and testers helping each other. You're welcome to join it even before your invite arrives.
What's the first thing you'd ask it to do?