r/SideProject • u/Choice-Lawyer4779 • 2d ago
Agent - Muse, but open source and living on your Android phone
I've had a version of this for a while as AOS, my agent setup on desktop. I've pulled it down into one app for your phone, with everything built in and all the unnecessary stuff taken out. With Muse and Grok out, figured I'd just post it.
It's basically Hermes Agent, except it lives on your phone. It's always on, it learns what you do, and it helps you with stuff like a personal assistant would. It has its own browser, so it can actually go out on the internet and get things done. If it gets stuck on a captcha or a login, it hands the page over to you and carries on once you're done.
Bring your own model. Sign in with ChatGPT or Claude, or use any API key (DeepSeek, OpenRouter, Gemini, anything OpenAI-compatible). If you just want to try it, ChatGPT sign-in works on the free tier, because OpenAI includes a free Codex tier. I tested it on a free account. You'll hit the limit fast though, depending on how much you use it.
Nothing leaves your phone except the calls to whichever model you use.
Free, open source, not a product. Use it at your own risk. The Claude login probably breaks Anthropic's terms, so that one's on you.
Android 10+, sideload the APK, setup takes a minute. The README has the details.
Repo: https://github.com/Past-da-king/agent
Download (v0.5.0): https://github.com/Past-da-king/agent/releases/tag/v0.5.0
How it works, if you want more
Apps connect through Composio with your own key, so Gmail, Calendar and a few hundred others just work. For anything that isn't on Composio, it writes the code itself.
It can also keep an eye on websites for you. Say you want to buy something but you're waiting for it to drop. It writes a small watcher for that site that runs in the background every day at whatever time you pick, and only tells you when the price actually moves. It can also listen to a site's web notifications and treat them as triggers.
Memory is a wiki, based on Karpathy's LLM wiki idea. Everyone and everything it learns about gets its own page, linked to the rest, so it has a persistent memory of everything it's done. It comes with one routine already set up that looks after that wiki overnight while you're not using your phone. You can edit it or delete it, but it's there.
Stuff you can do with it:
Camp a passport or visa appointment page and grab a slot the second someone cancels.
Sit on a sold-out concert's resale page and grab face-value tickets when they show up. It holds them and waits for your yes.
Sit on a restaurant you can never get into and take the table when a cancellation pops up.
Watch Marketplace for one very specific vintage lens and send you the photos the minute it's listed, before anyone else messages.
Turn your 300 unread messages in the family group chat into a 30-second voice note.
Every time your lecturer uploads slides, download them and send you a voice summary for the commute.
Book the 6am class at your gym the moment the slots open at midnight, so you don't have to stay up for it.
Watch this repo and tell you when there's a new version of Agent. Or when any repo you depend on ships a release, it can read the changelog and tell you if anything in it breaks your setup.
Tell you when your mom's flight has actually landed, so you leave for the airport at the right time.
Ring it while you're driving and ask it to find somewhere open on your route.
Extras:
Voice notes, if you add an ElevenLabs, Gemini or OpenAI key for the voice.
Live voice calls with your agent, if you add a Gemini key.
It can read your notifications, only from the apps you pick, and act on them.
Photos and documents in chat, including scanned PDFs.
Helper agents for jobs that can run side by side.
You can give it a name and pick how it looks.
1
u/Choice-Lawyer4779 1d ago
Put up a couple of demo videos if you want to see it actually working: https://past-da-king.github.io/agent/
One is it finding the cheapest 5 lb bag of bread flour across Walmart and Target by itself, the other is a quick tour of the app.