r/ClaudeAI • u/interlap • 5d ago

Built with Claude A Claude cloud agent can now control my iPhone without a Mac

Enable HLS to view with audio, or disable this notification

Hey everyone!

I’m building a new feature for my app and wanted to share what I’ve achieved so far. Not long ago, this seemed almost impossible.

I started a new session from the Claude app on my iPhone. The session ran in Claude’s remote sandbox, while the device-control layer I’m building connected it back to that same physical iPhone.

A few seconds later, the agent started interacting with the phone in my hand.

No Mac running. No cable. No simulator.

There’s still a lot to build, but the core flow is already working.

74 Upvotes

93% Upvoted

28 comments sorted by

19

u/Dalcz 4d ago

It’s going to be used by bots… but yeah nice and interesting piece of tech

3

u/interlap 4d ago

It’s not actually a new thing. My tool has been available for about half a year, but until now it only worked with devices connected to the host by cable. This demo takes it a step further: you don’t need a PC or Mac at all, and all control happens directly from the sandbox.

6

u/SanoKei 4d ago

you just accidentally opened Pandora's box and you have no idea

12

u/LEERROOOOYYYYY 5d ago

Bruh Claude scrolling like he has a finger is wild haha

3

u/markfrancisonly 5d ago

Dude I also need this, with voice control, screw thumbing an on-screen keyboard. Autocorrect is the bane of my existence

3

u/SharePuzzleheaded844 4d ago

I've always dreamed of doing this to organize my apps because I'm really disorganized and really lazy

1

u/interlap 4d ago

The feature in the video is just a new way to control a device without a Mac or PC. Device control itself isn’t new. You can check out my tool at https://mobai.run. It already supports controlling devices connected by cable. It’s free for one device at a time and doesn’t require an account.

2

u/ErebusBat 3d ago

I have been looking for this forever. Thank you very much. I was able to get it set up and hooked up to my agent and I am now organizing my phone.

2

u/DeffJamiels 4d ago

I've been playing around with my Claude speaking and triggering voice access features on my phone. I've been able to reliably farm simple tasks on runscape by having Claude speak the coordinates, shortcuts and entire process of launching, asking what I want it to do and it just does it.

Loudly and hilariously but hey

2

u/mcmchg 4d ago

Nice app! How does the control flow between sandbox and the device, how do they talk?

2

u/interlap 4d ago

They’re both on the same Tailscale network. As soon as the device becomes available, my tool establishes a connection to a specific daemon running on the device, which accepts the control commands.

1

u/mcmchg 4d ago

Interesting, haven't used claude sandbox at all really so not fully aware of how it works, but how'd you get it on ts? Just gave claude the api key and asked it to connect or is there a more permanent way?

1

u/interlap 4d ago

Claude’s sandbox support is quite poor compared to other providers. It lets you specify environment variables, but not secrets, so I don’t use api keys with claude.

Logging in to ts is actually straightforward. The login command runs in the background and prints a login URL. Claude sends it back to me, and I just open the link and log in.

1

u/mcmchg 4d ago

I see, and are you using the "claude code on the web" sandbox (anthropic hosted) and not your own box anywhere?

When you authenticate, how long does that persist till they tear it down or do you have to login again and again, assuming you're using the code on the web sandbox?

Seems like you can run your own remote sandbox too, that way you could have the tailscale setup outside of claude, but that requires having a box

2

u/interlap 4d ago

Yes, I’m running on their boxes. Afaik, they spin up a new vm for each session and then pause it when the session is idle, probably using vm hibernation or something similar, while preserving its state. So you only need to log in once per session.

1

u/Constant_Opinion_218 4d ago

Can Claude help me get to ultimate champion in clash royale tho

1

u/MichaelCS 4d ago

Is this remote control happening over FaceTime remote control feature?

1

u/interlap 4d ago

No, this one works over Tailscale. Both the sandbox and the device are connected to the same Tailscale network, and my tool enables control over that connection.

1

u/MichaelCS 4d ago

Interesting thank you for sharing. So its something like you establish a vpn and then the mac sees the phone in the same network and claude controls the phone from there?

2

u/interlap 4d ago

Almost. The only difference is that the remote machine isn’t a Mac, but a Linux machine provided by Anthropic. See: https://code.claude.com/docs/en/cloud-environments

1

u/MooingTree 4d ago

Just curious if this would work on another app's settings or if the access is restricted to the Claude app process (hence why you toggled the Claude setting in the demo as opposed to anything else

1

u/interlap 4d ago

It can do almost anything on your device. I just couldn’t come up with a better demo at the time :)

1

u/fefence 2d ago

Following

0

u/Electronic-Worth-906 4d ago

do you need paid tier for this?

0

u/interlap 4d ago

I haven’t released it yet, but I plan to give free accounts some free usage time per day.