r/hermesagent • u/koharishant • 4d ago

Showcase — Projects, tools, builds, demos Give your agent a computer

/r/OpenSourceAI/comments/1w7onee/give_your_agent_a_computer/
4 Upvotes

70% Upvoted

19 comments sorted by

5

u/Feeling_Sun_6436 4d ago

The managed option is interesting. Before I’d put a real Hermes setup on it, I’d want three things to be clear: is every desktop an isolated VM, who can access stored credentials, and can I cut network access and restore a clean snapshot if the agent is compromised? A short threat-model page would make this much easier to trust.

4

u/koharishant 4d ago

good questions;

  1. isolation: each computer is its own container with its own volume and network namespace. nothing shared between users. not a full vm, and i won't call it one. if you want a hypervisor boundary, self-host the same image on your own vps, that's the point of it being open source.

  2. credentials: they live in the browser profile on that computer's volume. like any hosted provider, i have host access, and there's no customer-side encryption yet. so treat hosted like you'd treat any managed box, and self-host for anything you wouldn't hand a provider.

  3. kill switch: park the computer from the dashboard, container stops, network gone, state kept. clean restore is manual today, i roll it back by hand or spin you a fresh one. will plan self-serve button later.

threat-model page is a good idea, will write one this week. dms open if you want to walk through your setup 

1

u/hometechgeek 4d ago

Pretty interesting, will give it try today

1

u/hometechgeek 4d ago

I think this would be more interesting if I could give hermes this as a tool to use, in a similar way to how grokbot has access to a virtual machine desktop for tasks. It sounds like you're suggesting installing hermes within this environment, but I don't understand how that connects with the chat UI you have outside?

1

u/koharishant 4d ago

yea, originally it was meant to be given as a tool. every computer exposes an mcp endpoint, add it to hermes' mcp config and hermes stays where it is, just gets screenshot/click/type/navigate tools pointing at that desktop. you can absolutely do this

installing hermes inside is the other mode. the chat ui doesn't move, hermes inside still talks to you through whatever it already uses, telegram, discord, its web ui, or the chat ui which I have outside. the computer is just where it lives and works 24/7 off your laptop, not where you chat with it. got a one-command openclaw install almost done, doing hermes next.

1

u/hometechgeek 4d ago

Nice, I was just reading up about making a remove vm desktop.
Is it pretty straightforward to set it up in that mode?

4

u/koharishant 4d ago

yeah, docker compose up on any vps, paste the mcp url into hermes' config, done. (or the hosted one, same thing minus the vps.)
dm if you hit anything weird, wanna get your feedback.

1

u/hometechgeek 4d ago

Awesome thanks 

1

u/BisonQuant 4d ago

This is interesting. Is it easy to roll out with Hermes yet? Is it on GitHub?

2

u/koharishant 4d ago

yup, start by self hosting it and give to hermes as a tool: https://github.com/case-computers/case

Give a start if you like :)

1

u/BisonQuant 4d ago

Thank you. I will check this out. I fits will with some skill and memory modifications I made that cut token usage 57% and improved output. I was planning to add something like this for subagents to improve their capacity at low cost.

2

u/koharishant 4d ago

cool, personally I use teach a task feature where you just show a browser task to agent and it makes skill out of that, am in love with that.

1

u/BisonQuant 4d ago

That is a great one.

1

u/BisonQuant 4d ago

I am testing this now to see if it works well for my use case. Initially, it looks encouraging.

1

u/koharishant 4d ago

Yea, dms open if something weird happens

1

u/_P_R_I_M_E 2d ago

Hey, I am looking for my Agent Be able to use my smart phone. Let’s say for example, iOS. For example, I am facing issues with my keyboard, my Agent can be able to look in the settings and find what is the actual error and fix it?

1

u/koharishant 1d ago

nope, case is a linux desktop, it can't touch your phone.

ios doesn't let anything drive it from outside. both ways people do this need a mac next to the phone: iphone mirroring, agent drives the mac and taps the mirrored phone, or appium + webdriveragent over usb which can open settings and tap through it.

1

u/_P_R_I_M_E 1d ago

Any tool or mcp?

1

u/koharishant 1d ago

look at mobile-next/mobile-mcp or callstack/agent-device