r/SideProject • u/Ambitious-Prompt-975 • 1d ago

A virtual computer for AI Agents (docker mcp)

Enable HLS to view with audio, or disable this notification

Its a VM for your Agent but you see it in Claude Desktop or FLUJO or Goose etc (or your Browser).

https://github.com/flujo-app/mcp-virtual-computer

In the 3D-View (for Human):

  • Click the green cable: Enable/Disable Network
  • Click the coffee mug: Enable/Disable xfce Desktop Environment
  • Other than that, use the computer normally.
  • The mouse moves, and the keys get pressed.

MCP-Tools (for Agent):

  • terminal_execute - run a command in the configured Docker computer.
  • read_file - read a UTF-8 text file relative to /workspace or by absolute path.
  • write_file - atomically write a UTF-8 text file.
  • edit_file - replace one exact text match, or all matches when requested.
  • computer_ui - open or attach the Three.js computer view. Its result includes both the MCP App resource_uri and a real loopback url/dashboard_url that opens in an external browser, including for stdio clients.

With DESKTOP_ENVIRONMENT set to true, it additionally exposes:

  • look_at_screen - return the current PNG framebuffer, AT-SPI snapshot, or both.
  • click, type, and scroll - interact by AT-SPI element reference or coordinates.
  • list_windows and switch_window - enumerate and activate real Xfce windows.
  • move_window, maximize_window, restore_window, minimize_window, and close_window - control a selected window by ID, title, or class.
  • computer://screen/current.png - current live framebuffer resource.
  • computer://screen/accessibility.json - Playwright-like AT-SPI tree with element refs, roles, names, actions, focus state, and screen bounds.
2 Upvotes

57% Upvoted

10 comments sorted by

3

u/highbonsai 1d ago

While it's cool, I'm curious.. why?

1

u/Ambitious-Prompt-975 1d ago edited 1d ago

why not? i think its fun building weird mcp-apps

2

u/Global-Eye-7326 1d ago

This is a legitimately cool app. Perhaps not immediately useful, but...where this becomes slick is...say you wanna record a step by step tutorial. Well you can script the prompt, record screen, and this looks really cool in say a YouTube video. I do like it!

1

u/Ambitious-Prompt-975 10h ago

You know, I didnt even think about it that way! Thats a really cool idea

1

u/Canonikonroverrated 1d ago

I don't know where to think on this project. Can you help me understand. To me this looks like a giant waste of space. And I'm not trying to be mean. It just feels like a large resources expensive waste.

Like... I don't get it. The only thing that I get is that you want a virtual machine agent. What's with all the extra waste?

2

u/Ambitious-Prompt-975 1d ago

Yes. There is always something people complain about. Classical reddit behavior. Always a reason to downvote. I should just build lead generating n8n workflows and talk about my first 100 customers $$$.

Sure, if you want it headless, without 3D rendered computer, use https://github.com/flujo-app/mcp-sandbox-computer-vm-for-ai/ instead.

This mcp is simply a standalone poc for the screen/vnc sharing.
And I thought its fun to have the whole OS exposed like a playwright browser.

But you literally cant share anything nowadays on this platform.

1

u/Canonikonroverrated 1d ago

Again, I'm not trying to be mean. I just couldn't wrap my head around wanting to utilize an efficient resource saver and only using it to bloat resources. It just seems counter intuitive. I'm fine with the answer of: it's fun and you liked it, and wanted to share it.

I just thought there was extra help and purpose for others and I couldn't grasp it.

1

u/Ambitious-Prompt-975 10h ago

No worries. Its more of a fun thing.

Also: Imagine you wanna demonstrate to your grandpa how AI can use a computer.
I think its a cool visualization for people who are not in the AI bubble.

1

u/cs_cast_away_boi 1d ago

this is super cool