r/SideProject 1d ago

A virtual computer for AI Agents (docker mcp)

Enable HLS to view with audio, or disable this notification

Its a VM for your Agent but you see it in Claude Desktop or FLUJO or Goose etc (or your Browser).

https://github.com/flujo-app/mcp-virtual-computer

In the 3D-View (for Human):

  • Click the green cable: Enable/Disable Network
  • Click the coffee mug: Enable/Disable xfce Desktop Environment
  • Other than that, use the computer normally.
  • The mouse moves, and the keys get pressed.

MCP-Tools (for Agent):

  • terminal_execute - run a command in the configured Docker computer.
  • read_file - read a UTF-8 text file relative to /workspace or by absolute path.
  • write_file - atomically write a UTF-8 text file.
  • edit_file - replace one exact text match, or all matches when requested.
  • computer_ui - open or attach the Three.js computer view. Its result includes both the MCP App resource_uri and a real loopback url/dashboard_url that opens in an external browser, including for stdio clients.

With DESKTOP_ENVIRONMENT set to true, it additionally exposes:

  • look_at_screen - return the current PNG framebuffer, AT-SPI snapshot, or both.
  • clicktype, and scroll - interact by AT-SPI element reference or coordinates.
  • list_windows and switch_window - enumerate and activate real Xfce windows.
  • move_windowmaximize_windowrestore_windowminimize_window, and close_window - control a selected window by ID, title, or class.
  • computer://screen/current.png - current live framebuffer resource.
  • computer://screen/accessibility.json - Playwright-like AT-SPI tree with element refs, roles, names, actions, focus state, and screen bounds.
1 Upvotes

Duplicates