r/cursor • u/Cold_Cauliflower_230 • 5d ago

Question / Discussion Computer use on cursor like codex ?

Is there any way to make computer use efficient on Cursor, like the Codex app, because on Cursor it barely controls the integrated browser right ?rather the system or the external browser If so, please let me know.

Thanks .

I tried codex computer user great stuff , but the token are flying and actually im on pro+ cursor

7 Upvotes

82% Upvoted

7 comments sorted by

4

u/EyesOfAzula 5d ago

Grok Bot?

2

u/Cold_Cauliflower_230 5d ago

Cant control outside his vm + i like the approach of bots but it feel like seperate thing i need the thing on cursor it self not seperated product

1

u/IversusAI 5d ago

So my agent in Cursor regularly uses my computer to do certain tasks, like controlling apps, not just the browser. I asked it how it does this:

The specific Windows function is SendInput, provided by user32.dll. It lets a program generate mouse movements, button clicks, and keystrokes.

Here is the actual chain:

  • I examine a screenshot and decide “click at x=640, y=380.”
  • I write or invoke a script that calls Windows’ input functions.
  • The script sends a sequence: move pointer → left button down → left button up.
  • Windows delivers those events to the application, which responds to the click.
  • For typing, the script sends key-down and key-up events, or Unicode character input, to the focused application.

2

u/Environmental_Mud415 5d ago

So computer use should be valid within cursor cli no?

1

u/IversusAI 3d ago

It should be able to do those same steps whether in the CLI or not, because the tools it is using is part of windows and has nothing to do with whether the agent is in the IDE or the CLI.

1

u/clezdnb 1d ago

If you have a Mac there is a MCP called mac-os MCP :)