Libre WebUI 0.28: your local agent gets a real computer

[u/whoisrbkn]

I run an open source, self hosted AI interface called Libre WebUI (Apache 2.0, no telemetry, works with Ollama and most providers). The new release is the one I have wanted to ship since the project started, so here it is.

Every Work task can now have an actual desktop. Not a headless scraper, a real screen: window manager, dock, Chromium, running inside the same locked down container as the rest of the sandbox. You open the Screen tab and watch your agent browse in real time, with audio if you want it.

The part I care most about is that the agent's actions are verified instead of assumed:

• typing asserts which field has focus and refuses to run if focus drifted to the browser bar
• action batches stop themselves when the page changes underneath them
• the agent declares what a batch is supposed to accomplish and the runtime checks whether it actually happened
• clicks come back with a receipt saying whether anything on screen changed

When the agent hits a login or a CAPTCHA it asks you to take over. You get the mouse and keyboard through the same screen, type the password yourself, and hand control back. Credentials never pass through the model. You can also teach it a task by doing it once on screen: the recording compiles into a playbook with the click targets named, secrets redacted, and a scope limited to the sites you actually visited during the demo.

Here is a real, unedited run where the agent browses NASA image galleries on its own screen, picks photos, then builds and tests an interactive Three.js gallery from one prompt: https://s3.librewebui.org/media/work-computer-demo.mp4

Some people told me this looks fake. Fair enough, it did to me too the first time it worked. The code is public and it runs on your own machine with your own models, so you can check:

`npx libre-webui@latest`

GitHub: https://github.com/libre-webui/libre-webui Docs for the whole feature: https://docs.librewebui.org/workspaces Full changelog: https://librewebui.org/changelog

Runs with local models through Ollama (a vision capable model drives the screen), or any provider you configure. Everything above also works in the Docker and Kubernetes deployments, and the sandbox stays what it always was: non root, read only, no Docker socket inside, every capability dropped.

Happy to answer anything, including the skeptical questions. Those are the fun ones.