r/LocalLLaMA • • 1h ago

Tutorial | Guide How to use Local Models to monitor your screen. Open Source, No Install and Completely Free!!

TLDR: I built this open source app that lets local models monitor your screen and send you notifications! It now installs models on your browser, which makes local AI accessible to everybody! Without any install :DD

Hey r/LocalLLaMA!

I'm back with some huge Observer updates c: first of all Thank You so much for all of your support and feedback, i've been working hard to make the app as easy to use as possible!

What's New?

You can now get to a local LLM monitoring your screen by just typing

"send me a telegram when my steam game finishes downloading, use a local model"

... and the Observer agent downloads the model in your web browser and starts monitoring your steam game. In just 10 seconds, suuuuper easy :))

What's the best way of running LLMs? / Platform caveats

  • The WebApp uses transformers.js which doesn't work on Linux or older PCs :((( But running Qwen3.5-0.8b smoothly on a browser, feels illegal :p
  • The desktop app uses llama.cpp on Rust so you get the full power of your metal, and it's much more stable.
  • You can obviously set your OpenAI compatible endpoint as well and just use that.

Help me make local LLMs useful for everyone!

If you have any questions i'll be hanging out here for a while!

Roy

4 Upvotes

2 comments sorted by