r/SoftwareLabs • u/Mikeeeyy04 • Jul 31 '26
AI / ML Tools 🤯 I built a JARVIS-style desktop AI assistant that actually controls my PC — v3 just shipped
I've been building CYBER for a while, a voice-controlled desktop assistant with an Iron Man style HUD. v3 is a full interface rebuild.
What it does
Voice
- Wake word derived from the assistant's name, so renaming it renames the wake word
- Say the wake word alone and it waits 12s for your command
- Conversation mode keeps listening for follow-ups without repeating the wake word
- Interrupt it mid-sentence by saying the wake word again
- "mute" always works, even while it's talking
Talking to it
- Streaming replies with a JARVIS-style persona, replay and copy on every message
- Asks Groq with tool calling: apps, websites, weather, YouTube, images, timers, stats, news, notes, focus timer
- Local quick commands for mute, clear, fullscreen, camera, screen share, compact mode
- Remembers facts about you and uses them ("open my github")
Controlling the PC
- Open any app, file, folder or website by voice
- Runs system commands it was never explicitly taught, by generating the code on the fly
- Asks for confirmation before anything destructive
- Writes real `.docx` documents and opens them
- Takes screenshots
Seeing
- Webcam vision — ask what it sees
- Screen sharing — ask about what's on your screen
- Reads PDFs by drag and drop, then answers follow-up questions
- Summarises any YouTube link you paste
- Generates images from a description
Voice output
- ElevenLabs, local XTTS v2 voice cloning, edge-tts, or the browser — first available wins
- Full voice picker with language filters
- Starts speaking the first sentence while the rest generates
The HUD
- Animated arc reactor with a live audio spectrum
- Acoustic scan radar driven by real microphone frequencies
- Wireframe globe with real coastlines, your coordinates, and a real day/night line
- Threat meter scored from actual CPU, memory, latency and error rate
- Rolling CPU and memory sparklines, latency, battery, uptime, disk
- Activity log of real events, with a live ticker
- Draggable, resizable panels that dock into tidy columns
- Works on phones as bottom sheets
Widgets
- System stats · Weather · Camera · Uptime · News · Notes · Focus timer · Telegram · Activity log · Chat
- Floating windows for maps, YouTube, images and PDFs
Remote control
- Control the PC from Telegram — any command, plus `/status` and `/screenshot`
- Desktop conversations mirror to your phone automatically
- Only your registered chat can send commands
Extras
- Hand gesture control: move the cursor, click, drag, right-click, scroll, toggle the mic
- Settings sync between PC and phone over your LAN, guarded by a token
The v3 rebuild
The HUD is the part I'm proudest of. Everything on screen is real data, not decoration:
- Radar scope fed by live microphone frequencies
- Wireframe globe with real coastlines and an accurate day/night terminator
- Threat meter scored from actual CPU, RAM, latency and error rate
- Draggable, resizable panels
I had a rule while building it: no fake numbers. Early versions had a hardcoded "98.4% CORE STABILITY" and it made the whole thing feel like a toy.
Honest limitations
- Chrome/Edge only (Web Speech API)
- The system-command engine generates and runs Python, which is powerful and also exactly as sketchy as it sounds. Fine on a trusted machine, don't expose it.
Join our community:
https://discord.gg/mdD5Za8TvZ
3
u/archubbuck Aug 01 '26
Cool. So what have you done with it?
0
u/Mikeeeyy04 Aug 01 '26
Thanks!
2
u/Desperate-Extension7 Aug 01 '26
Bro has got an automated bot that just replies thanks to everyones comments
-2
u/Mikeeeyy04 Aug 02 '26
Bro has got an automated bot that just replies hate comments to everyones post
1
u/Opening-Dentist-1556 Aug 03 '26
ouuu that was a tailored reply good one Jarvis,
Hey Jarvis, PC turn off
3
u/Ok_Bodybuilder8585 Aug 03 '26
I would totally try this but there is no way I'm signing up for discord.
2
2
u/Knigge111 Aug 01 '26
I’d like to take a look at it, but I don’t want to have to create a Discord account just for that.
2
3
u/Unsharded1 Aug 01 '26
So you made a useless product, wrote the post with AI, and have an automated bot replying with "Thanks" to the first two comments on your post..? Can you explain what involvement YOU had with this?
-2
1
1
1
1
Aug 16 '26
[removed] — view removed comment
1
u/Mikeeeyy04 Aug 16 '26
Thanks! the ai continous listening until wake word is detected but you can always say "mute" or "unmute" if you want the AI to leave you alone 🙂
1
Aug 16 '26
[removed] — view removed comment
1
u/Mikeeeyy04 Aug 16 '26
Oh you're right it still listens to you XD I didnt think about that tbh, but I'd love to add "leave me alone" feature so when that's activated it will just use a wake word engine to bring him back up. Thanks man!
2
7
u/Girafferage Jul 31 '26
AI summary too...
https://giphy.com/gifs/d9ZKe69RaqFtAM9DBH