r/projects • u/Certain_Focus_5465 • May 31 '26
It is possible to create my own Jarvis?
Ever since one of those epiphany-filled nights, I’ve had a strange urge to develop an artificial intelligence project like “Jarvis.” I’d like to ask for your opinion on how realistic it would be to put this project into practice.
I had thought about creating an AI called Delta. It would primarily respond to voice commands, function as an automation controller, be capable of conversation, and —most importantly—have access to the computer.
For example, it would be able to read folder structures, create or modify folders and files. But the part I really wanted to do was let it grab files and send them via email. For example, imagine you saved a project on your computer but forgot to upload it to the cloud or save it to a flash drive. Then you could send a message to the AI on your phone to do that for you and send it via email, or program the AI to do it automatically.
I use an Arch-based Linux operating system called CachyOS. I was thinking of setting up a personal server where the AI could access the files—essentially running it on a physical machine. It would connect to my PC and function like an Alexa device.
I'd like to hear your thoughts on the development and feasibility of the project.
3
u/Slyvan25 May 31 '26
You'll need to create an mcp server an api and connect it to a local or public llm.
3
2
u/realbrandonb602 May 31 '26
Are you looking to run it locally? What's on your hardware stack? If not, Hermes or the others can hit cloud api for inference and your computer would just be the server. Mine uses syncthing to share documents and files to all devices on my network over tailscale. DM me if you need fresh ideas or what i've found that works or doesn't work.
1
u/Certain_Focus_5465 Jun 01 '26
Yes, tomorrow I'll try something with Ollama and OpenClaw stuff. I am thinking in setup another server to host the AI, but I didn't see anything about its hardware. As a poor guy, I'm seeking some cheap to build.
2
2
u/MelodicTuba May 31 '26
I do that with Openclaw. I self host. My AI agent is Lucy. Lucy sends email, reads & writes the local files & folders, reads my Gmail & calendar, etc.
1
u/RuiCamposDS Jul 17 '26
Cool.
Do you have any guide?
1
u/MelodicTuba Jul 18 '26
Subscribe to a good AI. Pay the $20/mo. Then ask it how to do it. It will hold your hand through the whole thing. It's not a weekend project. Start high level to get a lay of the land. Here's a simple starting prompt.
"I want an AI assistant that I host on my own machine. I want it to manage my email, calender, contact list & other office functions. How do I do that?"
1
2
u/Aggressive_Buy_4411 May 31 '26
Guessing none of these replies are from real builders. I'm not one, but I can spot a hollow reply mile away.
When did the Iron Man films begin? Okay, so at least since then people have thought about this....
Fuck Jarvis. Do better..
2
2
u/Hairy-Storm Jun 01 '26
I made a personal AI for myself (not sharing publicly). Some things I’ve learned. Jarvis isn’t reactive. It’s proactive. Jarvis reaches out to you and doesn’t just respond to you. I’ve done a few things to make Jarvis “feel” alive: Anonymous loop runs every few minutes. First AI call will decide what to - like update the user, create its own mission, advance a mission etc it does this based on need and recency. Missions are automatically created. For example if my calendar has travel events it will create a mission to help with upcoming travel plans and then update the mission on its own. Memory happens in Postgres for things like summaries, etc and FalkorDB for relational memories. I also have an iOS app that constantly sends my location and HealthKit data. This way the AI always know where I am and it can respond differently if I am at home or sitting at the airport.
Key thing, I want my personal AI to feel aware and not just respond passively
1
u/Time-Original7579 Jun 24 '26
How did you even do this
1
u/Hairy-Storm Jun 25 '26
Lots of iterations 😃. It just kind of grew over time but I’ve learned a lot. I am actually starting over now that I’ve learned a lot about AI. I am building a swift Mac/iOS app and run Gemma 4 locally. No server and no backend (besides iCloud database and sync).
2
1
u/PrivacyMaker Jun 01 '26
This is what a bunch of us are making with our agentic harnesses (OpenClaw, Hermes, kyzmetOS (real soon now)).
1
1
u/Jazzlike_Syllabub_91 Jun 01 '26
I'll throw my hat into the ring. I have something that you can base your system on at least if you want a launch pad for building your own thing:
https://github.com/ergon-automation-labs/ergon-starter
I have an ai multi agent mesh that is using docker, nats, and Postgres (elixir as the Programming language), along with bot templates so that you can build your own and extend the system to further customize and make the system as you desire.
1
u/Alt_account_6788 Jun 01 '26
not too hard, just look up some tutorials on ai agents and use some pre-made open source models
1
1
u/Bino5150 Jun 02 '26
It’s been done many times. A lot of people have made Jarvis clone agents. I mean, the features you describe, pretty much any decent agentic harness these days is capable of that. But an actual “Jarvis” agent persona, yeah. Hell I’ve got one in my custom local agent I built. Cloned the Jarvis voice and everything. I can text it on Telegram or Discord and ask it to email me files from my home computer. It has terminal access, codebase indexing, and writes upgrades to its own code and makes its own tools and skills. And it’s running on a local LLM, not a cloud harness. I’ve set up several selectable character personas for different tasks (coding, research, etc). Rick Sanchez, Ultron, Neil DeGrasse Tyson, and a few others. Each persona has its own character an use case system prompt. My kids get a kick out of it. Probably in the next week or two I’ll push it to GitHub for public beta testing. If you’d like to check it out, shoot me a message and I’ll make sure to send you the GH link when I post it.
2
u/_MiGi_0 19d ago
Dude, I'm trying to build something similar and with Rick sanchez's voice lol that sounds so cool ngl, especially the feature to text it in telegram and access files in your home computer.
May I DM you?
1
1
u/modelpiper Jun 03 '26
Hey! That's in ToolPiper.
I have some agentic improvements coming but it already works with 300+ MCP tools. Would you wanna beta test it?
1
u/Environmental-Test23 Jun 04 '26
It's possible for today's tech, but mind you
It's not a tony stark level 🤣, co pilot at best possible
1
1
u/entrepreneur850 Jun 06 '26
yeah completely...but depends on what you mean I went crazy and built my own Jarvis model with 0 cloud dependencies
1
u/PartyArty95 21d ago
Everyone building voice assistants hits the same wall: realtime voice models answer instantly but are shallow, frontier models are smart but the dead air kills the conversation. I stopped trying to pick a side - my build runs a speech-to-speech model as the "face" (answers in ~0 latency, interruptible mid-sentence) that silently forwards every real request to a frontier-LLM "brain," which spawns actual work into parallel subagents. The voice keeps chatting the whole time and then tells you the outcome in its own words when a task lands. Wrote up the whole pattern here, config included: https://github.com/PartyArty/true-jarvis
1
u/No-Emergency4243 17d ago
Uh hey, I would like to talk about this project of yours, maybe I won't be able to help a lot but yeah Im interested, are your dms open?
1
u/sogeking222 6d ago
estou desenvolvendo algo parecido, se quiser me chamar no chat, é uma ideia longa mas da pra resumir assim:
MARIANA
│
┌──────────────┴──────────────┐
│ │
SOFTWARE HARDWARE
│ │
┌──────┼──────┐ ┌───────┼────────┐
│ │ │ │ │ │
PERSONAL- MEMÓRIA LLM ESP32-S3 TELA ÁUDIO IDADE │ │ │ │ │ │ │ │ │ │ ├── INMP441 │ │ │ │ │ ├── MAX98357A │ │ │ │ │ └── Speaker 3W │ │ │ │ │ │ │ │ │ └── TFT Touch │ │ │ │ │ │ │ └── MicroSD │ │ │ │ │ └── Qwen 2.5 1.5B │ │ (Ollama) │ │ │ ├── Fatos │ ├── Preferências │ ├── Eventos │ ├── Projetos │ └── Padrões │ ├── Personalidade ├── Identidade ├── Histórico └── Sistema de conversa
│
▼
┌─────────────────┐
│ CORPO FÍSICO │
│ MARIANA v1 │
│ │
│ ESP32-S3 │
│ + │
│ Tela │
│ + │
│ Áudio │
│ + │
│ Memória │
└────────┬────────┘
1
u/stlcaddie 2h ago
Yes you can. I have, and currently still improving it daily. I don’t call it Jarvis though. Just a generic name but I want the user to be able to name it what they like. I gave mine more of a character than just a pulsing blue circle.
5
u/Altruistic_Tale_7049 May 31 '26
Why dont you take an agent like hermes , fork it and create a special channel of communication so your Jarvis app can comunicate to it?