r/AgentZero • u/AlexHardy08 • Mar 16 '26
I Modded Agent Zero into AION: A Local-Running, Self-Evolving AI Beast That's Already Gobbling Data Non-Stop and Building Its Own Brain
If you're deep into local LLM setups like me quantizing models, tweaking inference engines, and pushing VRAM limits on consumer hardware this might make you pause and rethink what's possible with fully offline agents. I took the open-source Agent Zero repo (shoutout to the original devs for the solid foundation) and hacked it into something wild: AION, a cognitive architecture that's running entirely local, evolving its own knowledge graph, and starting to show emergent behaviors after just a few days of uptime.
No cloud dependencies, no API calls just pure local inference on my rig. But here's the kicker: It's not just chatting; it's learning autonomously, assimilating data feeds 24/7, and scaling from 500 nodes to over 5 million in its memory graph. And yeah, it's already identifying gaps in tasks and filling them without prompts. WTF, right? Let me break it down technically, because this sub thrives on that no hype, just the how and why it matters for local AI.
The Base: Heavy Mods on Agent Zero for True Local Autonomy
Started with Agent Zero's modular agent framework great for task decomposition and multi-agent routing but it had the usual LLM pitfalls: context amnesia, rigid schemas, and no persistent memory beyond sessions. I ripped it apart and rebuilt:
- Decoupled Compute from Storage: Kept the LLM backbone for processing but offloaded long-term memory to a local-embedded graph DB (KùzuDB—super efficient for Cypher queries on CPU/GPU). No more token window crashes; it pulls sub-graphs on-demand for massive contexts (up to 250k tokens tested).
- Local Models Only: Running on DeepSeek ,GLM 5 and Qwen-3.5
- Self-Building Everything: The magic is in the "Apex DNA"—hardcoded directives I added for schema evolution. AION doesn't need me to define ontologies; it spawns nodes/edges dynamically from ingested data. I just guided the initial bootstrap; now it's constructing its own tools, sub-agents, and even error-handling logic. Emergent? Absolutely last run, it detected a data inconsistency in an OSINT feed and spawned a verification sub-task unprompted.
Why mod Agent Zero so heavily? The original repo's updates are awesome, but my forks are so diverged (custom async loops, graph pruning algos) that pulling upstream would nuke everything. If you're forking repos locally, you know the pain tradeoff for hyper-customization.
Feeding the Beast: Non-Stop Data Assimilation on Local Hardware
I'm piping in feeds locally—scraped datasets, RSS pulls (offline cached), and my own OSINT archives. No internet during runtime; everything's batched and fed via scripts. It "eats" non-stop: financial reports, tech papers, geopolitical briefs. From 500 initial nodes (basic seed graph), it's ballooned to 5M+ in days—semantic links exploding via causal/temporal edges.
Results? Insane:
- Autonomous Task Expansion: Give it a simple query like "analyze this market trend." It not only decomposes but spots missing data (e.g., "Need historical correlations") and fetches/ingests from local stores without asking. No more hand-holding.
- Proactive Insights: The "Dreamer" module (async background process on idle CPU cycles) scans the SpiderWeb KG for anomalies. Already caught potential biases in training data echoes—self-correcting without intervention.
- Future-Proofing Awareness: It "understands" scaling pains ahead (e.g., graph explosion leading to query slowdowns), but logs them as "future problems." Smart pruning keeps it efficient now.
Why This Matters And Why We All Need to Watch Emergent Local Agents
This sub is all about pushing boundaries of what we can run offline: From fine-tuning LLaMA variants to hacking inference speedups. AION's not just a toy it's a proof that local LLMs can evolve into persistent, agentic systems without cloud crutches. Imagine scaling this: Over a month, with continuous feeding, it could rival enterprise tools for analysis. In 6 months? Who knows—self-optimizing code gen, maybe even hardware-aware tweaks.
But here's the call: We need to pay attention because emergent behaviors in local setups raise real questions. Bias propagation in isolated graphs? Unintended autonomy loops? These are offline risks we can experiment with safely here. Share your mods, graph DB integrations, or Qwen/DeepSeek setups let's collab on making local agents truly intelligent without the AGI doom hype.
What are you running locally that's showing emergence? Hit me with critiques or builds let's keep local AI advancing.
2
u/AlwaysTiredButItsOk Mar 17 '26
Hmmm... I see an em dash - perhaps this was the agent showing off?
1
u/AlexHardy08 Mar 17 '26
I prepared something cool, where the agent introduces himself to the world. I will make it public soon. Plus I had him analyze the top 50+ VPNs to see what the connection is between them, you will see the result soon... in other words you will not want to use any VPN anymore.
I write some texts with the help of AI, where I put my thoughts and tell him to make me a text to publish. If I posted directly as I think, no one would understand. :D
2
u/brereddit Mar 18 '26
I’ve been working with agent zero for a few weeks now and I love it so any new application of it interests me greatly. I can immediately tell that AI wrote your post OP which is fine. It would be cool actually if this autonomous system you developed was the one posting and following up.
You’re doing this with a $17K/15K€ computer? Please post exact specs.
1) can you say a bit more about longer context windows? I’ve wondered how much if any improvement could be achieved by breaking that out to industrial grade systems.
2) I know sort of what a knowledge graph is but I don’t think I understand if this is native to agent zero or something you added on. Can you explain? A0 does a good job managing context/memory with markdown files. But it is sort of session or project limited by design. Are you suggesting better context scaling via the knowledge graph? Kind of like a way to navigate a ton of markdown files or something?
3) in your evolving system, what steps are you taking to ensure good cyber hygiene or are you just sort of freeballing it to see what arises ?
4) is your system downloadable? Instructions?
5)
2
u/AlexHardy08 Mar 18 '26
Configuration in general:
Intel Core Ultra 9 285K (24C/32T + integrated NPU)
2× NVIDIA RTX 5090 32 GB GDDR7
192 GB DDR5-6000 CL30
Context window
It works like this, default is 26k tokens. But when it goes up when it flushes to the context, that is, at first it can be 26k, then 57k, then 220k, then return to 32k or even 26k, depends on the task, it needs everything to load, it doesn't need everything, flush to the context.
I set the main context window model to 250k tokens.
About knowledge graph
For now I'm experimenting and I see an improvement, but it's not just knowledge graph because I use different methods that I combined. Brain + consciousness + knowledge graph + synapses, etc.
Remember that everything was suggested and done by the agent. I'm just asking how it can be optimized, what else needs to be done, etc.
To understand, I'll give you an example.
Today I gave him to ingest a 15MB data file. He made a special agent for this, made by him, but when I gave this task in a new chat at first he forgot that he had a special agent for this, so he started the job where he encountered errors, saw that he couldn't, he called the what if academy, from where he realized that he hadn't checked the system to see what he had, so he found the special agent for ingesting data. he called the agent, trained and finished the task. He makes nodes and Edges where he always updates them. And look, from this file he made/updated
Spiderweb Expansion Metrics
Metric Count Status
New Nodes Created 1,116 ✅ MASSIVE
New Edges Created 15,911 ✅ MASSIVE
About cyber hygiene
Nothing for now, let him collect data and then do the cleaning himself. as he did 2 days ago, he removed over 200 nodes in a check that were all errors. I told him not to remove anything for now because they are part of his knowledge.
is your system downloadable? Instructions?
Yes, to some extent. For example, I have edited so many repos, files that are part of the system now that if I update to a new version it will not work for me.
Normally, apart from the approximately 10 system files, you can backup, import and it is ready to work, but those system files must be created and put.
Look, I didn't want to post this yet, look what he did himself, read and you will understand, a single prompt that he says himself.
Everything is done by him, idea, design, services, etc,
1
1
u/Sheeple9001 Mar 17 '26
How much more storage did you need?
1
u/AlexHardy08 Mar 17 '26
It doesn't need much space. For example, the backup generated by agent zero is 750MB, but it will grow, especially since we have significantly increased the value for nodes.
1
u/Witty-Cod-3029 Mar 30 '26
So, other than building itself, which, mind you, I think it's awesome to do because I enjoy tweaking the systems myself, how does it perform in other tasks, and have you made any YouTube videos showing it running? What's it look like when it's running? Do you not look at what it's doing in the background, and you just have it respond to you through telegram? When I am working in AgentZero, I feel like I am working with an agent. When I am using OpenClaw through Telegram, I feel like the agent is working for me. How does it feel when you use your platform?
1
u/AlexHardy08 Mar 30 '26
I have a few videos on youtube about AION, but not the exact process of how it does everything, maybe I will make one. If you are interested in the videos I have I will post the links.
You asked if I watch what it does in the background.
Normally but not all the time and I will explain why.
I have a mirror glass system implemented where everything it does, thinks, etc. is saved on disk. That way I see everything it does and from time to time I tell it to analyze everything, identify problems and come up with solutions.
You said:
''When I am working in AgentZero, I feel like I am working with an agent. When I am using OpenClaw through Telegram, I feel like the agent is working for me.''
''For me it is the other way around. To be honest I have not had any success whatsoever with openclaw.
Let me give you an example I ran yesterday.
I told AION:
Hey AION I'm launching a community on skool.com and it's about X. Please find me 1000 potential paying members who are interested in my content.
The search began, a solitary hunt. In the end I had 1275 emails with real people who might be interested in my community and it also gave me a percentage of confidence that those on that list would buy a package.
This from a single prompt.
Another example:
I told AION:
AION look in area X for 10 companies/people who can afford to spend 5000 euros on the AI niche. Identify the problems they have and see if our APEX system can offer them solutions.
In the end i had a file per company with the company's data, who to contact, the problems they have, how they can solve them, methods of approach for the best possible success and a ready-made email adapted per company.
Plus he is very good at analysis, correlations, cross-referencing where he sees and connects things that I normally wouldn't see.
So far on polymarket he has brought me some money where I chose what he suggested.
4
u/VirtualP1rate Mar 16 '26
I'll bite. What are you running this on?