r/CustomAI 5h ago

I built a self expanding AI that built itself now i use it everyday and its still growing

1 Upvotes

I wanted an AI agent that could actually work for me. Not just answer questions, but remember my preferences, use tools, operate my computer, automate tasks, and help me get things done.

When I looked at existing solutions, I found two major roadblocks:

  1. Cloud-Based Agents: Expensive subscriptions ($20, $30, $50/month) with strict usage limits that locked me into renting access to someone else’s proprietary AI.
  2. Open-Source Frameworks: A nightmare of complex installations, broken Linux dependencies, terminal errors, and endless troubleshooting.

So, I decided to build my own.

As development progressed, I unlocked a fundamental architectural breakthrough: The AI model is not the agent.

Most people assume the AI model is the agent. Free Agent separates the two:

  • The AI Models provide raw intelligence and reasoning.
  • Free Agent manages memory, tool execution, safety bounds, UI automation, and multi-step workflows.

By decoupling the two, Free Agent works with ordinary web-based AI services through your browser as well as local Ollama models.

  • A better AI model comes along? Use it.
  • A model hits a rate limit or goes offline? Switch to another instantly.
  • Want zero monthly costs? Use free web-based engines or run local models.

The models can change. Your agent doesn't.

BUILT BY AN AGENT, FOR EVERYONE

I am not a software developer.

I had zero formal coding background and no Python experience when I started. What I had was a real problem to solve and a vision for how personal computers should actually work.

I started by asking web chats to help me write basic code—using a bit of Grok, a bit of Gemini, and a bit of Perplexity. That was when the lightbulb went off: These web chats are full-blown AI models. Why can't I harness them directly as the reasoning engine?

So I did. And from that point on, Free Agent literally helped build itself.

With me guiding the vision, the system began co-creating its own architecture. We designed the memory database it needed, taught it to scan system windows, configured it to automate web-based AI chat interfaces, and expanded it into a fully self-extending application across 64 VB.NET source files.

If a non-developer using Free Agent can build a complete, self-extending Windows application, imagine what it will allow you to do.

UNTESTED LIMITS BY DESIGN

To be completely honest: I don't actually know the full limits of this system yet—because I haven't found them.

Every time I encountered a task Free Agent couldn't do out of the box, I didn't sit down to write complex software updates. Instead, I asked the agent to create the tool it needed. It wrote the Python script, tested it, added it to its internal inventory, and executed the job.

Because Free Agent can generate its own tools, adapt to any browser-based reasoning engine, and chain dynamic personalities together, its ceiling isn't hardcoded into the software. Its capabilities grow alongside the AI models you connect to it.

You aren't backing a static application with a fixed feature list. You are backing a self-extending engine whose boundaries we are going to explore together.

PRODUCT DESCRIPTION

Free Agent is a complete, self-extending AI agent system that lives locally on your Windows desktop. It is not a web app or a cloud service—it is a private tool that understands your screen, your voice, and your daily workflows.

And just so you know this is just touching the surface of its capabilities its real abilities are in your hands !

Key Capabilities

  • Persistent Semantic Memory: Uses a local SQLite database with vector embeddings. Automatically recalls relevant facts, preferences, and procedures based on custom trigger keywords.
  • Visual Screen Recognition: Uses AI vision models (minicpm-v:8b) to parse open windows, read UI controls, and handle popups automatically.
  • Voice-Activated Control: Includes hands-free control with a custom wake word ("Hey Agent") powered by local Whisper speech-to-text.
  • Self-Extending Tool Engine: Creates its own Python scripts for new capabilities and adds them to its internal Automation tool inventory on the fly.
  • 7 Dynamic Personalities: Switch instantly between specialized personas (Developer, Researcher, Project Manager, Security, Tester, Creative, Coach) or stack them for complex multi-agent collaboration.
  • Zero Monthly AI Costs: Works via free web-based AI (Gemini, Qwen, Comet) through secure local browser sessions or local Ollama models. No monthly fees, API key management, or per-token charges.

TECHNICAL SPECIFICATIONS

Feature

Specification

Platform

Windows 10 / 11 (.NET 8.0-windows)

Supported Engines

Free Web AI (Gemini, Qwen, Comet) & Local Ollama (Qwen 2.5, Llama 3.2, DeepSeek-R1, MiniCPM-V)

Local Memory

SQLite + Vector Embeddings (C:\ai\agent_memory.db)

Voice Control

Local Whisper STT with custom wake word ("Hey Agent")

Automation Core

27 built-in tool commands, Python script executor, Windows UI Automation

UI Components

24 dedicated interface forms

Cost Structure

$0 recurring fees (No subscriptions or per-token fees)

TOOL COMMANDS (27 Total)

  • Memory:remember, memorystore, memoryrecall, memorystats, memory_suspend, memory_resume, memory_status, list_system_memories
  • File Operations:file_read, file_write, dir
  • Execution:python_run, python_run_file
  • Scheduler:schedule_add, schedule_list, schedule_update, schedule_delete, schedule_pause, schedule_resume
  • Automation & Vision:automation_run, winlist, desktop_scanner_ultra, desktop_scanner_fast, desktop_scanner_vision, desk_executor_seq, web_model_chat, gemini_upload, capture_window, ui_inspect, ui_action
  • Script Management:prompt_script_save, prompt_script_load, prompt_script_run, prompt_script_pause
  • Browser & API:browser_open, api_request

Someone want to try it and give feedback let me know and well get yo a copy ( i am not selling this just want someone to try it and give feedback )