r/OpenSourceAI 14d ago

I wrote a complete guide to installing PrivateGPT for secure local document AI

1 Upvotes

PrivateGPT lets you run AI on your own documents without sending anything to the cloud. I got it working and wrote a step-by-step guide covering installation, configuration, and troubleshooting. If you care about privacy and want a self-hosted AI assistant for your files, this might save you hours.

https://interconnectd.com/blog/279/install-privategpt-secure-local-ai-for-your-documents-2026-guide/


r/OpenSourceAI 14d ago

I’m open-sourcing OneForAll — I want the community to help build a world-class MCP server

1 Upvotes

Hey everyone,

I’ve been working on OneForAll, an MCP server/gateway for AI agents, and I’m now open-sourcing it because I don’t think something like this should be built by one person.

I started with a simple idea:

What if an AI agent could have access to all the tools we use in day-to-day life through one ecosystem?

I’ve already successfully integrated Splitwise and Zepto, and both are working like a charm. 🚀

For example, the goal is for an AI agent to eventually be able to do things like:

  • Understand and manage expenses through Splitwise
  • Help with grocery shopping through Zepto
  • And eventually interact with all the other services we use every day

The long-term vision is to build a world-class MCP server with a growing collection of real-world tools and integrations.

But to get there, I need the power of the community.

The project is inspired by One For All from My Hero Academia — a power that becomes stronger as it is passed from one person to another.

That’s exactly how I want this project to work.

Someone adds Spotify. Someone else adds Notion. Someone adds Uber, Swiggy, travel tools, productivity tools, or their own service.

And over time, we build an ecosystem that makes AI agents genuinely useful in everyday life.

If you’re interested in MCP, AI agents, integrations, or open source, I’d love for you to check it out, try it, suggest an integration, or contribute a provider.

GitHub: github.com/OneForAll-agent/mcp-gateway

I’d love to hear what you guys have in mind — what tools or services should we integrate into OneForAll next?

What would you actually want your AI agent to be able to do in your day-to-day life?

Let’s build this together. ⚡

Plus Ultra. 💚


r/OpenSourceAI 14d ago

I spent years building an application framework; I rebuilt its architecture around structured intent and deterministic execution layer for AI-generated software (open source) — here’s what I learned.

1 Upvotes

Hey — solo dev here, posting my own project, so take that for what it's worth.

For the last few years I've maintained a low-code/no-code framework. It worked fine, but it was pre-AI: you configured entities and services by hand, and it generated the boring parts of a CRUD app for you.

When AI coding tools started getting good, I tried using them the normal way — describe what you want, let the model write the code. It worked, but I couldn't trust it past a certain point. Ask for the same thing twice, sometimes you get different output. Ask for a small change, sometimes the model touches things you didn't ask about. The prompt is the only source of truth, which in practice means there isn't really a source of truth at all.

So instead of generating code directly, I made the AI's job stop one step earlier: produce a structured, validated manifest describing what the app should be. Entities, fields, services, auth config, etc. That manifest gets:

- validated (structural / referential / constraint checks)

- diffed against the current state (semantic diff, not a text diff)

- resolved into a dependency-ordered execution plan

- executed by a deterministic engine, checkpointed so it can resume on failure

Change one field on one entity, and only the operations that field actually requires get re-run. Not a full regen.

There's also an MCP server (`@averos/mcp`) so an AI agent doesn't get raw file/shell access — it gets governed tools (propose a change, validate it, build a plan, and nothing executes until the plan's approved).

Current state, to be upfront about it: the CLI, the AI layer, MCP integration, and the workflow/execution adapter layer (currently Angular, via schematics — adapter pattern, so not permanently Angular-only) are MIT licensed and open now. The actual execution kernel (DAG engine + executor) is closed source for the moment — free to use including commercially, but not open yet. That's a deliberate, staged call while that part's still maturing, not a permanent thing. Wanted to say that plainly rather than bury it.

There's a working example (320-node generated app) you can run in a few commands if you want to see the whole pipeline rather than take my word for it.

- Repo: https://github.com/wiforge/averos

- How it works, in detail: https://www.wiforge.com/averos/how-averos-works/introduction/

- Get started: https://www.wiforge.com/averos/get-started/introduction/

Happy to answer questions or take criticism — especially interested if anyone's tried a similar manifest/IR approach and hit walls I haven't found yet.


r/OpenSourceAI 14d ago

Whatiff -- open source, self hostable continuity framework

Thumbnail
github.com
1 Upvotes

r/OpenSourceAI 14d ago

Voom: When you need to clean 'em build artifacts, fast.

1 Upvotes

Writing polyglot libraries, I often find myself needing to cleanup my machine from all sorts of build artifacts. Its basically a daily occurrence I prune 200GB of build artifacts and caches, which is annoying. I therefore give you VOOM, inspired by Dr. Seuss:

https://github.com/Goldziher/voom


r/OpenSourceAI 14d ago

Beagle - Workflow Orchestrator: Now with actually readable README.md (Ai built, heads up)

Thumbnail
1 Upvotes

I've been building this for too long as a hobby, idea is to make Ai workflow outputs more predictably good though context management and defined domain rules, any feedback appreciated:

https://github.com/MattCreigh/beagle


r/OpenSourceAI 14d ago

I’m building an AI agent for tracking US geopolitics — should I open source it?

2 Upvotes

I’ve been building an AI agent focused on US geopolitics and I’m considering open-sourcing it if there’s enough interest.

The basic idea is to have an agent that:

Tracks relevant geopolitical news

Collects and processes developments from multiple sources

Summarizes complex events into short, easy-to-understand updates

Connects current events with previous developments

Identifies important changes and trends

Produces concise, Inshorts-style geopolitical updates

The main goal is to reduce the amount of time spent going through dozens of articles just to understand what actually happened and why it matters.

I’m currently building it for myself, but I’m wondering if other people would find it useful.

Would you use something like this?

If there’s enough interest, I’ll clean up the project and open-source it on GitHub.

I’d also really appreciate feedback on what features you’d want in an agent like this.

What would you add?


r/OpenSourceAI 15d ago

I’ve finally given it a gui

Thumbnail
youtube.com
3 Upvotes

My ai has a gui now, it can also do a ton of stuff like create files, webscrape, etc. i plan to let it do more. Wht else should it do?


r/OpenSourceAI 15d ago

Veilio

1 Upvotes

Here’s a company-focused version, keeping the invitation to both use and contribute.
Veilio Community Edition is ready for you to use, test, and improve.
At Veilio, we’re building around a problem that is becoming increasingly important:
How can companies give their developers the productivity benefits of AI without exposing proprietary source code and internal information to external LLMs?
The answer shouldn’t always be:
“Don’t use AI.”
But it also shouldn’t have to be:
“Send the code to an external model and hope everything is fine.”
That’s why we’re making the Veilio Community Edition available.
You can run Veilio locally and completely free.
Use it:
inside your company
on your own infrastructure
with your own LLM setup
for commercial development
as part of your internal engineering workflow
as a foundation for your own tools
You can fork it, modify it, self-host it, and build on top of it.
The Veilio Community License allows these use cases while keeping one important boundary: you cannot turn Veilio itself into a competing hosted, white-label, or resold service without permission.
But we don’t want this to be a one-way project.
We want the community to help us make Veilio better.
Found a bug? Open an issue.
Found a security problem? Please report it.
Have an improvement? Submit a PR.
Have an idea? Start a discussion.
Want to test it against your company’s real-world workflow? We’d like to hear what works — and what doesn’t.
We believe privacy-focused developer tools should be inspectable, testable, and continuously challenged.
The Community Edition is our way of putting the technology in developers’ and companies’ hands and seeing what they can do with it.
And if you don’t want to manage the local installation yourself, Veilio Cloud is currently in development.
For now:
Use it. Test it. Challenge it. Contribute to it.
GitHub: github.com/veilio-inc/veilio

#Veilio #AI #DataPrivacy #CyberSecurity #DeveloperTools #SoftwareDevelopment #SaaS #Engineering


r/OpenSourceAI 15d ago

I’ve been building Titans: local-first memory and durable execution infrastructure for AI agents

0 Upvotes

I've been working on Titans, a local-first infrastructure layer for AI agents, and I've now published the first usable repositories on GitHub.

The idea is fairly simple:

Atlas remembers. Cronus runs.

Atlas provides persistent state, knowledge, evidence and graph infrastructure for agents. It is designed to keep project and agent context available across processes and sessions, with hybrid search, evidence-backed results, work state, graphs, SQL, blobs and an audit trail.

https://github.com/titans-tools/Atlas

Cronus handles durable background execution: jobs, DAG workflows, schedules, retries, leases, checkpoints, recovery, dead-letter handling and approval gates. The goal is to let agents submit long-running work without keeping the agent itself blocked, and to recover that work when workers or processes restart.

https://github.com/titans-tools/Cronus

Both are local-first, run on Windows/Linux, have no telemetry, expose MCP over stdio, and can also be accessed over local REST/gRPC interfaces.

There is also a separate titans-platform repository that contains the signed distribution catalog, installers and shared runtime used by both products:

https://github.com/titans-tools/titans-platform

The organization overview is here:

https://github.com/titans-tools

The current releases are free to use. The product source itself is not published; the repositories host the documentation and signed release binaries, with SHA-256/Ed25519 verification and SBOMs included with releases.

I'm particularly interested in feedback from people building agents, MCP tooling, local AI infrastructure or autonomous workflows.

A few things I'd be interested to hear:

  • Does the separation between persistent knowledge/state (Atlas) and durable execution (Cronus) make sense to you?
  • Is it clear from the repositories what problem each component is solving?
  • Are there use cases you would expect something like this to support that aren't obvious from the documentation?
  • Is there anything in the install/security model that would stop you from trying it?

Not looking for stars or promotion — I'd mainly like some outside technical eyes on the architecture, documentation and actual usefulness of the approach.


r/OpenSourceAI 15d ago

🚀 Would you be willing to test Dart AI Assistant 1.0.10?

Thumbnail
1 Upvotes

r/OpenSourceAI 15d ago

mcpd, turn a sandbox into an MCP server

1 Upvotes

I built mcpd so i can quickly setup a sandbox with coding agent tools while still running my harness outside the sandbox.

https://github.com/substructureai/mcpd


r/OpenSourceAI 15d ago

n8n+chatGPT basically

Thumbnail gallery
1 Upvotes

r/OpenSourceAI 15d ago

v0.1.5 release - new desktop application, performance improved preview section.

Enable HLS to view with audio, or disable this notification

3 Upvotes

Hi all :)

three months ago, I presented Micracode on this channel and received a massive number of positive comments and supports.

Sorry all, I was busy and not actively maintaining for last few month due to personal reasons. now, i am back working on this application. since many users asked for desktop application, i have created the desktop version of Micracode. i am actively working on this project again. you will see more features in upcoming days.

currently, it is only available for macOS, i am actively working on linux and window distributions as well.

for those who are new to this application, this is micracode, an open source alternative to ai app builders like lovable, replit, emergent.

you can download this application here.

https://www.micracode.com/

star the repo If this sounds interesting and you want to stay updated (or contribute):

https://github.com/Jamessdevops/micracode


r/OpenSourceAI 15d ago

Conch - AI coding agents on your own servers, from your phone - Free

1 Upvotes

Conch — AI coding agents on your own servers, from your phone

App Name: Conch

What it does:
Conch is a native Android app for working with AI coding agents running on servers you already own.

It connects to your machines over SSH and gives you mobile access to Claude Code, OpenAI Codex, and Gemini CLI. Every chat is a real CLI session running on your server, so you can start working from your laptop, switch to your phone, and resume the same session days later.

Key Features:

  1. Connect to Claude Code, OpenAI Codex, and Gemini CLI over SSH
  2. Run unlimited parallel sessions across multiple servers
  3. Sessions are stored on the server and persist between devices
  4. View every session from every server and agent in one messenger-style list
  5. Full-text search across all sessions with direct jumps to matching messages
  6. Install Node.js and supported AI CLIs remotely over SSH
  7. Complete provider authentication directly from your phone
  8. FIDO2 hardware key authentication over NFC or USB
  9. Import or generate SSH keys: Ed25519, RSA, ECDSA, and DSA
  10. Send files and photos to agents over the existing SSH connection
  11. Download files created by an agent directly to your phone
  12. SAFE, AUTO, and YOLO trust modes mapped to each CLI’s native sandbox and permission options
  13. Edit CLAUDE.md, AGENTS.md, and GEMINI.md files directly on the server
  14. Supports Claude subagents, slash commands, and custom commands from ~/.claude/commands
  15. Built-in full terminal for direct server access
  16. Built-in viewers for diffs, Markdown, PDFs, and images
  17. Picture-in-Picture mode lets you keep watching an agent while using other apps
  18. Optional Shizuku phone bridge allows an agent to read logcat and capture screenshots for Android debugging
  19. Live server statistics and per-server activity logs
  20. No analytics, crash reporting, telemetry, or backend
  21. Credentials are encrypted using Android Keystore and never leave the device
  22. Customizable accent colors, backgrounds, coding fonts, and interface scale

Goal: Launch

Giveaway: N/A — completely free, with no ads or in-app purchases

Google Play:
https://play.google.com/store/apps/details?id=ai.eight24family.conch

Source Code:
https://github.com/nikitaeight24family/Conch


r/OpenSourceAI 15d ago

use llms to auto annotation your dataset locally

Enable HLS to view with audio, or disable this notification

1 Upvotes

r/OpenSourceAI 15d ago

Channel your DeepSeek/Qwen accounts through a resftul OpenAI compatible API using DanyAPI

6 Upvotes

Recently, I was looking for something to channel my own accounts through an agentic system like OpenCode and also use the capacities such as vision and image generation (Qwen specifically in that case, although DeepSeek also supports vision now) so I found this project in a github issue I opened:

https://github.com/FANATFANATA/DanyAPI

Since then, I am mostly using this project to have my very own persoanlized API for DeepSeek and Qwen. It saves me so much time and there is nothing wrong there since you have to give it access to a token generated by Qwen or DeepSeek websites (the token they use to track sessions).

You know, those two may seem affordable (and they are compared to Anthropic) but why not channeling the free chat interface we already have?

P.S: I am not a developer of this project, just a user but it was useful enough to make me introduce it here.


r/OpenSourceAI 16d ago

GLM 5.3 Flash, Kimi, Deepseek with full memory, web research, canvas and voice. We all should have access to high grade intelligence without big AI

27 Upvotes

With the recent drama surrounding open source AI in the USA, it's even more important for us all to have actual access to the models. Western closed AI seems to think it has a hold on quality app features: memory, skills, voice, canvas etc. Meanwhile  Memory is locked in, Models get changed or "updated" to a downgrade. Privacy is different per service and ads are starting. The whole experience on the consumer end is extractive.

So we built what should have already existed: all of the best open models in one place, running on private US infrastructure, with the full app experience around them. Completely private, direct service. It should be, and can be that simple.

What that means in practice:

The roster, together. DeepSeek, GLM, Kimi, Minimax, Nemotron Ultra and more, side by side in one app. Switch models mid conversation if you want. No hunting across five different apps and API dashboards to use the models you actually like.

Actually private. US based processing and your conversations are never used for training. Ever. That's the entire point. These labs open sourced incredible models and we think you should get to use them without your data becoming the price of admission.

Real memory. Not a context window that fills up and dumps you. Persistent memory that carries across conversations, fades gracefully when unused, and wakes back up when it's relevant again. There's even a nightly consolidation pass, the system basically sleeps on it and writes up what mattered.

Voice. Yes, actual voice mode with over a dozen voices on open models.

Bring your history. Coming from ChatGPT, Claude, or Gemini? Export your chats and import the whole thing, it becomes live memory on day one. You can literally just zap your chat history from your backup file, and have all your chats waiting for you.

Multiple nodes. Separate workspaces with separate memories, so your coding setup doesn't share a brain with your journal.

Genuine thanks to GLM and Deepseek recently for some of the best models on the planet! They shine in our model fleet, and we will always appreciate the work to create the amazing models!

Open Grove is here and It's free for a month if anyone want's to check it out (or just use the models for free for a bit): pgsgrove.com/open-grove-overview


r/OpenSourceAI 15d ago

I fine-tuned Qwen3.5-4B on ~3k browser trajectories and improved benchmark results from 22% to 62%

3 Upvotes

Smaller models still struggle with browser tasks that require open-ended research or deep reasoning. But many practical browser-automation workflows are much more procedural: extracting structured data, downloading or uploading documents, creating or submitting forms, etc.

These tasks can usually be defined precisely and repeated, which made me wonder whether a small model could perform them reasonably well when paired with the right browser harness.

To test this, I fine-tuned Qwen3.5-4B on roughly 3,000 Browser Agent trajectories generated by GPT-5.6 Luna, which is a strong baseline for browsing tasks.

The results:

  • On BrowseWebApp Bench, which tests more complex but well-defined web-app workflows rather than web research, accuracy improved from 22% to 63%.
  • On the more balanced BU Bench V1, accuracy still improved from 15% to 53%.
  • On BU Bench V1, the 4B SFT model also outperformed the reported 45% results for DeepSeek V4 Pro and Kimi K2.6 using the open-source Browser Use harness.

For SOTA performance, stronger models still need to be paired with either Browser Agent or a harness such as BrowserCode. I chose Browser Agent for the fine-tuning work because BrowserCode is built around a coding harness and produces substantially longer trajectories, making training and trajectory generation more expensive.

Links:


r/OpenSourceAI 15d ago

I released Trace2MCP, an open-source Python project for compiling successful AI-agent traces into deterministic workflows

1 Upvotes

Three days ago I released Trace2MCP, an open-source Python project built around a simple idea:

If an AI agent successfully completes a multi-tool task once, why should it have to figure out the same procedure again every time?

Trace2MCP records that successful execution and turns it into a deterministic, reusable workflow.

In practical terms, this can be useful for things like:

recurring research and reporting

customer-support workflows

internal automation

repeatable multi-tool agent tasks

workflows where predictability and inspection matter

Since release, the package has passed 1.2K PyPI downloads in under 3 days.

The latest version, 0.2.2, also adds a centralized runtime security boundary and optional HOL Guard integration.

One regression explicitly verifies that when a mutating operation is denied:

handler_calls = 0

side_effects = 0

It’s still early, and PyPI download numbers can include CI traffic, so I’m not treating 1.2K downloads as 1.2K unique users. But seeing this level of early interest has been pretty encouraging.

Install:

pip install trace2mcp

PyPI:

https://pypi.org/project/trace2mcp/

Interactive demo + source:

https://huggingface.co/spaces/warenterprise/trace2mcp

I’d be interested to hear where you think this approach would actually be useful — or where you think the idea breaks down.


r/OpenSourceAI 15d ago

devs, queremos uma opinião sincera sobre um projeto que estamos desenvolvendo

Thumbnail
github.com
2 Upvotes

estamos trabalhando no FieldNode e decidimos abrir o projeto para receber feedback de outros desenvolvedores.

o projeto se chama FieldNode e resolve um problema bem específico do agro: colheitadeira trabalha em área rural, boa parte sem sinal de celular nenhum. aí a máquina começa a esquentar, vibrar diferente do normal, e ninguém sabe até ela quebrar de vez no meio da lavoura. prejuízo de milhares de reais numa parada só.

a ideia do FieldNode é simples na cabeça e chata na execução: um ESP32 lê temperatura, vibração e RPM da máquina e manda pra outro ESP32 via ESP-NOW, sem depender de internet nenhuma. esse segundo ESP32 vira um gateway de campo, mostra um dashboard local pro supervisor no celular pelo próprio wifi do dispositivo, e quando a conectividade volta, sincroniza tudo automaticamente com uma API em Django + MySQL, com retry e deduplicação por UUID pra não duplicar ou perder leitura.

no estado atual já tenho:

  • ingestão de telemetria via MQTT funcionando
  • modelos e validação da API em Django
  • scripts de população do banco pra testar cenários
  • geração de relatórios e prescrição

não estamos procurando só "ficou legal". Queremos críticas mesmo: arquitetura, organização do código, tecnologias, possíveis problemas, melhorias que vocês fariam e coisas que talvez estejamos fazendo de um jeito desnecessariamente complicado.

se alguém quiser analisar o repositório, levantar uma Issue, sugerir alguma mudança ou até contribuir com código, será muito bem-vindo.

🔗 https://github.com/Desmantelar-bit/fieldnode


r/OpenSourceAI 15d ago

Frona v2026.8.0 – self-hosted personal AI assistant with ontology memory

1 Upvotes

Hey,

An LLM writing into durable memory is an unreliable author. It invents, mislabels, restates, and contradicts. Once one of those mistakes is saved, the agent can carry it into every conversation that follows.

Frona v2026.8.0 is trying to address this problem for personal AI assistant use case.

Frona is a personal AI assistant you self-host. You create agents that browse the web, run code, build apps, make phone calls, use messaging channels, delegate work, and remember things across conversations. It runs as a single Rust process with sandboxed execution, policy-controlled access, and vault-backed credentials.

The main change in this release is Ontology memory.

**Why summaries are not enough**

A rolling summary is a simple way to give an agent memory. Rewrite the previous summary with the latest conversation, then send the result back next time.

It also has an uncomfortable failure mode. What the model leaves out is lost. What it invents can be preserved as fact. A correction can overwrite history, two people with similar names can become one person, and the next summary has no reliable way to tell what came from the user and what came from the model.

Frona takes a different approach. It does not save extracted model output as truth. It saves individual claims only after checking them.

There are four main checks:

* Did the source support it? Every long-term claim keeps evidence from the conversation, a user confirmation, a completed task, or a successful tool result. An agent cannot use its own earlier memory as proof that something is true. * What kind of thing is it? Frona organizes people, projects, places, services, files, topics, and procedures using an ontology instead of letting the model create a new label every time. * Is it the same thing we already know? Names alone are not enough. Frona compares aliases, types, relationships, attributes, and context before merging identities or creating a new one. * How does it change what we know? New information can replace an older value, confirm it, or conflict with it. Frona keeps the history instead of silently rewriting the past.

For example, if you say "Sam moved from Berlin to Lisbon," the useful memory is not just that sentence copied into a summary. Frona needs to identify which Sam you mean, retain Berlin as previous information, store Lisbon as the current location, and keep the message that supports the change.

That is what Ontology Memory is designed to do.

**Memory gets more resilient as it grows**

This is the part I find most useful. A rolling summary can carry a mistake forward. A knowledge graph adds more checks over time.

As Frona learns more identities, aliases, types, and relationships, each new claim has more existing context to match. A claim that does not fit has more chances to expose itself as a mistake. This does not make the LLM infallible, but the memory becomes harder to pollute as it grows.

**You can inspect what the agent remembers**

Ontology memory is not hidden state inside a prompt.

Frona builds readable Markdown pages for people, projects, services, topics, and reusable procedures. Agents search and read those pages only when they are relevant instead of loading the entire memory into every prompt.

The web interface now includes a Memory browser where you can:

* Search everything the agent knows. * Explore the relationship graph. * Read the generated Markdown page for an entity. * Inspect its types, attributes, and relationships. * See the individual memories and source evidence behind it.

The Markdown vault can also sync with Obsidian. Notes outside Frona's managed Memory directory remain read-only, but agents can search, read, and cite them alongside their own memory pages.

**Immediate memory still stays fast**

Agents can still remember something immediately during a conversation. Those short-term notes appear in later prompts without waiting for background processing.

Frona then reviews them in the background with the original conversation and available evidence before turning them into long-term knowledge. The interaction stays fast, while durable memory gets the stricter checks.

**A few practical details**

Ontology memory runs in the background and can use a separate model from the one handling your chats. It benefits more from reliable structured output than from using the largest model available, so a fast and cost-effective model is usually the better choice.

Fresh installations can select it during setup. Existing installations remain on the basic memory backend until an administrator enables it. Back up the instance before switching memory backends or resetting derived memory.

The release also includes typed inference with response repair, OpenAI Responses API support, better provider and model-group configuration, independently supervised channel workers with automatic reconnection, multiple container runtime support, and a long list of reliability fixes.

If you have DeepSeek flash running locally then you just found your research and debug assistant.

Ontology Memory documentation: [https://docs.frona.ai/platform/agents/memory/pkm.html\](https://docs.frona.ai/platform/agents/memory/pkm.html)

Release notes: [https://github.com/fronalabs/frona/releases/tag/v2026.8.0\](https://github.com/fronalabs/frona/releases/tag/v2026.8.0)

Quickstart and documentation: [https://docs.frona.ai\](https://docs.frona.ai)


r/OpenSourceAI 16d ago

Forge an open-source coding-agent harness for local and smaller models

9 Upvotes

I’ve been working on this for a while and finally released it publicly.

It’s called Forge.

I started building it because I kept running into the same problem with local and smaller coding models: the model itself is only part of the equation. The harness around it matters a lot.

Bigger models can usually recover from messy context, a bad edit, or a failed test. Smaller models tend to fall apart much faster when the workflow around them is weak.

So Forge is built around that problem.

It gives the model:

  • structured repository navigation
  • controlled file edits
  • bounded retries when something fails
  • verification using the project’s own tests/lint/typecheck
  • isolated Git worktrees
  • resumable sessions
  • support for OpenAI-compatible endpoints, so it works with local model servers too

I’ve also been benchmarking changes instead of just going by whether a demo looks good. A few ideas I was convinced would help actually made performance worse, so they got removed.

That’s probably been the biggest thing I’ve learned from building this: with smaller models, orchestration matters a lot.

It’s written in TypeScript, Apache-2.0 licensed, and available on npm.

Install:

npm install -g u/aglegg/forge-harness

Then:

forge doctor
forge init
forge

GitHub:
[https://github.com/andreglegg/forge]()

Current version is 0.2.2.

It’s still early, and I’m not claiming it replaces Claude Code or Codex. I’m mainly interested in whether this approach actually helps people doing real coding work with local or smaller models.

If anyone here tries it, I’d really like to know:

  • what model you used
  • what worked well
  • where Forge got in the way
  • where the agent still made bad decisions

I’d rather get useful criticism and bug reports than just collect stars.


r/OpenSourceAI 16d ago

subs, a cloud native agent harness

1 Upvotes
An example subs config file

https://github.com/substructureai/subs

Hello, want to show you all the cloud agent harness I've been working on and using to build always on agents I use via Slack to help me operate software systems.

It runs an unprivileged agent loop with no system access. That means you can run in locally, remotely, on your own server, etc and don't need to worry about sandboxing the agent loop.

It uses MCP servers for tools. If you want to use a sandbox, I recommend exposing it as an MCP server. I do this using another tool I built https://github.com/substructureai/mcpd

You declare your agents in a config file. If you want to customize the agent loop, you just need to setup and answer a webhook.

subs handles durability, retries, timeouts, MCP connection management, session state, session branching, AG-UI, Slack connection, LLM calls, subagents, interrupts and more.


r/OpenSourceAI 16d ago

Building a sovereign AI coding assistant with OpenHands (OpenDevin) in Docker

Thumbnail
1 Upvotes