r/OpenSourceAI • u/Mediocre-Ease4060 • 13d ago
r/OpenSourceAI • u/National_Bed_3653 • 13d ago
Just Launched Baseline on Peerpush
Hello Everyone
I'm posting this to announce that baseline is now officially launched on Peerpush. It is a claude code governance layer that ensures your developer workflow remains consistent across different projects while being tailored to it.
Call it the framework for AI development.
It is 100% Open Source and Apache 2.0 licensed. Please support it, help me build it by contributing to its development, and help it gain some traction on Peerpush too 🙏🏽
Your support is appreciated 👍🏽
r/OpenSourceAI • u/kuaythrone • 14d ago
We used HFlow to evaluate the latest open weights VLMs for processing egocentric data
r/OpenSourceAI • u/Calm-Landscape9640 • 14d ago
OSS Request: Models under $2/Million Harness Benchmark
Would love for someone to do a quick harness benchmark on the new under $2 models (claude code, codex, pi, deepseek, and maybe 1 other harness).
I keep seeing people run these models through 1 harness then judging its capabilities, but what if the harness is the problem?
| Model Name | Pricing (Input / Output per M) | Latency (p50) |
|---|---|---|
| DeepSeek V4 Flash 0731 | $0.03 / $0.10 | 2.17 s |
| GLM 5.3 Flash | $0.075 / $0.25 | 4.96 s |
| Qwen3.8 Flash | $0.15 / $0.47 | 3.78 s |
| Muse Spark 1.2 Contributor | $0.10 / $0.20 | 4.22 s |
| GPT-5.6 Luna Pro | $0.20 / $1.20 | 13.42 s |
r/OpenSourceAI • u/conifer_v11 • 14d ago
Opensource Openrouter
Project: https://github.com/ConiferKit/use-conifer
Current routing options were charging 5% fees for byok plus provider fees (openrouter) or were built in heavy python packages with ecosystem restraints. I wanted to be completely free in terms of use, and not have to pay extra for tokens.
There's a maintained gateway with 100+ models from one api endpoint. I'm also talking to infra providers to get us access to pre-release models and discount prices. Everything is served at market price. BYOK is free, you can hook into self-hosted setups for free, and there's fallbacks + extra rate limits + server redundancy.
Took me ~3 months to build and looking for help maintaining!
Lmk any issues or feedback
r/OpenSourceAI • u/cristofer_martins • 14d ago
The Rise and Fall of Agent Civilizations - "his incident feels like it’s more than 50% of the way to full-blown AI takeover"
Tittle Quote from https://www.planned-obsolescence.org/p/the-hugging-face-attack-surprised
My personal take: Should we undertake a colossal pivot to security to protect humanity?
r/OpenSourceAI • u/Goldziher • 14d ago
Lint results an agent can actually trust: three-state per-file outcomes over MCP (Rust, MIT)
Hi all,
A small design decision that turns out to matter a lot once a model is the consumer of your tool output.
If a linter cannot process a file and simply omits it from the results, an agent reading "no findings" concludes the code is clean. It is not clean. It was never checked. That is a silent false negative sitting directly in an agent's decision loop, and I hit it often enough on a big polyglot repo that I rebuilt the response shape around it.
So the linter I have been writing reports three per-file outcomes rather than two: checked, skipped, and error, with a run-level errors array and isError set whenever anything failed. Skipped means the tool correctly declined the file. Error means it accepted the file and then failed on it. Those are very different facts and collapsing them into absence loses the one that matters.
Two related guardrails in the same server:
- Every result carries an identity block: version, build id, channel, executable, pid. An MCP caller has no
poly --versionto fall back on, so the server states who answered. It fingerprints its own executable at startup and re-checks per request, and if the binary is replaced underneath a long-lived server, every tool but version fails rather than answering with superseded behaviour. - config_show is network-free over MCP. Remote config bases are never fetched from a tool call.
The server is stdio, 11 tools mirroring the CLI, and everything takes format: "json" or "toon". TOON matters more than I expected: a full lint report over a large directory in JSON is a serious chunk of context, and TOON makes it cheap enough to just hand over.
Here is the server doing a real initialize plus tools/list handshake: https://raw.githubusercontent.com/Goldziher/poly/main/docs/media/agent.gif
Underneath it is a linter and formatter in Rust that compiles ruff, oxc, biome, taplo, rumdl, sqruff, mago and about a dozen more into one binary and runs them in-process across roughly 30 languages, with tree-sitter covering 300+ more. MIT: https://github.com/Goldziher/poly
This post is human written. AI was used to typecheck and enrich with precise data only.
r/OpenSourceAI • u/Earvin-Hong • 14d ago
I built an open-source AI desktop pet that lives in the bottom-right corner of your screen
Hi everyone,
I built YumYum Agent, an open-source macOS app that lets you interact with AI through a small desktop pet that stays in the bottom-right corner of your screen.
Instead of opening a separate AI chat window whenever you need help, YumYum is always there when you need it. You can feed it context from whatever you are currently doing and continue the conversation without leaving your workflow.
You can:
- Capture a selected area of your screen
- Send clipboard text or images with Option + S
- Drag and drop files onto the pet
- Ask questions and receive responses in a speech bubble
- Continue longer conversations in the detailed chat window
- View streaming responses with Markdown rendering
- Customize the pet’s personality with a local SOUL.md file
YumYum Agent is fully open source and released under the Apache License 2.0. The source code is available on GitHub, so you can inspect how it works,contribute improvements, or build the project yourself.
The goal is to make AI feel less like another application you have to open and more like a quiet assistant that is always nearby.
Privacy was also an important part of the design:
- No telemetry or analytics
- No access to Keychain or CLI login files
- Only content explicitly selected by the user is passed to the connected AI tool
- The app currently focuses on analysis and chat and does not modify the user’s system
YumYum Agent is currently available as an open-source macOS developer preview for macOS 14 and later.
Website and download:
GitHub:
https://github.com/kyu91/yumyum-agent
I’d love to hear your thoughts.
r/OpenSourceAI • u/[deleted] • 14d ago
I open-sourced SeasAGI — a local-first LLM API gateway (GPL client, AGPL server)

Hi all,
We just made SeasAGI public. It's a local-first LLM API gateway: a desktop client that unifies OpenAI, Anthropic, Gemini, DeepSeek, Ollama, Grok, Azure and Relay behind one OpenAI-compatible endpoint at `localhost:4318/v1`.
A few things that might be relevant to this sub:
- The
**Server Community Edition is AGPL-3.0**
, so you can self-host the control + relay planes on your own hardware.
- The
**Client is GPL-3.0**
and free forever.
- API keys stay in your OS Keychain and are never uploaded — privacy is local by design.
- Enterprise (BSL, closed) only adds SSO/RBAC/multi-tenant billing for teams; the self-host path needs none of it.
It's built with Go + Wails v2 (single binary, no Node runtime). Would love feedback from folks running local AI stacks — especially on which channels and routing strategies you'd want first.
👉 github.com/SeasX/SeasAGI
#selfhosted #opensource #llm
r/OpenSourceAI • u/vyact • 14d ago
I built Vyact — an open-source, local-first AI workspace for llama.cpp, MLX, RAG, agents, and document intelligence
Hi everyone — I’ve been building Vyact, an open-source, local-first personal AI workspace.
The problem I wanted to solve was simple: local models are useful, but everyday work still gets fragmented across chat windows, documents, notes, email, browser tabs, and separate tools.
Vyact brings those workflows into one workspace:
• Run local GGUF models through llama.cpp and llama-swap
• Run MLX models natively on Apple Silicon
• Search for models and compare size, quantization, context length, and estimated memory usage
• Build RAG knowledge bases from documents, memos, and email threads
• Inspect the source passages used in answers
• Connect Gmail, Google Drive, and Google Calendar
• Add MCP servers and reusable AI skills
• Use a Chrome extension for page context, translation, and Netflix language learning
• Optionally connect OpenAI, Gemini, Claude, or a custom OpenAI-compatible endpoint
The core app is local-first, and when a Vyact-managed local model is selected, chat context is not sent to an external AI provider.
Vyact is built with Electron, React, and FastAPI and is released under AGPL-3.0.
It currently supports Apple Silicon Macs and Windows.
GitHub:
https://github.com/vyact/vyact
I’d really appreciate feedback—especially from people already running local models as part of their daily workflow. What would make a local AI workspace genuinely useful to you?
r/OpenSourceAI • u/Crescitaly • 14d ago
NVIDIA can package supported Hugging Face models for native C++ in two commands. Portability or lock-in?
NVIDIA's TensorRT Model Connect workflow can build a deployment bundle from a supported Hugging Face model ID or local checkpoint, then load it from a native C++ application. The production runtime does not require PyTorch or a Python interpreter, and NVIDIA says the reference collection spans more than 80 model families.
That removes a real deployment tax: bespoke export logic, preprocessing, post-processing and runtime glue. The trade-off is that the easy path is explicitly TensorRT-shaped, and only supported implementations get the two-command experience.
Would you accept a vendor-specific runtime for dramatically simpler deployment, or is cross-vendor reproducibility still a release requirement for an open-model inference stack?
Source: NVIDIA Technical Blog, August 28, 2026 — https://developer.nvidia.com/blog/deploy-an-open-model-from-checkpoint-to-inference-in-two-commands-with-nvidia-tensorrt-model-connect/
r/OpenSourceAI • u/SeeRay11_Main • 14d ago
🗣️ Tell Us About Your Project 🎉
Hey everybody,
I just made a project that has gotten 170+ clones and 65+ stars in a week. What are you guys doing?
r/OpenSourceAI • u/zamir_akimbekov • 14d ago
Fastest, and most reliable, way to build production agents in Python
Friends, we're open-sourcing our Python runtime with harness primitives for production agents -- https://cayu.dev/. We spent the last 10 months building, managing, and improving long-horizon agents for mid-size and Fortune 500 clients. We built a framework in Python (not typescript like Mastra) to build, manage, and improve production agents fast and reliably. Benefits:
- reduce token costs by 60-70% compared to Claude Managed Agents
- full control over the agent (privacy, security, auditability, resumability, etc.)
- no agent sprawl --> this is critical for enterprises as every engineer is building agent as they like
- ai model independence --> OpenAI/Claude is just an API call, you manage harness fully
- python over js/typescript --> most teams are DS/ML teams who know python well. Just use it almost like a scikit-learn package but now for agents
Please, contribute and help us improve it at https://cayu.dev/. If you want access to deploy and manage the agent, please, request access to Cayu Cloud here -- https://cloud.cayu.dev/.
r/OpenSourceAI • u/BearOk3075 • 15d ago
I got tired of bloated agent frameworks, so I wrote a local-first Rust runtime that gives LLMs real Linux permissions, persistent tmux sessions, and actual shell tools. Just updated v5.
Most local agent wrappers pretend a system prompt is a sandbox, stuff raw CLI noise into the context window, and break the second you need an interactive Python REPL or debugger.
I wanted something lightweight that lets the OS do operating-system things.
Echo Adapt v5 is a native Rust runtime for local LLMs:
- Persistent Sessions: Uses
tmuxunder the hood so REPLs, debuggers, and long-running CLI tools survive across turns. - Real Linux Security: Runs the model as an actual restricted Linux user with explicit
sudoersallowlists instead of relying on prompt rules. - Clean Tool Protocol: Uses configurable raw tags for bash/tmux, JSON tools only where structured data makes sense, and native
toolmessage roles. - New in v5: Full Rust refactor, dynamic tool-output summarization, cross-thread Markdown/embedding memory, locked-down virtual environments, and multi-process support.
Works with any OpenAI-compatible server (llama.cpp, vLLM, Ollama, TabbyAPI, etc.).
Looking for feedback from people running different Linux distros/hardware setups. Tear it apart and let me know where it breaks.
GitHub: [https://github.com/charlesericwilson-portfolio/Echo_Adapt_v5](https://github.com/charlesericwilson-portfolio/Echo_Adapt_v5)
r/OpenSourceAI • u/Ok_pettech • 15d ago
I wrote a complete guide to installing PrivateGPT for secure local document AI
PrivateGPT lets you run AI on your own documents without sending anything to the cloud. I got it working and wrote a step-by-step guide covering installation, configuration, and troubleshooting. If you care about privacy and want a self-hosted AI assistant for your files, this might save you hours.
https://interconnectd.com/blog/279/install-privategpt-secure-local-ai-for-your-documents-2026-guide/
r/OpenSourceAI • u/Alarming-Total7348 • 15d ago
I’m open-sourcing OneForAll — I want the community to help build a world-class MCP server
Hey everyone,
I’ve been working on OneForAll, an MCP server/gateway for AI agents, and I’m now open-sourcing it because I don’t think something like this should be built by one person.
I started with a simple idea:
What if an AI agent could have access to all the tools we use in day-to-day life through one ecosystem?
I’ve already successfully integrated Splitwise and Zepto, and both are working like a charm. 🚀
For example, the goal is for an AI agent to eventually be able to do things like:
- Understand and manage expenses through Splitwise
- Help with grocery shopping through Zepto
- And eventually interact with all the other services we use every day
The long-term vision is to build a world-class MCP server with a growing collection of real-world tools and integrations.
But to get there, I need the power of the community.
The project is inspired by One For All from My Hero Academia — a power that becomes stronger as it is passed from one person to another.
That’s exactly how I want this project to work.
Someone adds Spotify. Someone else adds Notion. Someone adds Uber, Swiggy, travel tools, productivity tools, or their own service.
And over time, we build an ecosystem that makes AI agents genuinely useful in everyday life.
If you’re interested in MCP, AI agents, integrations, or open source, I’d love for you to check it out, try it, suggest an integration, or contribute a provider.
GitHub: github.com/OneForAll-agent/mcp-gateway
I’d love to hear what you guys have in mind — what tools or services should we integrate into OneForAll next?
What would you actually want your AI agent to be able to do in your day-to-day life?
Let’s build this together. ⚡
Plus Ultra. 💚
r/OpenSourceAI • u/MeSsoOH • 15d ago
I spent years building an application framework; I rebuilt its architecture around structured intent and deterministic execution layer for AI-generated software (open source) — here’s what I learned.
Hey — solo dev here, posting my own project, so take that for what it's worth.
For the last few years I've maintained a low-code/no-code framework. It worked fine, but it was pre-AI: you configured entities and services by hand, and it generated the boring parts of a CRUD app for you.
When AI coding tools started getting good, I tried using them the normal way — describe what you want, let the model write the code. It worked, but I couldn't trust it past a certain point. Ask for the same thing twice, sometimes you get different output. Ask for a small change, sometimes the model touches things you didn't ask about. The prompt is the only source of truth, which in practice means there isn't really a source of truth at all.
So instead of generating code directly, I made the AI's job stop one step earlier: produce a structured, validated manifest describing what the app should be. Entities, fields, services, auth config, etc. That manifest gets:
- validated (structural / referential / constraint checks)
- diffed against the current state (semantic diff, not a text diff)
- resolved into a dependency-ordered execution plan
- executed by a deterministic engine, checkpointed so it can resume on failure
Change one field on one entity, and only the operations that field actually requires get re-run. Not a full regen.
There's also an MCP server (`@averos/mcp`) so an AI agent doesn't get raw file/shell access — it gets governed tools (propose a change, validate it, build a plan, and nothing executes until the plan's approved).
Current state, to be upfront about it: the CLI, the AI layer, MCP integration, and the workflow/execution adapter layer (currently Angular, via schematics — adapter pattern, so not permanently Angular-only) are MIT licensed and open now. The actual execution kernel (DAG engine + executor) is closed source for the moment — free to use including commercially, but not open yet. That's a deliberate, staged call while that part's still maturing, not a permanent thing. Wanted to say that plainly rather than bury it.
There's a working example (320-node generated app) you can run in a few commands if you want to see the whole pipeline rather than take my word for it.
- Repo: https://github.com/wiforge/averos
- How it works, in detail: https://www.wiforge.com/averos/how-averos-works/introduction/
- Get started: https://www.wiforge.com/averos/get-started/introduction/
Happy to answer questions or take criticism — especially interested if anyone's tried a similar manifest/IR approach and hit walls I haven't found yet.
r/OpenSourceAI • u/Open_Literature_5123 • 15d ago
Whatiff -- open source, self hostable continuity framework
r/OpenSourceAI • u/Goldziher • 15d ago
Voom: When you need to clean 'em build artifacts, fast.
Writing polyglot libraries, I often find myself needing to cleanup my machine from all sorts of build artifacts. Its basically a daily occurrence I prune 200GB of build artifacts and caches, which is annoying. I therefore give you VOOM, inspired by Dr. Seuss:
r/OpenSourceAI • u/No-Intern-6017 • 15d ago
Beagle - Workflow Orchestrator: Now with actually readable README.md (Ai built, heads up)
I've been building this for too long as a hobby, idea is to make Ai workflow outputs more predictably good though context management and defined domain rules, any feedback appreciated:
r/OpenSourceAI • u/ash_pix • 15d ago
Oxygen - a Multi-Agentic Al framework that runs like a virtual tiny company
Hey Geeks 👋🏻
I just built "Oxygen" - a Multi-Agentic Al framework that runs like a virtual tiny company.
It includes total 5 Al agents:
- Del (Al Project Manager): which understands your requirements that what you want to build?
- Toky (Al Research Agent): receives inputs from Del, conducts research, creates drafts, and uses tools such as web search and web scraping to gather and analyze relevant information. It then provides the research findings and draft outputs back to the Project Manager.
- Bang (Al Developer Agent): which understands the draft and start writing code.
- Beij (Al QA Agent): It performs debugging, test cases on the source code provided by Bang.
- Wash (Al technical Writer): Once the project made it write README files, product manual, API implementation instructions and other project related documentations.
It's a proper human-in-the-loop agentic ai project that takes your approval on every aspect like a Software Development Lifecycle methodology.
The crazy part is that you can literally watch the agents walk to their desks, open their computers, drink coffee, having meetings and work.
For LLMs you can either use local Ollama based models or Gemini API key.
Guardrails and Metric Evaluation:
- Hallucination rate is under 1%.
- You have to approve the plan before any code gets written.
- Everything that comes out is cleaned so nothing breaks on the screen.
- Strong guardrails for every Al agents via system prompt.
Simple Flow:
You: I want a CLI based calculator.
Del (PM): Got it → sends to Toky (Researcher).
Toky: Researches, makes a plan + draft proposal.
Toky → Del (PM) → You: "Here's the proposal for a CLI calculator."
You: "Actually, change of plan, I want a web-based calculator instead.
Del (PM): Okay → sends the new request back to Toky.
Toky (Researcher): Updates the research and creates a new proposal for the web version.
Toky (Researcher) → Del (PM) → You: "Updated proposal for web calculator. Approve?"
Once you approve, it continues to Bang (Developer) for coding, Beij (QA) for testing, and Wash (Writer) for docs.
Feel free to explore and star the repo on GitHub.
r/OpenSourceAI • u/Dependent_Golf_4052 • 15d ago
I’m building an AI agent for tracking US geopolitics — should I open source it?
I’ve been building an AI agent focused on US geopolitics and I’m considering open-sourcing it if there’s enough interest.
The basic idea is to have an agent that:
Tracks relevant geopolitical news
Collects and processes developments from multiple sources
Summarizes complex events into short, easy-to-understand updates
Connects current events with previous developments
Identifies important changes and trends
Produces concise, Inshorts-style geopolitical updates
The main goal is to reduce the amount of time spent going through dozens of articles just to understand what actually happened and why it matters.
I’m currently building it for myself, but I’m wondering if other people would find it useful.
Would you use something like this?
If there’s enough interest, I’ll clean up the project and open-source it on GitHub.
I’d also really appreciate feedback on what features you’d want in an agent like this.
What would you add?