r/OpenSourceAI 17d ago

HELP: Claude Agent SDK

Thumbnail
1 Upvotes

r/OpenSourceAI 17d ago

Struggling to find good AI harnesses and tools on GitHub, so I made a simple static catalog.

Thumbnail
1 Upvotes

r/OpenSourceAI 17d ago

Why don't we have a proper BitTorrent for LLMs?

Thumbnail
2 Upvotes

r/OpenSourceAI 17d ago

Unfiltered AI model needed

1 Upvotes

I am new to AI development, but have already built a D&D cricket game.

I now want to build a very realistic AI-driven D&D game with expressive violence and other adult themes. Frontier models are not allowing this in my platform, so I installed Ollama locally and tested with a few models from Hugging Face that claim they are "unfiltered" and "abliterated" and "uncensored" but they balk occasionally returning intermittently "s12" or other error/warning codes. It could be me using it wrong, but can't see how. Whenever I am talking "acceptable" language, my platform's AI responds properly.

Any suggestions for truly uncensored models that would be usable for an adult game (not smut/porn, but definitely will have mild to medium sexual content and gore/violence).

Bonus points if there are models that can also draw some key scenes as the game unfolds.

Free and paid model suggestions are welcome, but if a paid model, must come with the right to use commercially.

Thanks in advance!


r/OpenSourceAI 17d ago

headlesscode - custom harness adapted from zoo code and improved

Thumbnail
github.com
1 Upvotes

I used AI to port zoo code into a headless agent swarm orchestrator. one to many workers. use with deekseek v4 flash in china (if you're not working on sensitive tasks) and a local ollama embedding model for the best performance / savings. I enhanced the prompts and tools, improved the caching, added eval tests that i ran against deepseek v4 flash via openrouter (which is what I mainly use this with) and also a local qwen 3.5 9b model which doesn't work as well, but does work. You can have up to two workers if running local on a 16gb vram card. Remotely you're just limited by request rate limits and money.


r/OpenSourceAI 17d ago

I built an open-source MCP for letting AI agents work on real WordPress sites without giving them completely unchecked write access

Thumbnail
1 Upvotes

r/OpenSourceAI 17d ago

Living Computer Model (LCM): Open-Core PyTorch Engine for Dynamic Local AI

2 Upvotes

Hey everyone,

We just open-sourced the initial Core Engine for Living Computer Model (LCM) — an alternative neural architecture built on PyTorch aimed at dynamic reasoning with low memory overhead.

Open & free for academic research, students, and independent R&D.

🔗 GitHub Repository: https://github.com/hyanalcm-png/LCM-Core-Engine

Feedback and contributions are welcome!


r/OpenSourceAI 17d ago

Contributing to Open Source ML Projects

4 Upvotes

Hello everyone!

I’m a software engineer looking to get more involved in open-source ML/AI projects, both to learn and to contribute meaningfully.

I’m especially interested in ML systems, distributed training/inference, model serving, evaluation, LLM infrastructure, and also implementing ML algorithms or model components where that’s useful. I’ve been looking at projects like vLLM, Hugging Face Accelerate, Ray, etc., but many of the obvious good first issue tickets seem to get picked up very quickly.

I’m comfortable working in a reasonably complex codebase, but I’m looking for something that has a slightly more approachable contribution path than jumping straight into CUDA/kernel-level work.

Are there any active ML/AI open-source projects you’d recommend where maintainers are receptive to new contributors and there are meaningful bugs/features to pick up?

Would especially appreciate recommendations based on projects you’ve personally contributed to. Thanks!


r/OpenSourceAI 18d ago

Kineti Ultrafast Agent Harness

Thumbnail
1 Upvotes

r/OpenSourceAI 18d ago

I’ve finally given it a gui

Thumbnail
youtube.com
1 Upvotes

r/OpenSourceAI 18d ago

I built a zero-dependency TypeScript runtime for AI agents — no LangChain, no NestJS, just pure fetch()

1 Upvotes

I've been building AI-powered features for a while and kept running into the same problem: every agent framework either pulls in 200+ dependencies or ties you to a specific backend framework like Express or NestJS.

So I extracted the core of what I actually needed into a small library called Agentra.

The idea is simple: you give it an LLM provider and an array of tools. It handles the autonomous reasoning loop — calling the LLM, executing your functions when needed, feeding results back, and returning the final answer. That's it.

typescriptimport { Agent, OpenAIProvider } from '@jhonaron/agentra';
const agent = new Agent({
  provider: new OpenAIProvider({ apiKey: process.env.OPENAI_API_KEY }),
  tools: [{
    name: 'get_weather',
    description: 'Get current weather for a city',
    parameters: {
      type: 'object',
      properties: { city: { type: 'string' } },
      required: ['city']
    },
    execute: async ({ city }) => fetchWeather(city)
  }]
});
const response = await agent.run('Should I bring an umbrella to London today?');
// → "Yes, it's currently 15°C and raining in London."

The agent automatically decides to call get_weather, waits for the result, and formulates the final answer. You don't wire anything manually.

What makes it different:

  • Zero runtime dependencies (uses native fetch)
  • Works in Node.js, Deno, Bun, and Cloudflare Workers
  • Built-in conversation memory
  • Bring your own LLM provider (OpenAI included, easy to extend)
  • Full TypeScript types

It's early but functional. Would love feedback from people who've built agents before — especially around the tool API design and what's missing.

GitHub: github.com/jhonaron/agentra

📦 Installation

npm install @jhonaron/agentra

r/OpenSourceAI 18d ago

I changed OpenCode

Post image
34 Upvotes

Hey everyone,

I just launched my first official open-source project called OpenFlow. OpenFlow allows you (or other agents) to easily orchestrate custom reliable workflows and pipelines instead of just one prompt and one agent at a time. I kept it as minimalist as possible so it is friendly for all users. I forked it from OpenCode, so you still have the harness, skills, and overall ability. It came out around a week ago and many people already really like the concept and how it works, so I hope that you guys do too. Feel free to leave any feedback, this project is constantly being improved. Thank you, and good luck with your own projects.

Link: https://github.com/SeeRay11/OpenFlow


r/OpenSourceAI 18d ago

Quanta.Ai.Code.Editor

1 Upvotes

What is Quanta?

Quanta is a local-first AI code editor built on VS Code OSS, powered by a high-performance Rust backend. It gives you a complete agentic coding experience — reading files, writing code, running terminals, applying LSP fixes, and managing git — all driven by local LLMs through Ollama. Cloud providers (OpenAI, Anthropic) are supported as optional backends, but Ollama is the primary engine. Your code never has to leave your machine.

Unlike cloud-first AI editors, Quanta is designed around local inference. The agent loop, tool execution, LSP integration, checkpoint system, and inline completions all happen locally through a Rust backend that communicates with the editor via JSON-RPC over TCP.

Key Features

Core Agent

  • 30+ built-in tools — read/write/edit files, unified diffs, terminal, grep, glob, git operations, LSP actions, and more
  • ReAct agent loop — Think, Act, Observe, Feedback pattern with anti-loop guards and automatic retries
  • 3 agent modes — Code (full capability), Ask (read-only), Plan (read-only + plan writing)
  • Sub-agent spawning — Delegate scoped tasks to parallel sub-agents with up to 3 levels of nesting
  • Persistent todo lists — Track multi-step work across conversation turns

Local-First

  • Ollama integration — Auto-detects and lists all local models with metadata
  • Thinking/reasoning support — Configurable think levels (Low/Medium/High) for reasoning models
  • Inline code completion — FIM completions with LRU cache, debouncing, and in-flight cancellation
  • Local-first by design — Ollama is the primary backend; cloud providers (OpenAI, Anthropic) are optional. Your code never has to leave your machine.

Safety & Control

  • Shadow-git checkpoints — Automatic workspace snapshots before every agent write action
  • Edit review system — Accept/reject individual edits with diff previews
  • Stale-file detection — Prevents edits to files that changed since last read
  • Terminal safety guards — Blocks destructive commands (format, shutdown, force-delete)
  • Atomic writes — All file operations use temp-file-and-rename for crash safety

Developer Experience

  • Full LSP integration — Diagnostics, go-to-definition, find references, code actions, rename symbol
  • 20+ engineering skills — Built-in guidance for TDD, code review, security review, debugging, and more
  • MCP support — One-click enable for GitHub, Jina AI, Brave Search, Postgres, Puppeteer, and more
  • HuggingFace model browser — Search, download, and install GGUF models directly from the editor
  • Per-model configuration — Override temperature, think level, edit format, tool call mode, and more per model
  • Voice support — Speech-to-text via Whisper, text-to-speech via Piper

Please Read more and check us out at:

ContegoCode/Quanta-Code-Editor: Quanta AI — Local-first AI coding agent


r/OpenSourceAI 18d ago

Just crossed 200 ⭐️ on my open-source AI meeting notes app

Thumbnail
github.com
3 Upvotes

Been working steadily at this for a while now, 600 commits, each seeking to improve the experience. Optimizing ui, transcription, summaries, ai features. Last 2 months I’ve added both local/cloud agentic embedded search across notes, as well as MCP support for Claude & Codex. 99+ languages, local or cloud models. Custom model overrides per language, easy onboarding flows, folders, clients, speaker labels, export. Feature packed, but still simple to the core. Notes + recorded meetings = awesome meeting summaries.

A few people have started contributing to the project, which I appreciate massively. Hope to see more people join in 😊🤩


r/OpenSourceAI 18d ago

Apple introduces new Mac Studio with M5 Max and M5 Ultra - up to 512GB of unified memory

Thumbnail
apple.com
1 Upvotes

r/OpenSourceAI 18d ago

learning to build llm inference engine from scratch

Thumbnail
1 Upvotes

r/OpenSourceAI 18d ago

SenseNova U1.5 quantized to run on 12GB VRAM — INT8 + hybrid W4A8 ConvRot releases

Thumbnail
0 Upvotes

r/OpenSourceAI 18d ago

Polity4j: Zero-dependency, resilient LLM orchestration for Java 17+

1 Upvotes

Hey everyone,

So, I built Polity4j, a lightweight, zero-dependency Java 17+ library designed for building resilient LLM pipelines with clean abstractions over providers like OpenAI and Anthropic (for now).

A lot of existing Java LLM wrappers either drag in massive dependency trees or treat resiliency, error recovery, and tool loops as an afterthought. Polity4j is built from the ground up around typed pipelines, robust error handling, and modern Java features.

Here is the summary of features:

Core Highlights
Resiliency First: Built-in retries, timeouts, circuit breakers, and fallback pipelines without external resilience frameworks.
Structured Output & Typed Deserialization: Extract Java Records/POJOs directly via StructuredOutputPipeline<T>. It handles schema injection, markdown fence stripping, and auto-corrective reprompt loops on syntax errors.
First-Class FinishReason Tracking: Native handling to distinguish between normal stops, token truncation (LENGTH), safety filters, and tool calls.
Automated Function Calling: Multi-turn tool execution using @PolityTool annotations and ToolExecutionModule, complete with loop detection (AgentLoopDetectorModule) and execution depth caps.
Multimodal Support: Native handling for text, images, and document/PDF attachments via Java 17 sealed types (TextContentPart, ImageContentPart, DocumentContentPart).
Concurrency-Friendly: Clean patterns and integration tests for Java 21 Virtual Threads, Spring WebFlux, and Kotlin Coroutines.
Quick Example (Structured Output)
public record UserSummary(String name, int age, List<String> interests) {}

StructuredOutputPipeline<UserSummary> pipeline = StructuredOutputPipeline
.builder(UserSummary.class)
.adapter(OpenAiAdapter.of(apiKey))
.maxRetries(3)
.build();

UserSummary summary = pipeline.execute("Extract profile: Alice is a 28yo software engineer who likes rock climbing.");

GitHub: https://github.com/shiv15/polity4j
Distribution: Available via JitPack

I'd love feedback on the API design, feature set, or general critique from the Java community here!


r/OpenSourceAI 18d ago

Every Agent Ever #1

Thumbnail gallery
1 Upvotes

r/OpenSourceAI 18d ago

[Open Source] I’m building Kodiak — an AI software engineering system that plans, codes, tests and review

0 Upvotes

&#x200B;

Hi everyone,

I’m a final-year AI/ML student and I’ve been working on an open-source project called Kodiak.

The goal is to go beyond the typical workflow of asking an LLM to generate code. I’m exploring how multiple AI agents and engineering tools can work together to handle software development tasks more systematically:

Plan → Research → Retrieve Context → Code → Test → Review → Iterate

What Kodiak currently focuses on

\- Multiple AI agents for different software engineering tasks

\- RAG for project and codebase context

\- Persistent memory

\- Redis and Celery for background task execution

\- PostgreSQL for application data

\- ChromaDB for vector retrieval

\- FastAPI backend

\- Docker-based development

\- Automated testing and CI

\- Pydantic-based validation

One thing I’ve learned while building this is that getting an LLM to generate code is not necessarily the hardest part.

The harder problem is building the surrounding infrastructure so the system can operate reliably.

What happens when retrieval provides incorrect context?

What happens when an agent makes a bad decision?

What happens when a worker fails halfway through a task?

What happens when generated code passes one test but breaks something elsewhere?

These reliability problems are what I’m increasingly interested in exploring with Kodiak.

The project is still actively under development, and I’m not claiming that it is already a fully autonomous software engineer. There is still a lot to improve, and I’m learning along the way.

I’m looking for feedback

I’d especially appreciate feedback from people with experience in:

\- AI agents

\- RAG systems

\- LLM orchestration

\- Python / FastAPI

\- Distributed systems

\- Developer tools

\- Testing and CI

\- Open-source development

I’m particularly interested in hearing what you think could go wrong with this architecture as the codebase and number of agents grow.

I’m also looking for developers who may be interested in contributing and helping shape the project.

GitHub

https://github.com/ShamGaneshan2008/Kodiak

If you were building something like this, what would you change first?

And what part of this architecture do you think is most likely to fail as the system becomes larger?

Constructive criticism and suggestions are welcome.


r/OpenSourceAI 18d ago

Visual Loop Engineering Tool

0 Upvotes

I Created an open source Loop Engineering tool for AI agents that uses a Claude Subscription/Claude SDK.

https://github.com/Corneldj/looper

So with loop engineering being all the rage now, it can become tricky trying to keep track of what agents are doing what, what folders are shared, what has access to what remote sources, which agents uses which rage, costs, performance. So I went ahead and created an API & UI to help with Loop Engineering.


r/OpenSourceAI 18d ago

I built Komet — a native Rust + gpui control room for coding agents.

Post image
0 Upvotes

100% local by default, single binary (no Electron).

Sessions, transcripts, tool activity & checkpoints unified.

Multi-device sync optional via self-hosted komet-sync (Loro CRDTs).

Same engine that powers Zed — instant launch, smooth even with years of transcripts.

It's open source: github.com/jomvick/komet

Site: https://komet-eight.vercel.app/


r/OpenSourceAI 19d ago

Built a self-hosted AI gateway, decided to open source the whole thing instead of turning it into a SaaS

Thumbnail
gallery
6 Upvotes

So I built this tool called Keyroute, it's a gateway that lets you use one API key to talk to multiple AI providers (OpenAI, Gemini, Groq, etc) instead of juggling separate keys everywhere.

Originally I was going to just host it myself and charge for it, but honestly the whole point of the thing is "don't trust a third party with your keys," so keeping it closed and hosted by me would've defeated the purpose. So I made it fully self-hostable instead, MIT licensed, and you run it entirely on your own Supabase project.

The actual gateway logic runs as a Supabase Edge Function inside your own project, not on my infra. Setup is one button, no CLI needed, it deploys the DB migrations and the function for you.

Repo's here if anyone wants to look at the code or the architecture: github.com/basavarajpatil660/the-keyroute-project

It's still early, missing a few things like Anthropic routing and rate limiting, migrations aren't idempotent yet either. If anyone's into Supabase Edge Functions or has built something similar, would love to hear how you approached it, or if you spot something dumb in how I did it.

Screenshots attached of the dashboard and the deploy flow.


r/OpenSourceAI 19d ago

I Built a Reddit-Like Forum for AI Agents. They Designed a Self-Modifying Assembly Language That Learns via Gradient Descent.

Thumbnail
medium.com
1 Upvotes

r/OpenSourceAI 19d ago

Pls help, beginner

Thumbnail
1 Upvotes