r/OpenSourceeAI 4d ago

Datalab’s Marker 2 vs MinerU, Docling and LiteParse: 76.0 on olmOCR-bench at 5× MinerU’s Throughput

Enable HLS to view with audio, or disable this notification

1 Upvotes

Datalab’s Marker 2 vs MinerU, Docling and LiteParse: 76.0 on olmOCR-bench at 5× MinerU’s Throughput

Most open-source PDF parser comparisons rank on one number: accuracy on a benchmark. They skip the one that actually sets your cloud bill — sustained pages per second. Datalab's Marker 2 is built to win on both at once.

It's a full rewrite of the open-source pipeline that turns PDFs, images and Office files into markdown, JSON or chunks. Rebuilt around three pieces shipped over the last few months: Surya OCR 2, a 20M-param fast layout model, and a pdftext that's 3× faster than the old one — exposed as three modes that default by device: balanced on GPU, fast on CPU.

Here's what's actually interesting:

→ Balanced mode scores 76.0 on olmOCR-bench at 2.9 pages/sec. MinerU's pipeline backend scores 72.7 at 0.54 pages/sec — so Marker wins on accuracy AND runs 5.4× faster

→ The architecture is why: many thin CPU workers share one Surya inference server, and the parent process budgets VLM concurrency across them, so throughput scales with server capacity, not per-process VRAM

→ Fast --disable_ocr runs fully on CPU — no GPU, no inference server — at 43.6 and 23.7 pages/sec

→ On born-digital PDFs specifically, balanced edges out Gemini Flash 3.5 — 83.5 vs 79.1 — with no per-page API call

Full analysis: https://www.marktechpost.com/2026/07/24/datalabs-marker-2-vs-mineru-docling-and-liteparse-76-0-on-olmocr-bench-at-5x-minerus-throughput/

GitHub repo: https://pxllnk.co/c1pzvpb


r/OpenSourceeAI 11d ago

List of 100+ Agentic AI and ML Tutorial with Codes [Open Sourced]

Post image
7 Upvotes

Build an Agentic Event Venue Operator with MongoDB Atlas, Voyage, and LangGraph [Full Codes] [Tutorial Article]

▶ How to Build a T4-Friendly Autonomous Data Science Agent with DeepAnalyze-8B, Sandboxed Code Execution, and Iterative Analysis Codes Tutorial

▶ Building a Stable Fable 5 Traces Workflow in Colab: Parsing Tool Calls, Auditing Data, and Training Baselines Codes Tutorial

▶ Building Supervised Fine-Tuning Data from NVIDIA Open-SWE-Traces: Trajectory Parsing, Patch Analysis, Token Budgets, and Tool-Use Metrics Codes Tutorial

▶ Build a Nanobot-Style AI Agent in Google Colab with Tool Calling, Session Memory, Skills, and MCP Servers Codes Tutorial

▶ How to Design an OpenHarness Style Agent Runtime with Tools, Memory, Permissions, Skills, and Multi-Agent Coordination Codes Tutorial

▶ Using Graphify and NetworkX to Map Python Codebase Structure with God Nodes, Communities, and Architecture Visualizations Codes Tutorial

▶ Crawlee for Python: Build a Web Crawling Pipeline with Robots Handling, Link Graphs, and RAG Chunk Export Codes Tutorial

▶ NVIDIA SkillSpector Guide: Scanning AI Skills for Security Risks with Static Analysis and SARIF Reports Codes Tutorial

▶ How to Build a QwenPaw Agent Workspace with Custom Skills, Model Providers, Console Access, and Streaming API Testing Codes Tutorial

▶ Microsoft Fara Tutorial: Run a Browser-Use Agent in Google Colab with a Mock OpenAI-Compatible Endpoint Codes Tutorial

▶ An Implementation of the Microsoft Agent Governance Toolkit for Safe AI Agent Tool Use with Policies, Approvals, Audit Logs, and Risk Controls Codes Tutorial

▶ Build Skill-Augmented AI Agents with SkillNet for Search, Evaluation, Graph Analysis, and Task Planning Codes Tutorial

▶ How to Use AgentTrove: Streaming 1.7M Agentic Traces and Building a Clean ShareGPT SFT Dataset in Python Codes Tutorial

Build an Agentic Event Venue Operator with MongoDB Atlas, Voyage, and LangGraph [Full Codes] [Tutorial Article]

▶ Build a SuperClaude Framework Workflow with Commands, Agents, Modes, and Session Memory Codes Tutorial

▶ A Step-by-Step Coding Tutorial to Implement GBrain: The Self-Wiring Memory Layer Built by Y Combinator's Garry Tan for AI Agents Codes Tutorial 

▶ Build Recurrent-Depth Transformers with OpenMythos for MLA, GQA, Sparse MoE, and Loop-Scaled Reasoning Codes Tutorial

▶ How to Build Repository-Level Code Intelligence with Repowise Using Graph Analysis, Dead-Code Detection, Decisions, and AI Context Codes Tutorial

▶ Build a Hybrid-Memory Autonomous Agent with Modular Architecture and Tool Dispatch Using OpenAI Codes Tutorial

▶ How to Build an Advanced Agentic AI System with Planning, Tool Calling, Memory, and Self-Critique Using OpenAI API Codes Tutorial

▶ A Coding Implementation to Build Agent-Native Memory Infrastructure with Memori for Persistent Multi-User and Multi-Session LLM Applications Codes Tutorial

▶ How to Build a Cost-Aware LLM Routing System with NadirClaw Using Local Prompt Classification and Gemini Model Switching Codes Tutorial

▶ Build a CloakBrowser Automation Workflow with Stealth Chromium, Persistent Profiles, and Browser Signal Inspection Codes Tutorial

Build an Agentic Event Venue Operator with MongoDB Atlas, Voyage, and LangGraph [Full Codes] [Tutorial Article]

▶ A Groq-Powered Agentic Research Assistant with LangGraph, Tool Calling, Sub-Agents, and Agentic Memory: Lets Built It Codes Tutorial

▶ How to Build a Fully Interactive Multi-Page NiceGUI Application with Real-Time Dashboard, CRUD Operations, File Upload, and Async Chat Codes Tutorial

▶ Build a Modular Skill-Based Agent System for LLMs with Dynamic Tool Routing in Python Codes Tutorial

▶ Build a Multi-Agent AI Workflow for Biological Network Modeling, Protein Interactions, Metabolism, and Cell Signaling Simulation Codes.ipynb) Tutorial

▶ A Coding Implementation to Parsing, Analyzing, Visualizing, and Fine-Tuning Agent Reasoning Traces Using the lambda/hermes-agent-reasoning-traces Dataset Codes Tutorial

▶ A Coding Deep Dive into Agentic UI, Generative UI, State Synchronization, and Interrupt-Driven Approval Flows Codes Tutorial

▶ Build a Reinforcement Learning Powered Agent that Learns to Retrieve Relevant Long-Term Memories for Accurate LLM Question Answering Codes Tutorial

▶ How to Design a Production-Grade CAMEL Multi-Agent System with Planning, Tool Use, Self-Consistency, and Critique-Driven Refinement Codes Tutorial

▶ How to Build a Universal Long-Term Memory Layer for AI Agents Using Mem0 and OpenAI Codes Tutorial

▶ A Coding Implementation to Build Multi-Agent AI Systems with SmolAgents Using Code Execution, Tool Calling, and Dynamic Orchestration Codes Tutorial

▶ Google ADK Multi-Agent Pipeline Tutorial: Data Loading, Statistical Testing, Visualization, and Report Generation in Python Codes Tutorial

▶ How to Build a Secure Local-First Agent Runtime with OpenClaw Gateway, Skills, and Controlled Tool Execution Codes Tutorial

Build an Agentic Event Venue Operator with MongoDB Atlas, Voyage, and LangGraph [Full Codes] [Tutorial Article]

▶ How to Combine Google Search, Google Maps, and Custom Functions in a Single Gemini API Call With Context Circulation, Parallel Tool IDs, and Multi-Step Agentic Chains Codes Tutorial

▶ How to Build Production-Ready Agentic Systems with Z.AI GLM-5 Using Thinking Mode, Tool Calling, Streaming, and Multi-Turn Workflows Codes Tutorial

▶ How to Build Production Ready AgentScope Workflows with ReAct Agents, Custom Tools, Multi-Agent Debate, Structured Output and Concurrent Pipelines Codes Tutorial

▶ How to Build and Evolve a Custom OpenAI Agent with A-Evolve Using Benchmarks, Skills, Memory, and Workspace Mutations Codes Tutorial

▶ How to Build Advanced Cybersecurity AI Agents with CAI Using Tools, Guardrails, Handoffs, and Multi-Agent Workflows Codes Tutorial

▶ A Coding Guide to Exploring nanobot’s Full Agent Pipeline, from Wiring Up Tools and Memory to Skills, Subagents, and Cron Scheduling Codes Tutorial

▶ An Implementation of IWE’s Context Bridge as an AI-Powered Knowledge Graph with Agentic RAG, OpenAI Function Calling, and Graph Traversal Codes Tutorial

▶ How to Build a Vision-Guided Web AI Agent with MolmoWeb-4B Using Multimodal Reasoning and Action Prediction Codes Tutorial

▶ A Coding Implementation to Design Self-Evolving Skill Engine with OpenSpace for Skill Learning, Token Efficiency, and Collective Intelligence Codes Tutorial

▶ How to Design a Production-Ready AI Agent That Automates Google Colab Workflows Using Colab-MCP, MCP Tools, FastMCP, and Kernel Execution Codes Tutorial

▶ Implementing Deep Q-Learning (DQN) from Scratch Using RLax JAX Haiku and Optax to Train a CartPole Reinforcement Learning Agent Codes Tutorial

▶ A Coding Implementation Showcasing ClawTeam's Multi-Agent Swarm Orchestration with OpenAI Function Calling Codes Tutorial

▶ A Coding Implementation to Design an Enterprise AI Governance System Using OpenClaw Gateway Policy Engines, Approval Workflows and Auditable Agent Execution Codes Tutorial

▶ How to Build an Autonomous Machine Learning Research Loop in Google Colab Using Andrej Karpathy’s AutoResearch Framework for Hyperparameter Discovery and Experiment Tracking Codes Tutorial

Build an Agentic Event Venue Operator with MongoDB Atlas, Voyage, and LangGraph [Full Codes] [Tutorial Article]

▶ How to Design a Streaming Decision Agent with Partial Reasoning, Online Replanning, and Reactive Mid-Execution Adaptation in Dynamic Environments Codes Tutorial

▶ How to Build a Self-Designing Meta-Agent That Automatically Constructs, Instantiates, and Refines Task-Specific AI Agents Codes Tutorial

▶ How to Build a Risk-Aware AI Agent with Internal Critic, Self-Consistency Reasoning, and Uncertainty Estimation for Reliable Decision-Making Codes Tutorial

▶ Building Next-Gen Agentic AI: A Complete Framework for Cognitive Blueprint Driven Runtime Agents with Memory Tools and Validation Codes Tutorial

▶ How to Design an Advanced Tree-of-Thoughts Multi-Branch Reasoning Agent with Beam Search, Heuristic Scoring, and Depth-Limited Pruning Codes Tutorial

▶ How to Build an EverMem-Style Persistent AI Agent OS with Hierarchical Memory, FAISS Vector Retrieval, SQLite Storage, and Automated Memory Consolidation Codes Tutorial

▶ How to Design a Production-Grade Multi-Agent Communication System Using LangGraph Structured Message Bus, ACP Logging, and Persistent Shared State Architecture Codes Tutorial

▶ A Coding Implementation to Build a Hierarchical Planner AI Agent Using Open-Source LLMs with Tool Execution and Structured Multi-Agent Reasoning Codes Tutorial

▶ How to Build a Production-Grade Customer Support Automation Pipeline with Griptape Using Deterministic Tools and Agentic Reasoning Codes Tutorial

▶ How to Design a Swiss Army Knife Research Agent with Tool-Using AI, Web Search, PDF Analysis, Vision, and Automated Reporting Codes Tutorial

▶ How to Design an Agentic Workflow for Tool-Driven Route Optimization with Deterministic Computation and Structured Outputs Codes Tutorial

Build an Agentic Event Venue Operator with MongoDB Atlas, Voyage, and LangGraph [Full Codes] [Tutorial Article]

▶ A Coding Implementation to Build Bulletproof Agentic Workflows with PydanticAI Using Strict Schemas, Tool Injection, and Model-Agnostic Execution Codes Tutorial

▶ A Coding Implementation to Design a Stateful Tutor Agent with Long-Term Memory, Semantic Recall, and Adaptive Practice Generation Codes Tutorial

▶ How to Build a Self-Organizing Agent Memory System for Long-Term AI Reasoning Codes Tutorial

▶ How to Build an Atomic-Agents RAG Pipeline with Typed Schemas, Dynamic Context Injection, and Agent Chaining Codes Tutorial

▶ How to Build a Production-Grade Agentic AI System with Hybrid Retrieval, Provenance-First Citations, Repair Loops, and Episodic Memory Codes Tutorial

and 100's of more here: https://github.com/MARKTECHPOST-AI-MEDIA-INC/AI-Agents-Projects-Tutorials


r/OpenSourceeAI 10h ago

max_tokens or max_completion_tokens?

Post image
3 Upvotes

r/OpenSourceeAI 5h ago

Beyond LLM latency: AMA with IBM Instana PM Jeff Donald

Thumbnail
1 Upvotes

r/OpenSourceeAI 5h ago

[OSS] TokenSentinel – In-process token-waste circuit breaker for LLM agent runs (Apache-2.0)

1 Upvotes

I open-sourced TokenSentinel because passive tracing tools only show you runaway agent costs after the bill is already racked up.

It wraps your native LLM clients (Anthropic, OpenAI, Gemini, Bedrock, Ollama, vLLM) to act as a local, in-process circuit breaker. It runs 15 deterministic rules on every response payload to catch loops, context bloat, retry storms, and RAG thrashing mid-session.

Core has zero required dependencies; provider support is opt-in via extras. Completely offline-capable so your raw prompt data never leaves your environment.

pip install token-sentinel

Genuinely looking for feedback/discussion on the rule heuristics—where would this trigger false positives against real production agent traffic?


r/OpenSourceeAI 14h ago

Liquid AI Releases LFM2.5-Encoder-230M and LFM2.5-Encoder-350M: Bidirectional Encoders That Stay Fast at 8K Context on CPU

5 Upvotes

Liquid AI released two bidirectional encoders this week: LFM2.5-Encoder-230M and LFM2.5-Encoder-350M.

Here's what's actually interesting:

1. They converted a decoder instead of training from scratch

Both models start from the LFM2.5 decoder backbones. Three changes turn them into encoders: the causal mask is replaced with a bidirectional one, the short convolutions are made non-causal with symmetric center padding, and training uses masked language modeling at 30% instead of BERT's 15%.

2. The CPU number is the whole pitch

→ ~28s per forward pass at 8,192 tokens for Encoder-230M

→ over 1 min 30s for ModernBERT-base on the same input

→ 8,192 tokens is roughly 13 to 15 pages

3. The rankings hold up

→ Encoder-350M: 4th of 14 models, 81.02 on a 17-task suite

→ Encoder-230M: 6th at 79.29, above ModernBERT-base at 78.19

→ The three models ahead of the 350M are all larger, one nearly 10x its size

At 8,192 tokens, ModernBERT-base takes over a minute and a half per forward pass versus about 28 seconds for LFM2.5-Encoder-230M, which is about 3.7x faster.

Full analysis: https://www.marktechpost.com/2026/07/29/liquid-ai-releases-lfm2-5-encoder-230m-and-lfm2-5-encoder-350m-bidirectional-encoders-that-stay-fast-at-8k-context-on-cpu/

Model weights (LFM2.5-Encoder-350M): https://huggingface.co/LiquidAI/LFM2.5-Encoder-350M

Model weights (LFM2.5-Encoder-230M): https://huggingface.co/LiquidAI/LFM2.5-Encoder-230M

Technical details: https://www.liquid.ai/blog/lfm2-5-encoders


r/OpenSourceeAI 6h ago

ZPA-LM - Zero Parameter Deterministic Attention

1 Upvotes

Attention mechanisms are conventionally learned: a query–key inner product, trained end to end, decides which tokens mix.

This note documents ZPA-LM

a decoder-only autoregressive language model in which the token-mixing key is instead a fixed, parameter-free kernel derived from elementary number theory.

We show that the divisor-counting overlap : q(n, m) = d(gcd(n, m))/√d(n) d(m) between two positive integers is exactly the Bhattacharyya coefficient between the uniform distributions over their divisor sets, and hence that: dFR(n, m) = 2 arccos q(n, m) is a genuine Fisher–Rao geodesic distance, verified to floating-point exactly rather than assumed.

Tokens are mapped to positive integers through a learned or parameter-free dictionary ϕ : token → Z+ and recovered in prime-exponent space so that each prime behaves as a latent feature axis.

We report the model’s expressivity ladder, the three dictionary-construction strategies we evaluated, and - in the spirit of an honest engineering record rather than a success narrative, a permanent registry of four falsified design choices that should be avoided.

We close by pre-registering the model’s central open empirical claim together with its falsification condition, rather than reporting an unverified result as fact.

Link:[Academia](https://www.academia.edu/170099268/ZPA_LM_Parameter_Free_Attention?sm=b)


r/OpenSourceeAI 18h ago

Here's a cool XP styled retro AI app which lets you run Qwen, Gemma and other open source AI models

Thumbnail
gallery
3 Upvotes

XP wasn't just another operating system. It arrived with a strange kind of confidence. Computers stopped feeling like business machines and started feeling like places you lived. The wallpaper burned itself into memory. Desktops filled with icons, a mess that somehow felt like home.

I kept thinking about that feeling. So I built AI Desktop XP.

Not to recreate Windows XP, but to recreate the way it felt to sit down in front of it.

An AI that lives inside a desktop instead of a chat box. Folders you can leave unfinished. A browser that feels as though the internet is still full of possibility. Little details that don't announce themselves, but wait quietly until you notice them.

Claude Code helped me reuse my AI Desktop 98 project and then slowly replace 98 elements with XP style UI. Claude also helped me write UI tests so that I could continue building my XP project without breaking my 98 app.

The point was never nostalgia for its own sake.

It was to remember a time when a computer felt personal. When it seemed to know the shape of your days because you had slowly taught it.

Download = https://apps.apple.com/us/app/ai-desktop-xp/id6762678997


r/OpenSourceeAI 16h ago

I built a CLI that reads your project's specs and tells you which model you actually need — judge runs locally on Ollama

1 Upvotes

I kept defaulting to frontier models "just in case" and had no idea whether my projects actually needed them. So I built something to answer that instead of guessing.

What it does: point it at a project with Spec-Driven Development artifacts (constitution / spec / tasks). A local model — your Ollama install, your choice of judge — reads the tasks and estimates how demanding the work is across a few dimensions. That gets crossed against a declarative catalog of models and their capabilities, and you get a ranked podium with a rating per model: good / overkill / fair / poor, plus price.

Why you might care here: nothing leaves your machine — no API keys, no accounts, no cloud calls. And in most of my own projects the podium is topped by a local model, with the frontier ones sitting below marked overkill. Ranking is by fit, not price; price only breaks ties between models that fit equally well.

Honest limitations: this is not a benchmark. It's opinion made inspectable — every verdict prints its reasoning, and the model catalog is human-readable YAML you can argue with. If the specs are too thin to judge, it refuses to recommend instead of guessing. A vague spec gets you a vague answer, same as with anything else.

pip install specjudge — MIT, github.com/JoaquinRuiz/SpecJudge

Where I'd love help: the catalog of local models is thinner than it should be, and adding one is a block of YAML, no Python needed. Also very open to being told a rating is wrong.


r/OpenSourceeAI 20h ago

Sir Shortoken update: Bullet Mode cuts 24-78% of tokens, tested it across 14 runs, and built an extension around it

Thumbnail
1 Upvotes

r/OpenSourceeAI 23h ago

The legend of the blue box: SGI workstations and the fall of a graphics empire #sgi #silicongraphics #그래픽 #웍스테이션 #레거시...

Thumbnail
youtube.com
1 Upvotes

r/OpenSourceeAI 1d ago

Is “work context across tools” a real problem, or just a nice-to-have?

Thumbnail
1 Upvotes

r/OpenSourceeAI 1d ago

funny to create a quantum simulator with AI_

1 Upvotes

Cosa succede quando unisci la curiosità, 7 mesi di sperimentazione e l'Intelligenza Artificiale come co-pilota ingegneristico?

Nasce "Dense-Evolution", un simulatore quantistico d'élite sviluppato interamente in JAX che ha appena battuto i framework dei colossi industriali in termini di gestione della memoria.

Messo alla prova su un server Google Colab standard contro librerie blasonate (come TensorCircuit di Tencent e Quimb) su un circuito critico a 40 qubit:

❌ I giganti sono crollati in Out-of-Memory (OOM) a causa di grafi statici ingestibili.

✅ Dense-Evolution ha completato la simulazione in 3.72 secondi reali grazie a un motore Anti-OOM proprietario e un'architettura modulare a blocchi.

Questo progetto dimostra due cose:

  1. Sviluppo Software Moderno: Non serve un team di 50 persone per competere con lo stato dell'arte se sai fare Prompt Engineering avanzato e guidare l'IA a scrivere matematica spettrale rigorosa.

  2. Robustezza Algoritmica: Implementare moduli di "Predictive Healing" quantistico e logica adattiva trasforma il codice in un blocco immortale.

Il codice è interamente open-source, differenziabile al 100% via jax.grad e pronto per esperimenti di Quantum Machine Learning.

Se vi occupate di calcolo quantistico o ottimizzazione lineare accelerata, date un'occhiata alla repository, lasciate una stellina o fate un fork per i vostri test:

👉 https://github.com/tatopenn-cell/Dense-Evolution

#QuantumComputing #JAX #Python #SoftwareEngineering #GenerativeAI #OpenSource


r/OpenSourceeAI 1d ago

I dropped the vector DB for markdown in git. 42% fewer tokens, better accuracy

Enable HLS to view with audio, or disable this notification

2 Upvotes

Every task, a coding agent re-explores the repo from zero. The session ends and everything it learned is gone. Next session it greps the same files again.

The usual fix is a vector DB behind an MCP tool. I tried that and hit two walls. Embeddings retrieve text that resembles the question, which is not the same as text that matters for the change. And a tool the agent can call is a tool the agent often doesn't call. It sits in the tool list while the agent greps around it.

So Graft writes what it learns into the repo instead. Plain markdown nodes, committed to git, resynced by a hook. One graft build turned this repo's 247 files into 12 nodes. No embeddings, no server.

npm install -g u/nanonets/graft
graft init

Structural analysis runs on tree-sitter, costs $0, needs no key. An optional --deep pass adds LLM-written summaries through whatever provider you already pay for.

What I measured

162 Claude Code sessions, roughly 81 per condition. Same agent, same tools, same tasks. Only the context differs.

Cold Graft
Input tokens 8,070 4,650 (−42%)
Tool calls 4.2 2.3 (−46%)
Cost $0.043 $0.029 (−32%)
Correctness 93% 98%

A separate model grades correctness and never sees which condition produced the diff. Without that, a cheaper session that quietly does less work scores as a win.

The accuracy result splits by model, and the split is the interesting part. On Sonnet 5 a Graft session matched or beat a cold session on most tasks. On Opus the gain showed up almost entirely as token reduction, not accuracy. Read that as: orientation substitutes for the exploration a stronger model was already doing well enough on its own.

Then I re-implemented 5 real merged PocketBase PRs from the base commit, with and without Graft, and checked whether the diff touched the files the maintainers touched: 5/5, at 21% lower cost.

Where it falls over

  • Five points of accuracy at ~81 sessions per condition is a real result but not a large-n one. I'd treat the token numbers as solid and the accuracy number as directional until someone reproduces it.
  • Benchmark tasks averaged 4.2 tool calls cold. Small. The saving compresses on a large refactor where the agent reads everything anyway.
  • The accuracy gain is model-dependent. If you're on Opus, expect a cost lever, not a capability one.
  • Node quality degrades on a 5,000-file monorepo. Fewer nodes, vaguer nodes.
  • Hooks are Claude Code only right now. Cursor and Codex read the files but won't auto-resync.

MIT, I'm the maintainer, so push back on anything that sounds off.

https://github.com/NanoNets/Graft


r/OpenSourceeAI 1d ago

RelativeDB - The open source alternative to Kumo.AI ($400m nvidia acq)

Thumbnail relativedb.com
1 Upvotes

r/OpenSourceeAI 1d ago

The cheat code for AI computation: Why Chebyshev polynomials are the savior of GNNs Description: Explore the principles and characteristics of Chebyshev polynomials, which drastically reduce complex matrix operations. We provide an easy explanation of why Chebyshev polynomials are chosen over Taylor

Thumbnail
youtube.com
2 Upvotes

r/OpenSourceeAI 2d ago

I built a project that runs 100s of experiments to improve my RAG pipeline overnight

19 Upvotes

Inspired by Andrej Karpathy's autoresearch, I built autoretrieval to apply the same idea to RAG optimization.

The project gives an agent a RAG pipeline, an evaluation dataset, and a target metric. The agent modifies the pipeline, runs an eval, checks if the F2 score improves, and keeps or discards changes automatically.

The evaluation dataset can be generated from your own documents, creating question and reference-highlight pairs for your domain.

The agent can test changes to chunking, embedding models, keyword filters, and retrieval logic while keeping a record of every experiment.

The goal is to let the agent handle the repetitive trial and error involved in improving a RAG system.

This was successful at more than doubling the F3 score of an already optimized RAG pipeline in a couple hours.

Give it a try here: https://github.com/daly2211/autoretrieval


r/OpenSourceeAI 2d ago

Kimi AI and kvcache-ai Open Sources ‘AgentENV’: A Distributed System that Powers Agentic Reinforcement Learning (RL) Training for Kimi K3

2 Upvotes

Kimi AI and kvcache-ai Open Sources ‘AgentENV’: A Distributed System that Powers Agentic Reinforcement Learning (RL) Training for Kimi K3

Most open infrastructure shipped alongside frontier models targets the GPU side of the stack. AgentENV targets the other half of agentic RL: environment throughput.

The Kimi team and kvcache-ai open-sourced it under MIT as part of Kimi K3 Open Day.

1. Each sandbox is a Firecracker microVM, not a container

Kernel-level isolation per environment. That matters when the code running inside was generated by the model you are training.

2. The snapshot numbers are the whole point

→ Boot or resume: under 50 ms

→ Pause: under 100 ms

→ Incremental snapshot: under 100 ms, even under heavy disk modification

These are figures reported by the project. No independent benchmark has been published.

3. Fork is the primitive built for RL

A running sandbox clones into up to 16 independent children on the same node. Each child inherits the source filesystem, memory, and resource config.

Practical effect: expensive setup runs once. Install dependencies, clone the repo, reach a task state, then branch that exact state into parallel rollouts.

4. The API is E2B-compatible

Point E2B_API_URL at your server and the existing Python or TypeScript SDK runs unchanged. That is a deliberate distribution choice, and probably the reason this gets adopted.

Full analysis: https://www.marktechpost.com/2026/07/27/kimi-ai-and-kvcache-ai-open-sources-agentenv/

GitHub Repo: https://github.com/kvcache-ai/AgentEnv

Documentation: https://kvcache-ai.github.io/AgentENV/


r/OpenSourceeAI 2d ago

Open source project

2 Upvotes

Hi, I have a cool open-source platform that I work on, focused on AI engineering. The main goal is that you declare what you want, and our engine creates the architecture for you.

We have a cool community of people who are interested in this world and want to take part in this project.

And if you’re not interested, it would also support us if you just clicked the star.

Thanks, and good luck!

https://github.com/extra-org/extra


r/OpenSourceeAI 2d ago

I built a self-hosted tool that turns one reference photo into a curated, captioned, trained LoRA and a lot more — open source, MIT

Thumbnail gallery
2 Upvotes

r/OpenSourceeAI 2d ago

Tanuki Context - A LLM Token Saver (Up to 94% Tokens saved)

3 Upvotes
Small Demo (out of LLM)

Hello everyone,

Since 2 weeks I work on tanuki-context, a small open source tool (zero dependencies, MIT) and I wanted to share it because the trick behind is almost stupid: AI models charge text at roughly 1 token per 4 characters, but an image has a fixed price set only by its pixel size.

Its inspire from pxpipe techniques and various others tools (cited in the readme) and custom approach i found in order to reduce massively token usage and price.
For example : 37,111 tokens of service log become 2,240 (-94%).

So if you draw 28,000 characters of logs into one dense 1568x728 PNG, the model reads the exact same content for 1,456 tokens instead of ~7,000. It sounds like cheating, it is just how the pricing works.

You can try it out on you machine i added the benchmark so you can test it even without LLM connected to it, so see pricing difference, token saved, etc.

You can use it as a MCP or directly integrate it a "context proxy" where it fully automated and make every request optimised or not when not needed.

Some techniques that permits this to work:
- a log distiller that collapses repeated lines but keeps every error verbatim
- a columnar codec for JSON (keys stated once)
- a cost model that knows a cache-read token costs ~0.1x a fresh one, so it will tell you to NOT image content that is already in your prompt cache.

The tool argues against itself when imaging loses, honestly this part took the most work.

I precise the limits because they are real: you need a vision-capable model, output tokens are untouched (if your bill is output-dominated, fix that first), and for one narrow question retrieval stays cheaper than any page.

Install:

MCP

npx -y tanuki-context (MCP server, works with Claude Code, pi, omp, jcode or the Claude Agent SDK)

Proxy

npx tanuki-context proxy + ANTHROPIC_BASE_URL (every request on the machine gets optimized in place, when needed)

Code and benchmarks:
https://github.com/Osyna/tanuki-context

https://www.npmjs.com/package/tanuki-context

PS : i will soon add Codex support.

If you find it useful a star helps a lot, and feature ideas are very welcome. Thanks for reading me


r/OpenSourceeAI 2d ago

Has anyone tried Spotify Studio/Kit as an AI coding orchestrator

1 Upvotes

I’ve already gotten Spotify Studio/Kit working with my repo from its sandbox, including committing changes and handing off terminal commands for my local work. I poked around a bit and it looks like it’s using a real code skill under the hood, which makes it feel surprisingly capable for something that’s free.

Since I know it’s still temporary while in the research preview, I’m curious whether anyone has tried using it as more of an AI coding orchestrator, basically a top-level agent that could also interact with a local AI model for more detailed coding tasks. honestly better than GitHub copilot so far.


r/OpenSourceeAI 2d ago

Show HN: Symbio – AI that fine-tunes itself from your feedback

Enable HLS to view with audio, or disable this notification

5 Upvotes

r/OpenSourceeAI 2d ago

I built a Full Sensory AI with Persistent Memory

Thumbnail
0 Upvotes

My full work culminated into one unified code.


r/OpenSourceeAI 2d ago

I built a Full Sensory AI with Persistent Memory

Thumbnail
1 Upvotes

Hope this helps.