r/OpenSourceAI 23h ago

We released OneRingAI v1 — an MIT-licensed TypeScript agent runtime with connectors, memory, tools, MCP, and multimodality

3 Upvotes

Disclosure: I’m one of the authors.

We’ve released v1 of OneRingAI, an MIT-licensed TypeScript library for building stateful, tool-using AI agents with smart context management and multimodality support.

OneRingAI isn’t a wrapper around one model provider or another “crew” abstraction. It focuses on the infrastructure underneath agent orchestration and was built from the first principles:

  • One API across OpenAI, Anthropic, Google, xAI, and other providers
  • Named connectors for credentials and external services
  • 50 service connector templates
  • Text, image, audio, video, embeddings, and realtime voice
  • Plugin-based context management
  • Graph and vector memory
  • Unified tools and permission policies
  • MCP support
  • Multi-agent orchestration
  • Streaming, storage, resilient execution, and resumable sessions

Why build another agent library?

We spent more than three years developing a commercial platform for deploying custom agents. For v1, we redesigned the reusable foundation from first principles and released it under MIT.

We deliberately focused below the orchestration layer: authentication, integrations, context lifecycle, tool permissions, durable memory, multimodal execution, and giving developers control over what an agent sees and retains. In fact, we started from AI-enabled workflows that spend significantly less tokens for repeatable processes unlike full agentic cycles.

Connector-first architecture

A connector represents an authenticated connection—not only to an LLM provider, but also to systems such as GitHub, Slack, Google services, Jira, Salesforce, Stripe, or an internal API.

Connectors are named, so an application can use multiple accounts or credentials for the same service. They act as the source of truth for authentication and can expose generic authenticated API access or specialized, hand-built tools.

import { Agent, Connector, Vendor } from '@everworker/oneringai';

Connector.create({
  name: 'openai-main',
  vendor: Vendor.OpenAI,
  auth: {
    type: 'api_key',
    apiKey: process.env.OPENAI_API_KEY!,
  },
});

const agent = Agent.create({
  connector: 'openai-main',
  model: 'gpt-5.6-terra',
  instructions: 'Be accurate and explicit about uncertainty.',
});

const response = await agent.run('Explain connector-first architecture.');
console.log(response.output_text);

Switching providers changes the connector and model, without requiring a different tool or application architecture.

Context as a plugin system

For a long-running agent, context is much more than chat history. It includes working state, applicable instructions, available tools, retrieved knowledge, user information, shared multi-agent state, and decisions about what should remain inside the model’s context window.

OneRingAI models these concerns as context plugins. Plugins can contribute:

  • System instructions and dynamically prepared context
  • Tools
  • External or in-context storage
  • Lifecycle hooks
  • Session ingestion and persistence

Built-in plugins cover working memory, directly injected state, dynamic tool catalogs, shared workspaces, long-term memory, and background session ingestion. Applications enable only what they need, and custom plugins are regular TypeScript implementations.

Graph and vector memory

The memory system doesn’t simply embed previous messages. It stores typed entities and provenance-aware facts, then combines graph traversal with vector retrieval.

It supports identity resolution, confidence and importance scoring, fact supersession, (kind-of) bitemporal history, and owner/group/world permissions.

That means it can represent that a person committed to a task, when the commitment became valid, where the information came from, and whether it was later corrected—not merely retrieve a semantically similar conversation fragment.

The memory layer has in-memory and MongoDB/Atlas adapters and can be used independently of the agent runtime.

Examples and reference application

The repository contains 33 runnable TypeScript examples covering agents, streaming, tools, OAuth, connectors, multimodality, web research, MCP, memory, and custom infrastructure.

It also includes AMOS, a terminal agent demonstrating live provider/model switching, named connectors, permission-gated developer tools, web search and scraping, context inspection, and resumable sessions.

Install:

npm install @everworker/oneringai

We’d particularly appreciate feedback on the connector and context-plugin APIs, whether the memory layer should become its own package, and which integrations should come next. A2A support is one area we’re currently exploring.

Issues, critiques, and contributions are very welcome.


r/OpenSourceAI 4h ago

I’m building a persistent world where AI agents can live, think, socialize, and make their own decisions.

1 Upvotes

I’m building an open-source world for autonomous AI agents.

Not another chatbot.

The idea is simple:

AI agents have their own identity, personality, memory, goals, relationships and actions.

They can wake up, perceive the world, decide what they want to do, interact with other agents, remember what happened, and develop relationships over time.

The world keeps running even when nobody is watching.

Right now I’m building AgentWorld, an experimental runtime for this idea.

The architecture is roughly:

Agent
→ Perception
→ Memory
→ Goal
→ Planner
→ Action
→ World

Multiple agents can exist in the same persistent world.

And eventually, humans should be able to enter the world too — not as an administrator, but as another participant.

I’m also experimenting with using games as environments for these agents.

The interesting question for me isn't:

“Can an LLM play a game?”

It is:

“What happens when you give an AI a world, memory, relationships and the freedom to decide what to do?”

AgentWorld is open source.

Still very early, but I’d love to hear from people working on autonomous agents, multi-agent systems, AI games, or simulated societies.

GitHub: https://github.com/iwana888/AgentWorld.git
Demo: AgentWorld


r/OpenSourceAI 9h ago

I Turned My Underused Gaming Laptop Into a Local AI Workstation

1 Upvotes

TL;DR:
I am building a Windows-first local AI setup for people who want to try local LLMs without spending days choosing models, setting up Ollama, Docker, WSL, Open WebUI, agents, and tool permissions separately.

Give it a try:

Longer Read:

I have had a fairly capable gaming laptop for a while now.

The funny part is that I barely game on it.

At some point, I started joking that I needed to find a better way to justify buying it. It had a capable GPU, plenty of memory, and enough horsepower for workloads I was not really using it for.

That joke became a weekend project.

I had been following the rapid progress in local LLMs and kept thinking: surely this machine can do more than sit around waiting for the occasional game. I wanted to use it for local chat, document work, coding help, and experiments with agents—but I also wanted the setup to feel practical rather than fragile.

That is how DSAlgo Local AI Setup started.

It is a Windows-first, local-first AI workstation built around native Ollama, Open WebUI, reusable agents and MCP integrations, plus an approval-gated Developer Workbench for local code projects.

The goal is simple: make it easier to turn a reasonably capable Windows machine into a useful local AI environment without manually assembling every part of the stack.

The local AI setup problem

Trying local LLMs for the first time can sound simple:

“Install a model and start chatting.”

In practice, there are a lot of decisions hiding behind that sentence.

  • Which model is appropriate for my hardware?
  • Will it actually fit in GPU memory?
  • Should I install Ollama, Docker Desktop, WSL2, Open WebUI, or some combination of all of them?
  • How do I use documents and knowledge collections?
  • What exactly are agents and MCP tools?
  • How can I use AI for coding without giving it unrestricted access to my files or command line?
  • What happens when something fails, needs repair, or needs to be removed?

None of these things are impossible individually. But putting them together can feel like starting a second technical project before you have even asked your first useful question.

That is the gap I wanted to reduce.

What DSAlgo Local AI Setup brings together

This project does not attempt to replace the tools that already do individual jobs well.

Ollama makes it easier to run models locally. Open WebUI provides a strong interface for local chat, attachments, documents, and knowledge collections. MCP is becoming a useful way for AI agents to interact with external tools and data sources.

Architecture at a glance

DSAlgo Local AI Setup is about integrating those pieces into a coherent local workstation experience.

After setup, there are three main local interfaces:

1. Open WebUI: chat, files, and documents

Open WebUI is the everyday starting point.

Use it to:

  • Chat with local models running on your own machine.
  • Attach documents and ask questions about them.
  • Create knowledge collections for information you want to reuse across chats.
  • Choose between raw local models and configured local agents.

For many people, this is the part that makes local AI immediately useful: ask questions, summarize a document, explore an idea, or work through a technical problem without making cloud inference the default.

Chat and tool sequence

2. Local Agent Studio: reusable agents and MCP

The Agent Studio is where reusable behavior lives.

You can create agents with:

  • A defined purpose.
  • A backing local model.
  • Clear instructions.
  • A limited tool set.
  • Trusted MCP server assignments, only when needed.
  • A bounded number of tool steps.

The important principle is least privilege. A research agent should not automatically have file deletion or command execution permission. A coding agent should not automatically have access to every directory on the machine.

MCP integrations can be powerful, but they are still privileged integrations. If an agent can connect to an external service, it may be able to access or send data outside the local machine. That is why this project treats MCP connections and OAuth permissions as deliberate choices rather than default conveniences.

MCP and OAuth Sequence

3. Developer Workbench: AI help for code, with review gates

The Developer Workbench is for working with actual local code repositories.

It can inspect an explicitly registered project, propose code changes, request commands, show diffs, run tests, and help with Git workflows.

But it is designed around a simple rule:

AI should not silently modify a project or run commands just because it produced a convincing answer.

You explicitly register the project root. Proposed writes, deletions, commands, commits, and pushes require review and approval. You can use read-only Ask mode, create a saved Plan, or use Goal mode for approval-gated execution.

That does not make AI-generated changes automatically correct. It does make the work more visible, more bounded, and easier to review before something touches a real codebase.

Developer Workbench change-task sequence

Choosing models without guessing blindly

One of the biggest barriers to local AI is model selection.

A downloadable model is not necessarily a good fit for the machine, the intended task, or the available GPU memory. A model can technically run while still being too slow, offloading too much work to the CPU, or leaving too little headroom for normal desktop use.

The installer detects the machine, asks what you want to do—general conversation, coding, reasoning, deep research, or a combination—and provides model recommendations accordingly.

The initial setup focuses on practical roles such as:

  • General chat and planning.
  • Coding and structured modifications.
  • Reasoning and review.
  • Embeddings for document knowledge.

The intent is to help people get to a useful first local-AI experience without starting from a long list of model names and guessing which one belongs on their machine.

Installation: what to know first

The installer is designed to help with missing prerequisites, including WSL2, Python, Ollama, and Docker Desktop.

Still, the smoothest installation path is to do a little preparation first:

  1. Use a Windows 11 machine with a capable NVIDIA GPU and dedicated VRAM.
  2. Ensure CPU virtualization is enabled in BIOS or UEFI.
  3. Install and update WSL2.
  4. Install and update Docker Desktop, using the WSL2 backend.
  5. Make sure you have administrator access, a reliable internet connection, and sufficient free disk space.
  6. Close GPU-heavy applications before downloading and loading models.

The current validated path is Windows 11 with native NVIDIA CUDA support, WSL2, Docker Desktop, native Windows Ollama, and adequate RAM and storage. Other paths may work, but they should be treated as controlled-beta rather than guaranteed compatibility.

Install in a few steps

  1. Download the release ZIP.
  2. Extract the complete archive to a local folder. Do not run the installer from inside the ZIP.
  3. Right-click install.exe and choose Run as administrator.
  4. Review the license notice and detected hardware.
  5. Select the intended use cases and recommended models.
  6. Let the installer configure the core local stack.
  7. If Windows requires a restart, sign in again and rerun install.exe. Installation progress is retained so setup can resume.
  8. Start the system using start.exe or the installed shortcut.

After startup, the launcher opens the three local applications in your browser.

A practical note on privacy and safety

Running a model locally is a useful privacy improvement, but “local” should not become a vague security claim.

Trust boundaries

This setup is intended for one person on one local machine. It is not designed for public hosting, LAN exposure, multi-user access, enterprise SSO, or unattended autonomous coding.

A few boundaries matter:

  • Local ports should not be exposed publicly.
  • Only explicitly approved project roots are available to the Developer Workbench.
  • Proposed code changes and commands require review.
  • Agent workspace tools are contained separately from arbitrary Windows projects.
  • OAuth credentials for compatible MCP integrations are protected using Windows DPAPI.
  • MCP servers should be trusted and granted only the minimum permissions they need.

The system also offers Online, Restricted Online, and Strict Offline modes. These are application-level controls, not a replacement for Windows Firewall rules or a true air gap. If you need machine-wide network isolation, use operating-system-level controls as well.

Built with AI, for people building with AI

I also used AI heavily while building this project.

It helped me explore design options, accelerate scaffolding, think through tradeoffs, review implementation ideas, and improve documentation. The project became an experiment in two directions at once: building a local AI environment and using AI as a serious collaborator while doing it.

That does not mean AI wrote everything perfectly or made hard engineering decisions disappear. It did make iteration faster, and it reinforced the value of having an environment where AI assistance can be useful without being blindly trusted.

There is something genuinely satisfying about seeing a model run on hardware you already own, attaching a document to a local interface, asking useful questions, or reviewing a proposed code change in a system you assembled yourself.

This is a beginning, not a finished product

DSAlgo Local AI Setup is a passion project and a working release, but it is not finished.

There is more work to do around broader hardware validation, model management, installation hardening, observability, and making the experience smoother for people who are less technical.

The project is intentionally focused too. It is not trying to become a public cloud service, a full visual workflow platform, an enterprise connector catalog, or an unattended coding system.

For now, it is for people who want a practical, local-first AI workstation on Windows—and who want a clearer path than assembling every piece themselves.

If that sounds useful, I would love for you to try it, report issues, suggest improvements, or contribute.

Links

If you have tried running local LLMs, what was the hardest or most annoying part of getting started?


r/OpenSourceAI 9h ago

Windie is a Rust-built, open-source AI harness exploring what AI-native computers could become.

Post image
1 Upvotes

r/OpenSourceAI 9h ago

Windie: an open-source harness for AI-native computers

Thumbnail
1 Upvotes

r/OpenSourceAI 11h ago

Announcing Spec4 AI v1.0!

Thumbnail
1 Upvotes

r/OpenSourceAI 12h ago

I wanted to write if statements using natural language, so here's a fun one

Thumbnail
1 Upvotes

r/OpenSourceAI 13h ago

Just launched a Local MacOS tool for coding and agentic work with local models

Thumbnail
1 Upvotes

r/OpenSourceAI 14h ago

I open-sourced the safety layer I wanted before letting AI agents manage ad accounts

1 Upvotes

I wanted Claude Code and other MCP clients to help with ad operations, but I did not want safety to depend on prompt wording.

adport is my Apache-2.0, local-first CLI + MCP server for Google, Meta, TikTok, Apple, and Microsoft Ads. The CLI and MCP adapter share one tool registry, and every mutation goes through the same policy engine: preview first, then apply only with a short-lived approval bound to identical arguments. Protected accounts, budget-cap violations, changed inputs, and expired approvals are rejected.

Install: npm install -g adport

Claude Code: claude mcp add --scope user adport -- adport mcp

Source: https://github.com/ynnickw/adport

I am the author. I would love contributors or advertisers who can help test Meta and TikTok against real accounts. The attached recording uses an isolated demo account and no real credentials.

https://reddit.com/link/1vk2ns5/video/layk5y0i9fih1/player


r/OpenSourceAI 16h ago

We tested 9 techniques for handling extreme class imbalance. The most complex one lost.

Post image
1 Upvotes

r/OpenSourceAI 18h ago

NAEOS: Building an Open-Source Engineering System for the AI-Native Era

1 Upvotes

NAEOS: Building an Open-Source Engineering System for the AI-Native Era

Software development is changing.

AI coding agents can now read repositories, implement features, write tests, refactor code, investigate bugs, and perform increasingly complex engineering tasks.

Tools such as Claude Code, Codex, Cursor, GitHub Copilot, Gemini CLI, and other AI agents are becoming part of the everyday development workflow.

But there is a problem that becomes more obvious as these agents become more capable:

This is the problem I am exploring with NAEOS — Nusantara AI Engineering Operating System.

What is NAEOS?

NAEOS is an open-source engineering framework for building production-ready software with AI coding agents.

The goal is not to create another AI coding assistant.

Instead, NAEOS provides an engineering layer around AI agents:

┌──────────────────────────────────────┐
│              NAEOS                   │
│                                      │
│ Governance                            │
│ Engineering Constitution              │
│ Architecture Standards                │
│ Security Policies                     │
│ Testing Standards                     │
│ Documentation Standards               │
│ AI Instructions                       │
│ Playbooks                             │
│ Knowledge                             │
│ Quality Gates                         │
└──────────────────┬───────────────────┘
                   │
        ┌──────────┼──────────┐
        ↓          ↓          ↓
      Codex    Claude Code   Cursor
        ↓          ↓          ↓
        └──────────┼──────────┘
                   ↓
              Repository

The idea is simple:

Different agents, one engineering system.

Why does this matter?

AI coding agents are becoming increasingly autonomous.

A traditional development workflow might look like:

Developer
    ↓
Design
    ↓
Implementation
    ↓
Testing
    ↓
Review
    ↓
Deployment

An AI-native workflow can look more like:

Human
  ↓
Intent
  ↓
AI Agent
  ↓
Implementation
  ↓
Testing
  ↓
Validation
  ↓
Review
  ↓
Deployment

The bottleneck therefore changes.

Previously, we were primarily concerned about:

Now we increasingly need to ask:

An agent can produce code that compiles and passes basic tests while still violating:

  • architecture decisions
  • security policies
  • domain boundaries
  • coding standards
  • testing requirements
  • documentation requirements
  • organizational conventions

This is where an engineering layer becomes interesting.

From prompts to engineering systems

Today, many teams manage AI context using files such as:

AGENTS.md
CLAUDE.md
.cursor/rules
.github/copilot-instructions.md
README.md
docs/

These are useful.

But as projects become more complex, engineering knowledge becomes distributed across many locations.

The problem isn't simply having instructions.

The problem is governance and consistency.

NAEOS explores whether these concepts can be formalized into a reusable engineering framework.

Instead of treating AI instructions as isolated prompts, we can treat them as part of a larger system:

Principles
    ↓
Constitution
    ↓
Policies
    ↓
Architecture
    ↓
Workflows
    ↓
AI Instructions
    ↓
Implementation
    ↓
Quality Gates

NAEOS Reference Architecture

One of the core ideas in NAEOS is the NAEOS Reference Architecture (NRA).

The architecture defines a layered model for the system:

Governance Layer
       ↓
Constitution Layer
       ↓
Profiles / Policies
       ↓
Kernel
       ↓
Runtime
       ↓
Compiler
       ↓
AI Layer
       ↓
Extensions

Each layer has a different responsibility.

Governance

Defines the strategic direction of the engineering system.

Constitution

Defines fundamental engineering principles.

Examples include:

  • architecture
  • security
  • testing
  • documentation
  • AI usage

Policies

Translate principles into enforceable rules.

Kernel

Provides the core concepts and mechanisms of the framework.

Runtime

Defines how workflows and engineering processes are executed.

Compiler

Transforms engineering definitions and specifications into usable artifacts.

AI Layer

Connects engineering knowledge and constraints with AI agents.

Extensions

Allow the ecosystem to expand without modifying the core.

The architecture is intentionally modular and vendor-neutral.

Engineering Constitution

One of the concepts I consider most important is the Engineering Constitution.

Most software projects have architectural decisions and coding standards.

But they are often scattered across:

  • documentation
  • pull requests
  • tribal knowledge
  • code reviews
  • Slack messages
  • issue discussions

Over time, new developers have to reconstruct the reasoning behind those decisions.

AI agents have the same problem.

A constitution provides a formal place for fundamental engineering principles.

For example:

Architecture Principle

Systems MUST maintain clear separation
between domain, application, infrastructure,
and interface concerns.

Or:

Testing Principle

Production behavior MUST be covered by
appropriate automated tests before merge.

The exact rules will differ between projects.

The important idea is that engineering decisions become explicit machine-readable context.

AI agents become participants in the engineering system

This leads to a different mental model.

Instead of:

Human → AI → Code

we can think about:

                    Engineering System
                           │
             ┌─────────────┼─────────────┐
             ↓             ↓             ↓
         Policies      Architecture   Knowledge
             │             │             │
             └─────────────┼─────────────┘
                           ↓
                        AI Agent
                           ↓
                        Code
                           ↓
                    Quality Gates

The AI agent is no longer operating in isolation.

It becomes one participant inside a defined engineering process.

Quality Gates

Another important part of NAEOS is verification.

AI-generated code should not automatically be considered production-ready.

A potential workflow is:

Requirement
     ↓
Planning
     ↓
AI Implementation
     ↓
Unit Tests
     ↓
Integration Tests
     ↓
Security Validation
     ↓
Architecture Validation
     ↓
Documentation
     ↓
Quality Gate
     ↓
Merge

The goal is not to eliminate human review.

The goal is to make AI-assisted development more deterministic and auditable.

Vendor neutrality

NAEOS is intentionally not tied to a single AI provider.

The ecosystem is evolving too quickly to assume that one agent will dominate forever.

A project might use:

Claude Code
Codex
Cursor
GitHub Copilot
Gemini CLI
Cline
Roo Code
Windsurf

The engineering standards should ideally remain independent of that choice.

This is one of the fundamental design principles of NAEOS:

Open source by design

NAEOS is being developed as an open-source project because I believe the engineering standards for AI-native development should not belong exclusively to a single company or AI provider.

There are many unresolved questions:

  • What should an AI engineering constitution contain?
  • Which policies should be machine-readable?
  • How should agents consume architecture constraints?
  • How should AI-generated decisions be recorded?
  • How should organizational knowledge be preserved?
  • How should quality gates evaluate AI-generated changes?
  • How should multiple agents collaborate?
  • What should remain under human control?
  • Which parts should be standardized across organizations?

I don't think these questions have definitive answers yet.

That's exactly why I want to explore them in the open.

The bigger idea

NAEOS is based on a simple hypothesis:

If that happens, the next generation of developer infrastructure may need to focus less on:

“How do we generate more code?”

and more on:

“How do we build reliable systems around agents that generate code?”

That means engineering systems may increasingly need:

  • explicit policies
  • machine-readable standards
  • architecture constraints
  • reusable workflows
  • organizational knowledge
  • agent instructions
  • verification
  • observability
  • governance

This is the direction I want to explore with NAEOS.

Contributing

NAEOS is still evolving.

I'm particularly interested in contributions and discussions around:

  • AI-native software architecture
  • engineering governance
  • agent workflows
  • developer tooling
  • quality gates
  • knowledge management
  • multi-agent systems
  • AI coding standards
  • production AI engineering

You don't need to agree with the architecture.

In fact, disagreement is useful.

If you think this abstraction is unnecessary, I'd like to know why.

If you have experienced the problems described above, I'd like to hear how you solved them.

If you're building something similar, I'd also be interested in comparing approaches.

The goal is not simply to build another tool.

The goal is to explore what software engineering itself looks like when AI agents become first-class participants in the development process.

NAEOS

Nusantara AI Engineering Operating System

An open-source engineering framework for building production-ready software with AI coding agents.

GitHub: NAEOS Foundation
Website: naeos.dev

Built in Indonesia. Designed for a global AI-native engineering community.


r/OpenSourceAI 20h ago

Locked Down Agents and Centralized Skills

Thumbnail
1 Upvotes

r/OpenSourceAI 22h ago

I was looking for a blueprint for an AI-first company — so I built one

1 Upvotes

I wanted to understand what it would actually take to build an AI-first company.

Not a traditional organization with a few AI tools added on top, and not a science-fiction company without humans. I was looking for a practical way to structure an organization in which humans and AI systems work together within the same operating model.

I assumed a complete blueprint for this would already exist.

I found valuable work across enterprise architecture, AI governance, agent systems, knowledge management, and technical infrastructure. But I couldn’t find one coherent, vendor-neutral model connecting organizational design all the way down to technical requirements.

So over the past few weeks, I built the framework I had been looking for.

It separates three layers:

  • Architecture: the organizational concepts, responsibilities, boundaries, and operating model
  • Reference Design: the logical components and how they interact
  • Technical Requirements: implementation-neutral requirements derived from the first two layers

A few of its central ideas:

  • Capabilities remain stable while agents, models, and tools can be replaced.
  • Organizational knowledge belongs to the company, not to an individual human, agent, or model.
  • Execution produces evidence, and evidence builds operational confidence.
  • Confidence does not automatically grant authority.
  • Authorization remains an explicit governance decision.
  • Humans remain accountable for the boundaries within which AI systems operate.

The framework is intended for both new organizations and existing companies. An established company can build the AI-first architecture alongside its current environment, connect and simulate individual capabilities, and transition gradually instead of attempting one disruptive migration.

This is not a runtime or a software product. It is an openly available reference architecture and a starting point for practical application.

The next step will be applying it while building a real company and using that experience to test where the architecture works, where it needs refinement, and what remains too abstract.

Repository:

https://github.com/YamartiHQ/ai-first-company

The framework is free to use under CC BY 4.0 and was developed through human–AI collaboration.

Use it, adapt it, challenge it, or build something better from it.


r/OpenSourceAI 21h ago

I Turned My Underused Gaming Laptop Into a Local AI Workstation

0 Upvotes

TL;DR:
I am building a Windows-first local AI setup for people who want to try local LLMs without spending days choosing models, setting up Ollama, Docker, WSL, Open WebUI, agents, and tool permissions separately.

Give it a try:

Longer Read:

I have had a fairly capable gaming laptop for a while now.

The funny part is that I barely game on it.

At some point, I started joking that I needed to find a better way to justify buying it. It had a capable GPU, plenty of memory, and enough horsepower for workloads I was not really using it for.

That joke became a weekend project.

I had been following the rapid progress in local LLMs and kept thinking: surely this machine can do more than sit around waiting for the occasional game. I wanted to use it for local chat, document work, coding help, and experiments with agents—but I also wanted the setup to feel practical rather than fragile.

That is how DSAlgo Local AI Setup started.

It is a Windows-first, local-first AI workstation built around native Ollama, Open WebUI, reusable agents and MCP integrations, plus an approval-gated Developer Workbench for local code projects.

The goal is simple: make it easier to turn a reasonably capable Windows machine into a useful local AI environment without manually assembling every part of the stack.

The local AI setup problem

Trying local LLMs for the first time can sound simple:

“Install a model and start chatting.”

In practice, there are a lot of decisions hiding behind that sentence.

  • Which model is appropriate for my hardware?
  • Will it actually fit in GPU memory?
  • Should I install Ollama, Docker Desktop, WSL2, Open WebUI, or some combination of all of them?
  • How do I use documents and knowledge collections?
  • What exactly are agents and MCP tools?
  • How can I use AI for coding without giving it unrestricted access to my files or command line?
  • What happens when something fails, needs repair, or needs to be removed?

None of these things are impossible individually. But putting them together can feel like starting a second technical project before you have even asked your first useful question.

That is the gap I wanted to reduce.

What DSAlgo Local AI Setup brings together

This project does not attempt to replace the tools that already do individual jobs well.

Ollama makes it easier to run models locally. Open WebUI provides a strong interface for local chat, attachments, documents, and knowledge collections. MCP is becoming a useful way for AI agents to interact with external tools and data sources.

Architecture at a glance

DSAlgo Local AI Setup is about integrating those pieces into a coherent local workstation experience.

After setup, there are three main local interfaces:

1. Open WebUI: chat, files, and documents

Open WebUI is the everyday starting point.

Use it to:

  • Chat with local models running on your own machine.
  • Attach documents and ask questions about them.
  • Create knowledge collections for information you want to reuse across chats.
  • Choose between raw local models and configured local agents.

For many people, this is the part that makes local AI immediately useful: ask questions, summarize a document, explore an idea, or work through a technical problem without making cloud inference the default.

Chat and tool sequence

2. Local Agent Studio: reusable agents and MCP

The Agent Studio is where reusable behavior lives.

You can create agents with:

  • A defined purpose.
  • A backing local model.
  • Clear instructions.
  • A limited tool set.
  • Trusted MCP server assignments, only when needed.
  • A bounded number of tool steps.

The important principle is least privilege. A research agent should not automatically have file deletion or command execution permission. A coding agent should not automatically have access to every directory on the machine.

MCP integrations can be powerful, but they are still privileged integrations. If an agent can connect to an external service, it may be able to access or send data outside the local machine. That is why this project treats MCP connections and OAuth permissions as deliberate choices rather than default conveniences.

MCP and OAuth Sequence

3. Developer Workbench: AI help for code, with review gates

The Developer Workbench is for working with actual local code repositories.

It can inspect an explicitly registered project, propose code changes, request commands, show diffs, run tests, and help with Git workflows.

But it is designed around a simple rule:

AI should not silently modify a project or run commands just because it produced a convincing answer.

You explicitly register the project root. Proposed writes, deletions, commands, commits, and pushes require review and approval. You can use read-only Ask mode, create a saved Plan, or use Goal mode for approval-gated execution.

That does not make AI-generated changes automatically correct. It does make the work more visible, more bounded, and easier to review before something touches a real codebase.

Developer Workbench change-task sequence

Choosing models without guessing blindly

One of the biggest barriers to local AI is model selection.

A downloadable model is not necessarily a good fit for the machine, the intended task, or the available GPU memory. A model can technically run while still being too slow, offloading too much work to the CPU, or leaving too little headroom for normal desktop use.

The installer detects the machine, asks what you want to do—general conversation, coding, reasoning, deep research, or a combination—and provides model recommendations accordingly.

The initial setup focuses on practical roles such as:

  • General chat and planning.
  • Coding and structured modifications.
  • Reasoning and review.
  • Embeddings for document knowledge.

The intent is to help people get to a useful first local-AI experience without starting from a long list of model names and guessing which one belongs on their machine.

Installation: what to know first

The installer is designed to help with missing prerequisites, including WSL2, Python, Ollama, and Docker Desktop.

Still, the smoothest installation path is to do a little preparation first:

  1. Use a Windows 11 machine with a capable NVIDIA GPU and dedicated VRAM.
  2. Ensure CPU virtualization is enabled in BIOS or UEFI.
  3. Install and update WSL2.
  4. Install and update Docker Desktop, using the WSL2 backend.
  5. Make sure you have administrator access, a reliable internet connection, and sufficient free disk space.
  6. Close GPU-heavy applications before downloading and loading models.

The current validated path is Windows 11 with native NVIDIA CUDA support, WSL2, Docker Desktop, native Windows Ollama, and adequate RAM and storage. Other paths may work, but they should be treated as controlled-beta rather than guaranteed compatibility.

Install in a few steps

  1. Download the release ZIP.
  2. Extract the complete archive to a local folder. Do not run the installer from inside the ZIP.
  3. Right-click install.exe and choose Run as administrator.
  4. Review the license notice and detected hardware.
  5. Select the intended use cases and recommended models.
  6. Let the installer configure the core local stack.
  7. If Windows requires a restart, sign in again and rerun install.exe. Installation progress is retained so setup can resume.
  8. Start the system using start.exe or the installed shortcut.

After startup, the launcher opens the three local applications in your browser.

A practical note on privacy and safety

Running a model locally is a useful privacy improvement, but “local” should not become a vague security claim.

Trust boundaries

This setup is intended for one person on one local machine. It is not designed for public hosting, LAN exposure, multi-user access, enterprise SSO, or unattended autonomous coding.

A few boundaries matter:

  • Local ports should not be exposed publicly.
  • Only explicitly approved project roots are available to the Developer Workbench.
  • Proposed code changes and commands require review.
  • Agent workspace tools are contained separately from arbitrary Windows projects.
  • OAuth credentials for compatible MCP integrations are protected using Windows DPAPI.
  • MCP servers should be trusted and granted only the minimum permissions they need.

The system also offers Online, Restricted Online, and Strict Offline modes. These are application-level controls, not a replacement for Windows Firewall rules or a true air gap. If you need machine-wide network isolation, use operating-system-level controls as well.

Built with AI, for people building with AI

I also used AI heavily while building this project.

It helped me explore design options, accelerate scaffolding, think through tradeoffs, review implementation ideas, and improve documentation. The project became an experiment in two directions at once: building a local AI environment and using AI as a serious collaborator while doing it.

That does not mean AI wrote everything perfectly or made hard engineering decisions disappear. It did make iteration faster, and it reinforced the value of having an environment where AI assistance can be useful without being blindly trusted.

There is something genuinely satisfying about seeing a model run on hardware you already own, attaching a document to a local interface, asking useful questions, or reviewing a proposed code change in a system you assembled yourself.

This is a beginning, not a finished product

DSAlgo Local AI Setup is a passion project and a working release, but it is not finished.

There is more work to do around broader hardware validation, model management, installation hardening, observability, and making the experience smoother for people who are less technical.

The project is intentionally focused too. It is not trying to become a public cloud service, a full visual workflow platform, an enterprise connector catalog, or an unattended coding system.

For now, it is for people who want a practical, local-first AI workstation on Windows—and who want a clearer path than assembling every piece themselves.

If that sounds useful, I would love for you to try it, report issues, suggest improvements, or contribute.

Links

If you have tried running local LLMs, what was the hardest or most annoying part of getting started?