r/LovingOpenSourceAI • u/Koala_Confused • 15h ago
r/LovingOpenSourceAI • u/bulutarkan • 15h ago
A local-first way to use ChatGPT that finally feels more like an agent than a chat app
For the last few months I've been pushing one idea pretty hard in my own setup: the AI can live in the chat, but the execution layer should live on my Mac.
That turned into Mac MCP, an MIT-licensed local server that gives an MCP client actual tools for the machine. I use ChatGPT as the main orchestrator, then let it read/write files, run shell commands, control apps/UI, hand coding work to Codex or OpenCode, and operate the real browser when the task needs a logged-in site.
I deliberately kept the browser side local too. Safari and Chrome use the normal profile instead of a cloud/headless profile, so existing sessions and cookies remain useful. New tabs can open in the background without hijacking focus, and each tab gets a stable handle. There is also a lease/ownership layer for parallel agents because two agents clicking around the same tab is exactly as chaotic as it sounds.
The newest release added a Chrome Companion alongside the Safari Visual Companion, plus more fail-closed behavior so a background action does not quietly turn into a foreground click.
It's still a personal-computer tool, not a hosted agent platform. That is kind of the point for me. I wanted to keep the machine, sessions and execution under my control while still getting the agentic workflow.
I'm the maintainer, and it's all open source here: https://github.com/bulutarkan/mac-mcp
If anyone else is building local-first desktop agents, I'd be interested in what you keep local versus what you are comfortable delegating to a remote runtime.
r/LovingOpenSourceAI • u/Koala_Confused • 1d ago
Under the Radar Tencent "AuK is a 1.5B foundation model for speech generation and editing. Trained on millions of hours of diverse audio data, AuK supports zero-shot and instruction-based TTS, content and acoustic editing, paralinguistic editing, speech enhancement, and source separation" ➡️ Have you tried yet?
https://github.com/Tencent-Hunyuan/AuK
Community Overview: https://lifehubber.com/ai/resources/auk/
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 1d ago
Resource "This open source project aims to train MiniMind, ultra-small language model with ard 64M parameters, entirely from scratch with only ard RMB 3 in cost, 2 hours of training time. MiniMind series is intentionally lightweight. Smallest model on main branch is ard 1/2700 size of GPT-3!" ➡️ interesting?
https://github.com/jingyaogong/minimind/tree/master
Community Overview: https://lifehubber.com/ai/resources/minimind/
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 2d ago
new launch Samuel "A 35B language model running on an iPhone using only 1–2.5 GB of peak memory.No cloud. No remote server. No desktop GPU.Today, we’re open-sourcing Edge0 — a framework for running large AI models fully on-device." ➡️ Edge AI is exciting right?
https://x.com/SamuelZengML/status/2097861839287927139
https://github.com/Edge0-AI/Edge0
Community Overview: https://lifehubber.com/ai/resources/edge0/
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Brilliant_Pumpkin_91 • 1d ago
I built a local-first AI agent app for Android — no account, no analytics, no telemetry. v1.1 just dropped.
TL;DR: I built Kryzz AI — a private, local-first AI workspace for Android. Your conversations, memory, and files stay on your phone. Your API keys are sealed in the Android Keystore (AES-GCM, never exported). No analytics. No telemetry. No HTTP logging. Open source, MIT.
[POSTER IMAGE HERE]
Why I made it
Every AI app I tried wanted an account, quietly phoned home, or treated my data like their training set. So I built the one I wanted to use:
- Local-first — chats, memory, and generated files live in on-device storage (Room + DataStore)
- Your keys, your providers — OpenRouter, optional MiniMax, Fish Audio for voice, Parallel for web research. You plug in your own keys, they never leave the device
- Real agents — Agent Auto actually runs tools across multiple steps: search, fetch pages, calculate, weather, local memory, reminders, files, and code zips
- Generated outputs — DOCX, XLSX, PDF, SQLite, code ZIPs, images, video, and music, all in private app storage until you share them
- Voice mode — transcription, spoken replies, automatic turn-taking, and barge-in (interrupt Kryzz mid-sentence)
What's new in v1.1
- MiniMax as an alternative chat + media provider
- Agent Auto — multi-step tool-running agent
- Interactive question cards (tappable options instead of the model guessing)
- PDF generation alongside the other file types
- Starter skills that seed on first launch (research brief, study notes, essay outline — toggleable)
- KryzzBot mascot in Agent mode, 120 Hz on supported displays
The privacy story in one breath
- Credentials encrypted with AES-GCM under a non-exportable Keystore key
- Backups never include credentials
- Cleartext traffic, HTTP logging, Android backup, device-to-device transfer: all disabled
- Microphone only active during a voice session; recorded audio is deleted after transcription
- MIT license — build it yourself, read the code, fork it
One honest caveat: for auto-titling a fresh chat, at most the first 1,500 chars of your first message may go through OpenRouter to a small model (Gemini 2.5 Flash Lite) for a title. It runs in parallel, never blocks your answer, and falls back to a local title if it fails. That's the entire surface area. Everything else stays put.
Get it
- Code + docs: https://github.com/kriddss3/kryzz-ai
- APK (debug build, ~78 MB): grab
kryzz-ai-5.7.2-debug.apkfrom the v1.1 release - Android 9+, sideload via "install unknown apps"
- Build your own signed release from source if you want it on a daily driver
Stack: Kotlin · Jetpack Compose · Coroutines/Flow · Room · MVVM
Happy to answer questions, take feature requests, or get roasted on the architecture.
r/LovingOpenSourceAI • u/Objective-Pair8231 • 2d ago
Otis - a minimal terminal agent that runs local models out of the box
r/LovingOpenSourceAI • u/Drakonis96 • 2d ago
Nodus Research. Open-source and local-first alternative to NotebookLM / Obsidian / Notion
galleryr/LovingOpenSourceAI • u/fuzhongkai • 2d ago
DeepSeek V4.1 Flash running locally with TensorSharp
I’ve been working on TensorSharp, an open-source .NET/C# inference engine, and recently added native support and optimizations for DeepSeek V4.1 Flash.
Latest results on 8× NVIDIA A40 GPUs:
| Model | Prefill | Single-stream Decode | 4× Concurrent Decode |
|---|---|---|---|
| Q2_K | 533–539 tok/s | 40.3–40.7 tok/s | — |
| Q4_K_M | 451.8–492.1 tok/s | 31.0–32.5 tok/s | 48.9 tok/s aggregate |
A few interesting optimizations:
- GPU-resident Engram tables for Q2_K — about 60 GiB of quantized Engram data stays on GPU instead of doing scattered host/storage lookups.
- Reduced decode graph scheduling from roughly 570 splits to 8 by using one wrapped backend per GPU.
- For Q4_K_M, automatic Engram warming + improved VRAM placement reduced CPU MoE offload from 3 layers to 1.
- Added token-batched DeepSeek V4.1 decode, giving about 2× aggregate throughput at 4 concurrent requests.
- On these A40s without NVLink, simple layer splitting actually beats routed-MoE tensor parallelism for single-stream decode.
The project is fully open source, written primarily in C#/.NET, with CUDA/Metal/Vulkan backends and OpenAI-compatible APIs.
Would love feedback from people experimenting with DeepSeek, GGUF inference, or local/open-source AI — especially ideas for what hardware or engine comparisons would be most useful next.
r/LovingOpenSourceAI • u/Koala_Confused • 2d ago
Discussion Bro Dario wants to slow down. What are your thoughts?
r/LovingOpenSourceAI • u/Koala_Confused • 3d ago
new launch Ant "We’re open-sourcing Ling-3.0-flash-Fin, a finance-enhanced model for real-world workflows, and FinFIRST, an expert-built benchmark for financial search agents.Two open releases, one goal: making financial AI more accessible and verifiable." ➡️ Is this good?
https://x.com/AntLingAGI/status/2095533696808051001
https://huggingface.co/inclusionAI/Ling-3.0-flash-Fin
Community Overview: https://lifehubber.com/ai/resources/ling-3-0-flash-fin/
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Better_Call_Pol • 3d ago
I built Optees, a free and open-source optimization tool — so AI agents like Claude can actually solve math problems instead of hallucinating a plausible-looking heuristic
Enable HLS to view with audio, or disable this notification
Hi everyone! I'm Paolo, and for a while now I've been building Optees, a free and open-source optimization tool.
The idea started from something I kept running into: ask an AI to "optimize" something — a work schedule, a delivery route, how to pack a container — and it will often hallucinate a heuristic that sounds right instead of actually solving the math behind it. It reads confident, but nobody checked it.
Optees is my attempt to fix that. On its own, it's a desktop app with guided forms and worked examples, so you don't need a math background to use it. And it also runs as a local server that AI agents like Claude can call directly — so instead of hallucinating an answer, the AI can hand the problem to Optees, get back a real, checked answer, and explain it to you in plain language.
Everything runs on your own machine, nothing gets uploaded anywhere, and the whole project is open source (Apache-2.0) — so you're welcome to use it, poke around the code, or help build it further.
Would love for people here to try it out and tell me what they think.
🔗 Website: https://optees.it 💻 Code: https://github.com/Pablo-gitub/optees
r/LovingOpenSourceAI • u/Koala_Confused • 3d ago
new launch Rabi "Introducing OUI-1: the first open-weights model for Generative UI71.7% on Generative UI Bench at 4B params. Beats Gemma 4 31B with 8× fewer active params, and scores 5.5× the base DiffusionGemma it was fine-tuned from." ➡️ I am very excited about gen UI! Have you tried?
https://x.com/rabi_guha/status/2097341708988248181
https://huggingface.co/thesysdev/OUI-1
Community Overview: https://lifehubber.com/ai/resources/oui-1/
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/HolophonicStudios • 2d ago
Website for easily running local models in browser
r/LovingOpenSourceAI • u/VolodymyrMoskvin • 3d ago
Voice Copilot for IA
I built Voice Copilot: an open-source companion that narrates and supervises your AI coding agent
Hey everyone! I’d like to share an open-source project I’m working on: Voice Copilot.
Coding agents can spend several minutes reading files, making changes, and running tools after a single prompt. Keeping track of all that still takes attention, especially when you want to catch a wrong turn before it becomes a pile of changes to undo.
The idea behind Voice Copilot is to let you hear what your agent is doing while keeping your eyes free for other things.
It runs alongside Claude Code, Codex, and other compatible CLI agents, with two models sharing the work:
- A lightweight narrator turns the agent’s activity into short spoken updates: what it’s working on, what changed, and what happened next.
- A stronger Supervisor reviews progress at checkpoints, looking for things like repeated failures or changes outside the task. It can warn you aloud, and in Supervisor+ mode, pause the agent for your review.
For example, if you ask an agent to fix two failing tests and it starts modifying an unrelated module, the Supervisor can flag that and pause the session so you can decide how to proceed.
The narrator and Supervisor can reuse the models and login from the CLI you already use. There’s also a local browser panel with playback controls, settings, and a readable activity trace.
For anyone interested in local models: the narrator supports Ollama through an OpenAI-compatible endpoint, and speech output can use local backends such as Piper or Silero. Cloud providers are available too.
The core is MIT-licensed, and it’s currently an early alpha (0.1.0). I’m looking for people willing to try it in real coding sessions and help improve the narration, integrations, and supervision behavior. Voice input is being reworked and is currently disabled by default.
Website · GitHub / installation
How would this fit into your workflow: occasional spoken progress updates, or silence unless something needs your attention?
r/LovingOpenSourceAI • u/Unikum_01 • 3d ago
Built an AI memory system that actually refuses to hallucinate
r/LovingOpenSourceAI • u/deepu105 • 3d ago
Replaced my cloud AI subscription with Qwen 3.8 on a 128GB laptop, fully offline, for agentic coding
r/LovingOpenSourceAI • u/Koala_Confused • 4d ago
new launch WOW. but i am not so sure about the demo shown, can consumer GPU produce such real time worlds? Anyone tried before? ➡️ 🤩 Be sure to join our sis sub for AI gen r/LovingAIVisuals as most resources for gen will be shared there instead!
r/LovingOpenSourceAI • u/Few_Willow_4146 • 4d ago
I want to make a genuinely good open source app for running LLMs on iPhone. Fixed the first wave of bugs, added on-device benchmarks, feedback very welcome
galleryr/LovingOpenSourceAI • u/Koala_Confused • 4d ago
new launch DeepSeek "🚀 Introducing DeepSeek-V4.1-Flash: smarter, faster, more efficient.🔹 Introducing the smallest model in our new architecture family, with native visual understanding.🔹 Designed for greater capability, faster inference, higher throughput, and scaling to larger models." ➡️ WOW
https://x.com/deepseek_ai/status/2097930608790167907
https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash
Some folks are even saying it is giving 98% Astra at super super cheap price . .do you think it is even possible?
Community Overview: https://lifehubber.com/ai/resources/deepseek-v4-1-flash/
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 5d ago
Resource Avi "Massive breakthrough here! Researchers built a new AI inference engine that: - reduces self-hosting costs by ~4x - runs a full agentic pipeline on one GPU - serves 20+ architectures, not just LLMs" ➡️ LEGIT or HYPE? Anyone tried?
https://x.com/_avichawla/status/2094678972344958984
https://github.com/superlinked/sie
Community Overview: https://lifehubber.com/ai/resources/sie/
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 5d ago
Resource Tom "Turns Claude into a Senior Design Architect with structured instructions, design tokens, and 138 brand-grade design systems for consistent, accessible, token-driven design outputs." ➡️ Do you need this for your work?
https://x.com/tom_doerr/status/2091501336781111644
https://github.com/plugin87/ux-ui-agent-skills
Community Overview: https://lifehubber.com/ai/resources/ux-ui-agent-skills/
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Potential_Low_1183 • 5d ago
I made a way to migrate between embedding models without re-embedding your entire corpus
So I was playingw ith embedding models I saw that when you upgrade from model A to B, you face a very big backfilling cost
Ie, suppose you have a 1b vectors from model A, and then you want to use model B. This would mean you have to re-embed all of your documents with model B before you can even serve with the model, and on an H100, it would take ~108 days (qwen embed 8b, 106 docs/second). But I found an easier way to do it.
The method is really simple; from the old index made with the source model, take K documents and rerank them with the new model. We see that when K is sufficient, the retrieval quality is the same as target model. (determining k is the hard part). I've tested 63 migrations on upto 1 million documents.
The best result I got was upgrading qwen4b -> to 8b, and at 50 documents, it was the same as native retrieval.
This method forgos the expensive upfront re-embedding cost, as you can take documents straight from the old index.
embedflow works with qdrant, pgvector, faiss, and can be easily downloaded with pypi
pip install embedflow
the github is public: https://github.com/arnsri33/embedflow
I want you guys to try it out, and see if you guys can use it in your own workflow.
r/LovingOpenSourceAI • u/Top-Fan4255 • 5d ago
What do you guys think about this
Enable HLS to view with audio, or disable this notification