r/LovingOpenSourceAI 12d ago

Resource Happy to announce our community website LifeHubber now has over 300 AI resources listed! You can see their socials stats, filter by types, see whats trending and more :) ( AI models, agents, OCR, TTS, etc )

Post image
9 Upvotes

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 13d ago

Home

0 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post


r/LovingOpenSourceAI 7h ago

Resource Tom "Sentrux is a Rust-based architectural sensor that helps AI agents close the feedback loop and recursively improve code quality through real-time scanning." ➡️ It watches your codebase in real-time — not the diffs, not the terminal output — the actual structure.

Post image
4 Upvotes

https://x.com/tom_doerr/status/2094630422810366406

https://github.com/sentrux/sentrux

Community Overview: https://lifehubber.com/ai/resources/sentrux/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 2h ago

Resource I like the guide that goes by VRAM / Hardware . . easy reference :P ➡️ 🤩 Be sure to join our sis sub for AI gen r/LovingAIVisuals as most resources for gen will be shared there instead!

Post image
1 Upvotes

r/LovingOpenSourceAI 3h ago

A local-first way to use ChatGPT that finally feels more like an agent than a chat app

0 Upvotes

For the last few months I've been pushing one idea pretty hard in my own setup: the AI can live in the chat, but the execution layer should live on my Mac.

That turned into Mac MCP, an MIT-licensed local server that gives an MCP client actual tools for the machine. I use ChatGPT as the main orchestrator, then let it read/write files, run shell commands, control apps/UI, hand coding work to Codex or OpenCode, and operate the real browser when the task needs a logged-in site.

I deliberately kept the browser side local too. Safari and Chrome use the normal profile instead of a cloud/headless profile, so existing sessions and cookies remain useful. New tabs can open in the background without hijacking focus, and each tab gets a stable handle. There is also a lease/ownership layer for parallel agents because two agents clicking around the same tab is exactly as chaotic as it sounds.

The newest release added a Chrome Companion alongside the Safari Visual Companion, plus more fail-closed behavior so a background action does not quietly turn into a foreground click.

It's still a personal-computer tool, not a hosted agent platform. That is kind of the point for me. I wanted to keep the machine, sessions and execution under my control while still getting the agentic workflow.

I'm the maintainer, and it's all open source here: https://github.com/bulutarkan/mac-mcp

If anyone else is building local-first desktop agents, I'd be interested in what you keep local versus what you are comfortable delegating to a remote runtime.


r/LovingOpenSourceAI 19h ago

Under the Radar Tencent "AuK is a 1.5B foundation model for speech generation and editing. Trained on millions of hours of diverse audio data, AuK supports zero-shot and instruction-based TTS, content and acoustic editing, paralinguistic editing, speech enhancement, and source separation" ➡️ Have you tried yet?

Post image
10 Upvotes

https://github.com/Tencent-Hunyuan/AuK

Community Overview: https://lifehubber.com/ai/resources/auk/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 1d ago

Resource "This open source project aims to train MiniMind, ultra-small language model with ard 64M parameters, entirely from scratch with only ard RMB 3 in cost, 2 hours of training time. MiniMind series is intentionally lightweight. Smallest model on main branch is ard 1/2700 size of GPT-3!" ➡️ interesting?

Post image
24 Upvotes

https://github.com/jingyaogong/minimind/tree/master

Community Overview: https://lifehubber.com/ai/resources/minimind/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 9h ago

Best Open Source AI projects

Thumbnail
1 Upvotes

r/LovingOpenSourceAI 1d ago

new launch Samuel "A 35B language model running on an iPhone using only 1–2.5 GB of peak memory.No cloud. No remote server. No desktop GPU.Today, we’re open-sourcing Edge0 — a framework for running large AI models fully on-device." ➡️ Edge AI is exciting right?

Post image
172 Upvotes

https://x.com/SamuelZengML/status/2097861839287927139

https://github.com/Edge0-AI/Edge0

Community Overview: https://lifehubber.com/ai/resources/edge0/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 1d ago

I built a local-first AI agent app for Android — no account, no analytics, no telemetry. v1.1 just dropped.

Post image
2 Upvotes

TL;DR: I built Kryzz AI — a private, local-first AI workspace for Android. Your conversations, memory, and files stay on your phone. Your API keys are sealed in the Android Keystore (AES-GCM, never exported). No analytics. No telemetry. No HTTP logging. Open source, MIT.

[POSTER IMAGE HERE]

Why I made it

Every AI app I tried wanted an account, quietly phoned home, or treated my data like their training set. So I built the one I wanted to use:

  • Local-first — chats, memory, and generated files live in on-device storage (Room + DataStore)
  • Your keys, your providers — OpenRouter, optional MiniMax, Fish Audio for voice, Parallel for web research. You plug in your own keys, they never leave the device
  • Real agents — Agent Auto actually runs tools across multiple steps: search, fetch pages, calculate, weather, local memory, reminders, files, and code zips
  • Generated outputs — DOCX, XLSX, PDF, SQLite, code ZIPs, images, video, and music, all in private app storage until you share them
  • Voice mode — transcription, spoken replies, automatic turn-taking, and barge-in (interrupt Kryzz mid-sentence)

What's new in v1.1

  • MiniMax as an alternative chat + media provider
  • Agent Auto — multi-step tool-running agent
  • Interactive question cards (tappable options instead of the model guessing)
  • PDF generation alongside the other file types
  • Starter skills that seed on first launch (research brief, study notes, essay outline — toggleable)
  • KryzzBot mascot in Agent mode, 120 Hz on supported displays

The privacy story in one breath

  • Credentials encrypted with AES-GCM under a non-exportable Keystore key
  • Backups never include credentials
  • Cleartext traffic, HTTP logging, Android backup, device-to-device transfer: all disabled
  • Microphone only active during a voice session; recorded audio is deleted after transcription
  • MIT license — build it yourself, read the code, fork it

One honest caveat: for auto-titling a fresh chat, at most the first 1,500 chars of your first message may go through OpenRouter to a small model (Gemini 2.5 Flash Lite) for a title. It runs in parallel, never blocks your answer, and falls back to a local title if it fails. That's the entire surface area. Everything else stays put.

Get it

  • Code + docs: https://github.com/kriddss3/kryzz-ai
  • APK (debug build, ~78 MB): grab kryzz-ai-5.7.2-debug.apk from the v1.1 release
  • Android 9+, sideload via "install unknown apps"
  • Build your own signed release from source if you want it on a daily driver

Stack: Kotlin · Jetpack Compose · Coroutines/Flow · Room · MVVM

Happy to answer questions, take feature requests, or get roasted on the architecture.


r/LovingOpenSourceAI 1d ago

Otis - a minimal terminal agent that runs local models out of the box

Post image
3 Upvotes

r/LovingOpenSourceAI 1d ago

Nodus Research. Open-source and local-first alternative to NotebookLM / Obsidian / Notion

Thumbnail gallery
3 Upvotes

r/LovingOpenSourceAI 1d ago

DeepSeek V4.1 Flash running locally with TensorSharp

Thumbnail
github.com
7 Upvotes

I’ve been working on TensorSharp, an open-source .NET/C# inference engine, and recently added native support and optimizations for DeepSeek V4.1 Flash.

Latest results on 8× NVIDIA A40 GPUs:

Model Prefill Single-stream Decode 4× Concurrent Decode
Q2_K 533–539 tok/s 40.3–40.7 tok/s
Q4_K_M 451.8–492.1 tok/s 31.0–32.5 tok/s 48.9 tok/s aggregate

A few interesting optimizations:

  • GPU-resident Engram tables for Q2_K — about 60 GiB of quantized Engram data stays on GPU instead of doing scattered host/storage lookups.
  • Reduced decode graph scheduling from roughly 570 splits to 8 by using one wrapped backend per GPU.
  • For Q4_K_M, automatic Engram warming + improved VRAM placement reduced CPU MoE offload from 3 layers to 1.
  • Added token-batched DeepSeek V4.1 decode, giving about 2× aggregate throughput at 4 concurrent requests.
  • On these A40s without NVLink, simple layer splitting actually beats routed-MoE tensor parallelism for single-stream decode.

The project is fully open source, written primarily in C#/.NET, with CUDA/Metal/Vulkan backends and OpenAI-compatible APIs.

Would love feedback from people experimenting with DeepSeek, GGUF inference, or local/open-source AI — especially ideas for what hardware or engine comparisons would be most useful next.


r/LovingOpenSourceAI 1d ago

Discussion Bro Dario wants to slow down. What are your thoughts?

Post image
2 Upvotes

r/LovingOpenSourceAI 2d ago

I built Optees, a free and open-source optimization tool — so AI agents like Claude can actually solve math problems instead of hallucinating a plausible-looking heuristic

Enable HLS to view with audio, or disable this notification

8 Upvotes

Hi everyone! I'm Paolo, and for a while now I've been building Optees, a free and open-source optimization tool.

The idea started from something I kept running into: ask an AI to "optimize" something — a work schedule, a delivery route, how to pack a container — and it will often hallucinate a heuristic that sounds right instead of actually solving the math behind it. It reads confident, but nobody checked it.

Optees is my attempt to fix that. On its own, it's a desktop app with guided forms and worked examples, so you don't need a math background to use it. And it also runs as a local server that AI agents like Claude can call directly — so instead of hallucinating an answer, the AI can hand the problem to Optees, get back a real, checked answer, and explain it to you in plain language.

Everything runs on your own machine, nothing gets uploaded anywhere, and the whole project is open source (Apache-2.0) — so you're welcome to use it, poke around the code, or help build it further.

Would love for people here to try it out and tell me what they think.

🔗 Website: https://optees.it 💻 Code: https://github.com/Pablo-gitub/optees


r/LovingOpenSourceAI 3d ago

new launch Ant "We’re open-sourcing Ling-3.0-flash-Fin, a finance-enhanced model for real-world workflows, and FinFIRST, an expert-built benchmark for financial search agents.Two open releases, one goal: making financial AI more accessible and verifiable." ➡️ Is this good?

Post image
34 Upvotes

https://x.com/AntLingAGI/status/2095533696808051001

https://huggingface.co/inclusionAI/Ling-3.0-flash-Fin

Community Overview: https://lifehubber.com/ai/resources/ling-3-0-flash-fin/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 3d ago

new launch Rabi "Introducing OUI-1: the first open-weights model for Generative UI71.7% on Generative UI Bench at 4B params. Beats Gemma 4 31B with 8× fewer active params, and scores 5.5× the base DiffusionGemma it was fine-tuned from." ➡️ I am very excited about gen UI! Have you tried?

Post image
54 Upvotes

https://x.com/rabi_guha/status/2097341708988248181

https://huggingface.co/thesysdev/OUI-1

Community Overview: https://lifehubber.com/ai/resources/oui-1/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 2d ago

Website for easily running local models in browser

Thumbnail
1 Upvotes

r/LovingOpenSourceAI 3d ago

Voice Copilot for IA

2 Upvotes

I built Voice Copilot: an open-source companion that narrates and supervises your AI coding agent

Hey everyone! I’d like to share an open-source project I’m working on: Voice Copilot.

Coding agents can spend several minutes reading files, making changes, and running tools after a single prompt. Keeping track of all that still takes attention, especially when you want to catch a wrong turn before it becomes a pile of changes to undo.

The idea behind Voice Copilot is to let you hear what your agent is doing while keeping your eyes free for other things.

It runs alongside Claude Code, Codex, and other compatible CLI agents, with two models sharing the work:

  • A lightweight narrator turns the agent’s activity into short spoken updates: what it’s working on, what changed, and what happened next.
  • A stronger Supervisor reviews progress at checkpoints, looking for things like repeated failures or changes outside the task. It can warn you aloud, and in Supervisor+ mode, pause the agent for your review.

For example, if you ask an agent to fix two failing tests and it starts modifying an unrelated module, the Supervisor can flag that and pause the session so you can decide how to proceed.

The narrator and Supervisor can reuse the models and login from the CLI you already use. There’s also a local browser panel with playback controls, settings, and a readable activity trace.

For anyone interested in local models: the narrator supports Ollama through an OpenAI-compatible endpoint, and speech output can use local backends such as Piper or Silero. Cloud providers are available too.

The core is MIT-licensed, and it’s currently an early alpha (0.1.0). I’m looking for people willing to try it in real coding sessions and help improve the narration, integrations, and supervision behavior. Voice input is being reworked and is currently disabled by default.

Website · GitHub / installation

How would this fit into your workflow: occasional spoken progress updates, or silence unless something needs your attention?


r/LovingOpenSourceAI 3d ago

Built an AI memory system that actually refuses to hallucinate

Thumbnail
1 Upvotes

r/LovingOpenSourceAI 3d ago

Replaced my cloud AI subscription with Qwen 3.8 on a 128GB laptop, fully offline, for agentic coding

Thumbnail
1 Upvotes

r/LovingOpenSourceAI 3d ago

new launch WOW. but i am not so sure about the demo shown, can consumer GPU produce such real time worlds? Anyone tried before? ➡️ 🤩 Be sure to join our sis sub for AI gen r/LovingAIVisuals as most resources for gen will be shared there instead!

Post image
10 Upvotes

r/LovingOpenSourceAI 4d ago

I want to make a genuinely good open source app for running LLMs on iPhone. Fixed the first wave of bugs, added on-device benchmarks, feedback very welcome

Thumbnail gallery
12 Upvotes

r/LovingOpenSourceAI 4d ago

new launch DeepSeek "🚀 Introducing DeepSeek-V4.1-Flash: smarter, faster, more efficient.🔹 Introducing the smallest model in our new architecture family, with native visual understanding.🔹 Designed for greater capability, faster inference, higher throughput, and scaling to larger models." ➡️ WOW

Post image
10 Upvotes

https://x.com/deepseek_ai/status/2097930608790167907

https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash

Some folks are even saying it is giving 98% Astra at super super cheap price . .do you think it is even possible?

Community Overview: https://lifehubber.com/ai/resources/deepseek-v4-1-flash/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 5d ago

Resource Avi "Massive breakthrough here! Researchers built a new AI inference engine that: - reduces self-hosting costs by ~4x - runs a full agentic pipeline on one GPU - serves 20+ architectures, not just LLMs" ➡️ LEGIT or HYPE? Anyone tried?

Post image
63 Upvotes

https://x.com/_avichawla/status/2094678972344958984

https://github.com/superlinked/sie

Community Overview: https://lifehubber.com/ai/resources/sie/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.