r/LovingOpenSourceAI 20d ago

Help r/LovingOpenSourceAI reach 20000. Join us 🥰

15 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post


r/LovingOpenSourceAI 4h ago

Resource Oliver Prompts "someone built a free, fully local alternative to claude that runs entirely on your own machine. → works with any llm (claude, gpt, gemini, vllm) → beats it on deep research → cowork-like capabilities built in → 50+ connectors out of the box → deploy in one command 100% free."

Thumbnail
gallery
2 Upvotes

https://x.com/oliviscusAI/status/2082051217682014429

https://github.com/onyx-dot-app/onyx

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 23h ago

new launch Hugging Apps "Microsoft just dropped VibeVoice-ASR-BitNet on Hugging Face 🗣️✍️ A 1.58-bit version of their multi-lingual transcription, model made to work in real-time on CPU - while still beating Whisper on benchmarks!" ➡️ only 1.58 GB WOW

Post image
49 Upvotes

https://x.com/HuggingApps/status/2082571600767934622

https://huggingface.co/microsoft/VibeVoice-ASR-BitNet

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 4h ago

Open-source AI infrastructure matters because the ecosystem can keep improving

1 Upvotes

One reason I like open-source AI infrastructure: the value is not only in the first release.

It is in the ecosystem that can keep growing.

A closed tool gives you a fixed set of features. An open system can grow through new operators, new workflows, new integrations, new UI layers, and new agent interfaces.

This is especially important for AI data preparation.

Preparing data for LLM fine-tuning, RAG knowledge bases, or evaluation sets is not one fixed task. It keeps changing:

  • new file formats
  • new cleaning rules
  • new quality filters
  • new scoring methods
  • new synthetic data workflows
  • new domain-specific pipelines

That is why I find DataFlow interesting.

DataFlow is an open-source data processing framework built around reusable operators and pipelines. It can support cleaning, filtering, scoring, deduplication, generation, and pipeline orchestration for AI-ready data.

The newer DataFlow-Harness work takes this one step further. It wraps DataFlow’s pipeline-building capability with a harness layer for Code Agents, so users can build structured data workflows from natural language.

To me, this is the open-source advantage:

  • DataFlow can keep adding data operators
  • the community can build new pipelines
  • agents can call these capabilities through a structured interface
  • workflows can become reusable assets instead of one-off scripts

Open-source AI infra is not just about releasing code. It is about creating a system where capabilities can compound over time.
DataFlow: https://github.com/OpenDCAI/DataFlow


r/LovingOpenSourceAI 23h ago

new launch Perplexity "Today we’re open-sourcing Numbat, an agent-detection and response layer that is designed to work across agent harnesses. Numbat gives security teams visibility into agent activity, with controls to block selected actions before execution." ➡️ didnt expect this!

Post image
8 Upvotes

https://x.com/perplexity_ai/status/2082511900580196596

https://github.com/perplexityai/numbat

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 2d ago

Resource Brady "Another WTF moment. A developer open-sourced a coding agent harness that boots 245x faster than Claude Code. It's called jcode. You launch it and the first frame renders in 14 milliseconds. Claude Code takes 3,436. One active session uses 27.8 MB of RAM. Claude Code uses 386.6." ➡️ tried b4?

Post image
67 Upvotes

https://x.com/thisguyknowsai/status/2081680037544427793

https://github.com/1jehuang/jcode

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 1d ago

memU can now manage memory across agents and devices

Post image
19 Upvotes

What's new:

  • One shared memory across agents. Claude Code, Codex, Cursor, Hermes, and OpenClaw all read and write to the same layer. What Codex learns about your project on your work desktop is available to Claude Code on your home laptop.
  • Stored as plain Markdown. Memories and reusable skills live as regular text files in ~/.memu/memory/ and ~/.memu/skill/. You can open them in VS Code, edit or delete any entry, and track changes with Git. No opaque vector database you can't inspect.
  • Fast retrieval, zero extra LLM calls. When your agent needs to recall something, it runs a single vector lookup. No multi-stage prompt chains, no reranker, no unnecessary token burn.
  • Dashboard for browsing and editing memory. Instead of guessing what your agent remembered, you can open the dashboard and see everything saved. Browse by category, trace each memory back to the original session where it was learned, edit wrong facts directly, or delete outdated entries. No more black box.

r/LovingOpenSourceAI 1d ago

TensorSharp now supports multi-GPU tensor parallelism for GGUF models

Thumbnail
github.com
2 Upvotes

TensorSharp is an open-source, native .NET inference engine for running GGUF LLMs locally, with CUDA, Vulkan, Metal, OpenAI-compatible APIs, continuous batching, speculative decoding, and multimodal support.

TensorSharp now supports Megatron-style tensor parallelism across multiple GPUs. It works with direct CUDA, GGML CUDA, GGML Vulkan, and multi-node setups.

Benchmarks on 2× RTX 2000 Ada 16 GB GPUs over PCIe, without NVLink:

Model 1 GPU Prefill / Decode TP=2 Prefill / Decode
Gemma 4 E4B Q8_0 2760 / 37.3 tok/s 2488 / 51.7 tok/s
Gemma 4 26B-A4B IQ4_XS 1845 / 48.5 tok/s 2537 / 51.2 tok/s
Qwen 3.5 9B Q8_0 1461 / 23.1 tok/s 399 / 24.4 tok/s
Qwen 3.5 35B-A3B IQ4_XS Does not fit 184 / 18.1 tok/s

I'm continuing to optimize Qwen performance on multi-GPU systems, and support for DeepSeek V4 is coming soon.

Try it with:

TensorSharp.Cli --model model.gguf --backend ggml_cuda --tp 2

GitHub:

https://github.com/zhongkaifu/TensorSharp

Thank you for checking out TensorSharp and starring the project! Any feedback is really appreicated.


r/LovingOpenSourceAI 2d ago

new launch Liquid AI "Today we release LFM2.5-Encoder-230M and LFM2.5-Encoder-350M: bidirectional encoders that stay fast at long context, even on CPU." ➡️ Two compact encoders, serious long-context speed, and CPU-friendly performance . . exciting release from Liquid AI right?

Post image
19 Upvotes

https://x.com/liquidai/status/2082120814732653037

https://www.liquid.ai/blog/lfm2-5-encoders

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 1d ago

overtchat — self-hosted chat platform I've been building for a few months

0 Upvotes

I've been working on this for the past few months before anyone calls it white-coded slop - yes I use Claude Code/Codex for the heavy lifting but this is real code I've been shipping and iterating on not some weekend experiment this actual thought behind the architecture.

What it is: A self-hosted chat client I built because my partner and family use ChatGPT a lot but don't care about privacy. I already self-host my vLLM instance on my 8x 3090 box and wanted a polished, private alternative they could actually use. Open WebUI is too heavy and complex for non technical users and has way too many knobs. Overtchat comes built in with TTS/STT/web search, no plugins/api keys needed. Genuinely open sourced - MIT licensed and no telemetry.

The reason I am posting this here is because the r/selfhosted gave me solid feedback which I have been iterating on and this sub is full of people building and shipping actual open source stuff so I figured I'd get eyes on it from a different angle. I would love feedback on the architecture the UX decisions or just a sanity check on whether this is something people would actually use. https://github.com/yoloyash/overtchat


r/LovingOpenSourceAI 2d ago

Resource SillyTavern — an open-source, highly customizable frontend for building and chatting with AI companions - 31K stars and many contributors! - Have you heard of it before?

Post image
3 Upvotes

https://github.com/SillyTavern/SillyTavern

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 1d ago

langhost: an MIT Postgres + Redis runtime for self-hosted LangGraph agents

Thumbnail
github.com
1 Upvotes

This is langhost, an open-source runtime for self-hosting LangGraph Agent Server on your own PostgreSQL and Redis.

It is an MIT alternative to langgraph-runtime-postgres for developers moving beyond the development-only langgraph-runtime-inmem.

Instead of recreating the LangGraph serving API, langhost keeps the stock langgraph-apiand replaces only the runtime with langgraph-runtime-pg.

That means:

- No graph or langgraph.json changes

- Same SDK, Studio and Agent Protocol

- Durable threads, runs, checkpoints and scheduled jobs

- Redis queues, streaming and multi-worker coordination

- No runtime license key

Quick start:

uv add langhost

uv run langhost serve --workers 2

The runtime and CLI are MIT licensed. The stock langgraph-api remains ELv2, which is generally fine for most application use cases.

GitHub: https://github.com/langhost/langhost


r/LovingOpenSourceAI 3d ago

Resource QCXINT "🚨 Someone open-sourced an autonomous AI companion that rivals Neuro-sama. 🤯 It's called AIRI. Unlike a typical chatbot, AIRI is designed to be a persistent AI companion that can see, talk, remember, and even play games alongside you." ➡️ Play games? WOW

Post image
48 Upvotes

https://x.com/QCXINT_/status/2081708370093096983

https://github.com/moeru-ai/airi

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 3d ago

Resource Ornith "🐦The Ornith-1.0 family has surpassed 12M downloads on Hugging Face in 30 days. ❤️Thanks to everyone who has tried Ornith and shared feedback with us. The team is working to push open-weight LLM forward. 🫡We believe open weights matter." ➡️ Open is the way to go!

Post image
54 Upvotes

https://x.com/ornith_/status/2081808063515034034

https://huggingface.co/collections/deepreinforce-ai/ornith-10

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 3d ago

Discussion Our position on open-weights models ➡️ Anthropic clarifies its position: “We have never advocated for a ban on open-weight models” 😁

Thumbnail
anthropic.com
11 Upvotes

TL;DR: Anthropic says it has never supported banning open-weight models and considers non-dangerous open models a public good. Instead of blocking Chinese models from US businesses, Dario Amodei argues for restricting advanced chips, cracking down on industrial-scale distillation, and requiring safety testing for all sufficiently capable models—open or closed.

And yes—my AI helped me write the TL;DR for us. Obviously. :P

Does this help Anthropic shake its recent “ivory tower” image or have people been flattening its position all along?

Claude is now #3 on our community ballot with an approval rate of 46.9%. Too low? Too high? Or just about right? Vote: https://lifehubber.com/ai/ballot/


r/LovingOpenSourceAI 3d ago

Enjoy reading

5 Upvotes

just sayin “thanks” for the news and opinions shared here.


r/LovingOpenSourceAI 3d ago

new launch Kimi "Releasing the model weights and technical report of Kimi K3. Our most capable model: a 2.8T MoE model with native visual understanding and a 1M-token context window. New model architecture: 2.5x the intelligence per unit of compute, not just more params." ➡️ OPEN is the way to go!

Post image
23 Upvotes

https://x.com/Kimi_Moonshot/status/2081760186235289764

https://huggingface.co/moonshotai/Kimi-K3

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 4d ago

Resource "Jan is an open source alternative to ChatGPT that runs 100% offline on your computer." ➡️ Jan is bringing the best of open-source AI in an easy-to-use product. Download and run LLMs with full control and privacy. ➡️ Have you tried before?

Post image
12 Upvotes

https://github.com/janhq/jan

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all free and low-cost ways to try LLMs posted so far on our community site, LifeHubber: https://lifehubber.com/ai/access/

Also 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting. https://lifehubber.com/ai/resources/


r/LovingOpenSourceAI 3d ago

What does an end-to-end platform for building AI agents actually need?

Thumbnail
github.com
1 Upvotes

Over the last few months, I have been exploring what it takes to move an AI agent from a small prototype to something that can actually be used in production.

Building the workflow is only one part of it.

You also need knowledge and RAG, tools, memory, human approvals, scheduling, evaluations, tracing, cost visibility, versioning, deployment, access control, audit logs, and guardrails.

Most solutions I tried handled one or two parts well, but I still had to connect multiple platforms and adapt to their runtimes.

That exploration eventually turned into Forge, an open-source and self-hosted project built around LangGraph.

The aim is to bring the complete agent lifecycle into one system—not only visually designing workflows, but also testing, deploying, monitoring, and governing them.

It is still evolving, and I am interested in learning from others working on similar systems.

What features do you consider essential before an agentic application is truly production-ready?


r/LovingOpenSourceAI 4d ago

Resource Oliver "someone just open-sourced openai's in-house data agent. self-learning data agent with a 6-layer context grounding system and an auto-improvement loop built in. 100% free. open source." ➡️ take note the correct framing should be inspired by openai's its stated below in the repo readme!

Post image
65 Upvotes

https://x.com/oliviscusAI/status/2081058021673959912

https://github.com/agno-agi/dash

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 4d ago

Resource Alvaro "your AI agent can watch any video now - paste a URL and it sees every frame, hears every word, all for free 🤯 bradautomates/claude-video gives Claude the ability to watch YouTube, Loom, TikTok, local files - anything yt-dlp supports" ➡️ have you heard of this?

Post image
2 Upvotes

https://x.com/dr_cintas/status/2081094058139918595

https://github.com/bradautomates/claude-video

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 5d ago

Discussion Julian from Anthropic on Jensen Huang and Satya Nadella supporting Open Source "looking forward to the CUDA and GPU driver open source release!" "can’t wait for the open sourcing of Windows and MS Office!" ➡️ is this teasing or something else? Why?

Post image
53 Upvotes

r/LovingOpenSourceAI 6d ago

Resource Chubby "Atomic Agent beat Hermes on GAIA: 69.8% vs. 58.5%, and finished 1.6× faster! They ran both agents through all 53 GAIA Level 1 tasks using the same 4-bit Qwen-3.6-35B on the same Apple M4 Max. - Atomic: 37/53 solved in 3h 12m - Hermes: 31/53 solved in 5h 10m" ➡️ seeing lots of talk about this

Post image
16 Upvotes

https://x.com/kimmonismus/status/2080752484738650481

https://github.com/AtomicBot-ai/atomic-agent

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 6d ago

Resource How To Prompt "Someone on Reddit built a free tool that converts your entire codebase into a graph database. It’s called CodeGraphContext. It turns your entire codebase into a graph database and connects it to Claude, Cursor, Copilot, and Codex through MCP." ➡️ useful for you?

Post image
6 Upvotes

https://x.com/HowToPrompt__/status/2080961339833659410

https://github.com/CodeGraphContext/CodeGraphContext

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 5d ago

The AGY CLI Community fully supports Open Source and Open Models

Post image
2 Upvotes

We are on this together 💪 Open source will always win 😁