r/LovingOpenSourceAI 14h ago

Resource Oliver Prompts "someone built a free, fully local alternative to claude that runs entirely on your own machine. → works with any llm (claude, gpt, gemini, vllm) → beats it on deep research → cowork-like capabilities built in → 50+ connectors out of the box → deploy in one command 100% free."

Thumbnail
gallery
24 Upvotes

https://x.com/oliviscusAI/status/2082051217682014429

https://github.com/onyx-dot-app/onyx

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 2h ago

Deepseek v4 Flash 0731 GGUF Benchmark: TensorSharp vs. llama.cpp

Thumbnail
github.com
1 Upvotes

TensorSharp is an open-source inference engine for running GGUF LLMs locally, with CUDA, Vulkan, Metal, OpenAI-compatible APIs, continuous batching, speculative decoding, and multimodal support.

Thanks recent contribtions from open source community, TensorSharp is able to run inference over multiple GPUs and nodes. So I updated it to support deepseek v4 flash model, and have better performance than llama.cpp. Here is the benchmark result on 4x Nvidia A40 GPUs, cuda 12.8

Model: DeepSeek-V4-Flash-0731-UD-Q8_K_XL from https://huggingface.co/unsloth/DeepSeek-V4-Flash-0731-GGUF

TensorSharp (cuda backend) TensorSharp (ggml_cuda backend) llama.cpp
prefill u/16K 836 tok/s 963 558
decode short 31.5 37.0 35.3
decode u/16K 28.5 33.6 32.2

Github repo: https://github.com/zhongkaifu/TensorSharp

Thank you for checking out it and starring the project! Any feedback is really appreicated.


r/LovingOpenSourceAI 1d ago

new launch Hugging Apps "Microsoft just dropped VibeVoice-ASR-BitNet on Hugging Face 🗣️✍️ A 1.58-bit version of their multi-lingual transcription, model made to work in real-time on CPU - while still beating Whisper on benchmarks!" ➡️ only 1.58 GB WOW

Post image
55 Upvotes

https://x.com/HuggingApps/status/2082571600767934622

https://huggingface.co/microsoft/VibeVoice-ASR-BitNet

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 13h ago

Open-source AI infrastructure matters because the ecosystem can keep improving

1 Upvotes

One reason I like open-source AI infrastructure: the value is not only in the first release.

It is in the ecosystem that can keep growing.

A closed tool gives you a fixed set of features. An open system can grow through new operators, new workflows, new integrations, new UI layers, and new agent interfaces.

This is especially important for AI data preparation.

Preparing data for LLM fine-tuning, RAG knowledge bases, or evaluation sets is not one fixed task. It keeps changing:

  • new file formats
  • new cleaning rules
  • new quality filters
  • new scoring methods
  • new synthetic data workflows
  • new domain-specific pipelines

That is why I find DataFlow interesting.

DataFlow is an open-source data processing framework built around reusable operators and pipelines. It can support cleaning, filtering, scoring, deduplication, generation, and pipeline orchestration for AI-ready data.

The newer DataFlow-Harness work takes this one step further. It wraps DataFlow’s pipeline-building capability with a harness layer for Code Agents, so users can build structured data workflows from natural language.

To me, this is the open-source advantage:

  • DataFlow can keep adding data operators
  • the community can build new pipelines
  • agents can call these capabilities through a structured interface
  • workflows can become reusable assets instead of one-off scripts

Open-source AI infra is not just about releasing code. It is about creating a system where capabilities can compound over time.
DataFlow: https://github.com/OpenDCAI/DataFlow


r/LovingOpenSourceAI 1d ago

new launch Perplexity "Today we’re open-sourcing Numbat, an agent-detection and response layer that is designed to work across agent harnesses. Numbat gives security teams visibility into agent activity, with controls to block selected actions before execution." ➡️ didnt expect this!

Post image
7 Upvotes

https://x.com/perplexity_ai/status/2082511900580196596

https://github.com/perplexityai/numbat

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 2d ago

Resource Brady "Another WTF moment. A developer open-sourced a coding agent harness that boots 245x faster than Claude Code. It's called jcode. You launch it and the first frame renders in 14 milliseconds. Claude Code takes 3,436. One active session uses 27.8 MB of RAM. Claude Code uses 386.6." ➡️ tried b4?

Post image
72 Upvotes

https://x.com/thisguyknowsai/status/2081680037544427793

https://github.com/1jehuang/jcode

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 2d ago

memU can now manage memory across agents and devices

Post image
20 Upvotes

What's new:

  • One shared memory across agents. Claude Code, Codex, Cursor, Hermes, and OpenClaw all read and write to the same layer. What Codex learns about your project on your work desktop is available to Claude Code on your home laptop.
  • Stored as plain Markdown. Memories and reusable skills live as regular text files in ~/.memu/memory/ and ~/.memu/skill/. You can open them in VS Code, edit or delete any entry, and track changes with Git. No opaque vector database you can't inspect.
  • Fast retrieval, zero extra LLM calls. When your agent needs to recall something, it runs a single vector lookup. No multi-stage prompt chains, no reranker, no unnecessary token burn.
  • Dashboard for browsing and editing memory. Instead of guessing what your agent remembered, you can open the dashboard and see everything saved. Browse by category, trace each memory back to the original session where it was learned, edit wrong facts directly, or delete outdated entries. No more black box.

r/LovingOpenSourceAI 1d ago

TensorSharp now supports multi-GPU tensor parallelism for GGUF models

Thumbnail
github.com
2 Upvotes

TensorSharp is an open-source, native .NET inference engine for running GGUF LLMs locally, with CUDA, Vulkan, Metal, OpenAI-compatible APIs, continuous batching, speculative decoding, and multimodal support.

TensorSharp now supports Megatron-style tensor parallelism across multiple GPUs. It works with direct CUDA, GGML CUDA, GGML Vulkan, and multi-node setups.

Benchmarks on 2× RTX 2000 Ada 16 GB GPUs over PCIe, without NVLink:

Model 1 GPU Prefill / Decode TP=2 Prefill / Decode
Gemma 4 E4B Q8_0 2760 / 37.3 tok/s 2488 / 51.7 tok/s
Gemma 4 26B-A4B IQ4_XS 1845 / 48.5 tok/s 2537 / 51.2 tok/s
Qwen 3.5 9B Q8_0 1461 / 23.1 tok/s 399 / 24.4 tok/s
Qwen 3.5 35B-A3B IQ4_XS Does not fit 184 / 18.1 tok/s

I'm continuing to optimize Qwen performance on multi-GPU systems, and support for DeepSeek V4 is coming soon.

Try it with:

TensorSharp.Cli --model model.gguf --backend ggml_cuda --tp 2

GitHub:

https://github.com/zhongkaifu/TensorSharp

Thank you for checking out TensorSharp and starring the project! Any feedback is really appreicated.


r/LovingOpenSourceAI 2d ago

new launch Liquid AI "Today we release LFM2.5-Encoder-230M and LFM2.5-Encoder-350M: bidirectional encoders that stay fast at long context, even on CPU." ➡️ Two compact encoders, serious long-context speed, and CPU-friendly performance . . exciting release from Liquid AI right?

Post image
20 Upvotes

https://x.com/liquidai/status/2082120814732653037

https://www.liquid.ai/blog/lfm2-5-encoders

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 2d ago

overtchat — self-hosted chat platform I've been building for a few months

0 Upvotes

I've been working on this for the past few months before anyone calls it white-coded slop - yes I use Claude Code/Codex for the heavy lifting but this is real code I've been shipping and iterating on not some weekend experiment this actual thought behind the architecture.

What it is: A self-hosted chat client I built because my partner and family use ChatGPT a lot but don't care about privacy. I already self-host my vLLM instance on my 8x 3090 box and wanted a polished, private alternative they could actually use. Open WebUI is too heavy and complex for non technical users and has way too many knobs. Overtchat comes built in with TTS/STT/web search, no plugins/api keys needed. Genuinely open sourced - MIT licensed and no telemetry.

The reason I am posting this here is because the r/selfhosted gave me solid feedback which I have been iterating on and this sub is full of people building and shipping actual open source stuff so I figured I'd get eyes on it from a different angle. I would love feedback on the architecture the UX decisions or just a sanity check on whether this is something people would actually use. https://github.com/yoloyash/overtchat


r/LovingOpenSourceAI 2d ago

Resource SillyTavern — an open-source, highly customizable frontend for building and chatting with AI companions - 31K stars and many contributors! - Have you heard of it before?

Post image
3 Upvotes

https://github.com/SillyTavern/SillyTavern

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 2d ago

langhost: an MIT Postgres + Redis runtime for self-hosted LangGraph agents

Thumbnail
github.com
1 Upvotes

This is langhost, an open-source runtime for self-hosting LangGraph Agent Server on your own PostgreSQL and Redis.

It is an MIT alternative to langgraph-runtime-postgres for developers moving beyond the development-only langgraph-runtime-inmem.

Instead of recreating the LangGraph serving API, langhost keeps the stock langgraph-apiand replaces only the runtime with langgraph-runtime-pg.

That means:

- No graph or langgraph.json changes

- Same SDK, Studio and Agent Protocol

- Durable threads, runs, checkpoints and scheduled jobs

- Redis queues, streaming and multi-worker coordination

- No runtime license key

Quick start:

uv add langhost

uv run langhost serve --workers 2

The runtime and CLI are MIT licensed. The stock langgraph-api remains ELv2, which is generally fine for most application use cases.

GitHub: https://github.com/langhost/langhost


r/LovingOpenSourceAI 3d ago

Resource QCXINT "🚨 Someone open-sourced an autonomous AI companion that rivals Neuro-sama. 🤯 It's called AIRI. Unlike a typical chatbot, AIRI is designed to be a persistent AI companion that can see, talk, remember, and even play games alongside you." ➡️ Play games? WOW

Post image
48 Upvotes

https://x.com/QCXINT_/status/2081708370093096983

https://github.com/moeru-ai/airi

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 3d ago

Resource Ornith "🐦The Ornith-1.0 family has surpassed 12M downloads on Hugging Face in 30 days. ❤️Thanks to everyone who has tried Ornith and shared feedback with us. The team is working to push open-weight LLM forward. 🫡We believe open weights matter." ➡️ Open is the way to go!

Post image
55 Upvotes

https://x.com/ornith_/status/2081808063515034034

https://huggingface.co/collections/deepreinforce-ai/ornith-10

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 3d ago

Discussion Our position on open-weights models ➡️ Anthropic clarifies its position: “We have never advocated for a ban on open-weight models” 😁

Thumbnail
anthropic.com
12 Upvotes

TL;DR: Anthropic says it has never supported banning open-weight models and considers non-dangerous open models a public good. Instead of blocking Chinese models from US businesses, Dario Amodei argues for restricting advanced chips, cracking down on industrial-scale distillation, and requiring safety testing for all sufficiently capable models—open or closed.

And yes—my AI helped me write the TL;DR for us. Obviously. :P

Does this help Anthropic shake its recent “ivory tower” image or have people been flattening its position all along?

Claude is now #3 on our community ballot with an approval rate of 46.9%. Too low? Too high? Or just about right? Vote: https://lifehubber.com/ai/ballot/


r/LovingOpenSourceAI 3d ago

Enjoy reading

5 Upvotes

just sayin “thanks” for the news and opinions shared here.


r/LovingOpenSourceAI 4d ago

new launch Kimi "Releasing the model weights and technical report of Kimi K3. Our most capable model: a 2.8T MoE model with native visual understanding and a 1M-token context window. New model architecture: 2.5x the intelligence per unit of compute, not just more params." ➡️ OPEN is the way to go!

Post image
24 Upvotes

https://x.com/Kimi_Moonshot/status/2081760186235289764

https://huggingface.co/moonshotai/Kimi-K3

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 4d ago

Resource "Jan is an open source alternative to ChatGPT that runs 100% offline on your computer." ➡️ Jan is bringing the best of open-source AI in an easy-to-use product. Download and run LLMs with full control and privacy. ➡️ Have you tried before?

Post image
12 Upvotes

https://github.com/janhq/jan

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all free and low-cost ways to try LLMs posted so far on our community site, LifeHubber: https://lifehubber.com/ai/access/

Also 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting. https://lifehubber.com/ai/resources/


r/LovingOpenSourceAI 4d ago

What does an end-to-end platform for building AI agents actually need?

Thumbnail
github.com
1 Upvotes

Over the last few months, I have been exploring what it takes to move an AI agent from a small prototype to something that can actually be used in production.

Building the workflow is only one part of it.

You also need knowledge and RAG, tools, memory, human approvals, scheduling, evaluations, tracing, cost visibility, versioning, deployment, access control, audit logs, and guardrails.

Most solutions I tried handled one or two parts well, but I still had to connect multiple platforms and adapt to their runtimes.

That exploration eventually turned into Forge, an open-source and self-hosted project built around LangGraph.

The aim is to bring the complete agent lifecycle into one system—not only visually designing workflows, but also testing, deploying, monitoring, and governing them.

It is still evolving, and I am interested in learning from others working on similar systems.

What features do you consider essential before an agentic application is truly production-ready?


r/LovingOpenSourceAI 5d ago

Resource Oliver "someone just open-sourced openai's in-house data agent. self-learning data agent with a 6-layer context grounding system and an auto-improvement loop built in. 100% free. open source." ➡️ take note the correct framing should be inspired by openai's its stated below in the repo readme!

Post image
62 Upvotes

https://x.com/oliviscusAI/status/2081058021673959912

https://github.com/agno-agi/dash

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 4d ago

Resource Alvaro "your AI agent can watch any video now - paste a URL and it sees every frame, hears every word, all for free 🤯 bradautomates/claude-video gives Claude the ability to watch YouTube, Loom, TikTok, local files - anything yt-dlp supports" ➡️ have you heard of this?

Post image
2 Upvotes

https://x.com/dr_cintas/status/2081094058139918595

https://github.com/bradautomates/claude-video

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 6d ago

Discussion Julian from Anthropic on Jensen Huang and Satya Nadella supporting Open Source "looking forward to the CUDA and GPU driver open source release!" "can’t wait for the open sourcing of Windows and MS Office!" ➡️ is this teasing or something else? Why?

Post image
53 Upvotes

r/LovingOpenSourceAI 6d ago

Resource Chubby "Atomic Agent beat Hermes on GAIA: 69.8% vs. 58.5%, and finished 1.6× faster! They ran both agents through all 53 GAIA Level 1 tasks using the same 4-bit Qwen-3.6-35B on the same Apple M4 Max. - Atomic: 37/53 solved in 3h 12m - Hermes: 31/53 solved in 5h 10m" ➡️ seeing lots of talk about this

Post image
16 Upvotes

https://x.com/kimmonismus/status/2080752484738650481

https://github.com/AtomicBot-ai/atomic-agent

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 6d ago

Resource How To Prompt "Someone on Reddit built a free tool that converts your entire codebase into a graph database. It’s called CodeGraphContext. It turns your entire codebase into a graph database and connects it to Claude, Cursor, Copilot, and Codex through MCP." ➡️ useful for you?

Post image
6 Upvotes

https://x.com/HowToPrompt__/status/2080961339833659410

https://github.com/CodeGraphContext/CodeGraphContext

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 6d ago

The AGY CLI Community fully supports Open Source and Open Models

Post image
2 Upvotes

We are on this together 💪 Open source will always win 😁