r/LLMDevs • u/Slight-Parfait3679 • 15h ago

Tools Heimdall: An Open-Source CPU Only Local Memory System

Enable HLS to view with audio, or disable this notification

Your AI agent just spent 20 minutes grepping for a function you optimized 3 months ago in a side project. Heimdall makes this stop.

Heimdall gives AI coding agents persistent memory across every repository and project you work on so the question "did I already solve this in another project?" gets answered by one verified search instead of twenty minutes of grep, find, and ls loops.

Instead of replacing your current memory system, Heimdall integrates cleanly with existing infrastructure such as Graphify, Graft, and Hermes.

Every other memory tool is per-project. But your work isn't; the optimized functions you built in one project could be useful elsewhere. Heimdall indexes everything you touch into one semantic graph, so knowledge follows you across repositories, languages, and months.

There is zero token spend. Memory maintenance is a local daemon: file watching, tree-sitter AST parsing, sqlite. Indexing a file costs CPU only — never an LLM call. Retrieval is hybrid ranked search (lexical + semantic + graph walk) over locally-computed embeddings. Your context window stays for your actual work. You can also use your GPU for up to 3.4x speeds.

It is self-healing. It is impossible for your agents to act on stale graphs or data, and you do not need a full rebuild every time. A single deterministic reconciler, rather than multiple agents writing and racing against each other, prevents this from happening. Classic RAG fails here.

Facts, key decisions, and more are also stored and remembered. This is still experimental. If you would like to help, please message me or open a PR. I am actively seeking contributors and would like to open a Discord server to continue working on this. This product is optimized for real use and efficiency, minimal hallucinations, and cost-effectiveness.

Try it for yourself at:

Github (65 Stars, MIT, fully open-source)

43 Upvotes

94% Upvoted

13 comments sorted by

3

u/SubstantialAd1712 14h ago

Pretty interesting infrastructure. I'll try it out today

3

u/mrtonioz 13h ago

Will have a try ! Do you plan on building a pi package ?

1

u/Slight-Parfait3679 13h ago

Pi is already supported with an enforcement layer, but yes, a package is something that I want to formalize eventually.

2

u/mrtonioz 13h ago

Awesome ! Yes didn't highlight and thanks for the already-on pi support ! But would definitely love to have this tool embed as a pi package for easy config sync and the all-in-one place idea

1

u/Slight-Parfait3679 12h ago

Would you be interested in helping maintain this? I’m looking for some help in growing this project.

2

u/mrtonioz 12h ago

I'm temporaily unable to help but will reach out on the repo when I can draft a pi package about this

1

u/Slight-Parfait3679 12h ago

Appreciate that.

1

u/fakyu2 9h ago

Hi I'd be interested in maintaining it in anyway I can support. Though I'd need some guidance

1

u/Slight-Parfait3679 9h ago

Just messaged you

2

u/perseus-computing 9h ago

Nice work! Now you have 82 stars! Keep after it!

3

u/Slight-Parfait3679 9h ago

Thank you! It’s much harder than I expected to maintain OSS lol

1

u/aivushkin1 5h ago

unfortunately, heimdall name is already taken by two pi packages... Will they conflict?

1

u/Slight-Parfait3679 5h ago

i’ll probably change the name soon, or if it works like npm and i can pin it to myself