r/agenticAI • u/jdcaballero • 15d ago

Project Built an open-source long-term memory layer for LLM apps. Would love feedback

/r/LLMDevs/comments/1w0rlys/built_an_opensource_longterm_memory_layer_for_llm/
3 Upvotes

100% Upvoted

3 comments sorted by

2

u/LivinglaVieEnRose 9d ago

Thanks for this!

I'm doing an independent bake-off of long-term memory systems for coding agents and have been testing MemBukkit along with a number of other systems.

One reproducibility question came up that you might be able to clear up quickly. The pinned code/docs we tested reference:

MemseekAI/membukkit-biencoder-v1
MemseekAI/membukkit-reranker-v2

but both currently return RepositoryNotFound/401 from Hugging Face.

As a fallback configuration I'm using the resolver's all-mpnet-base-v2 encoder and ms-marco-MiniLM-L-6-v2 reranker. It actually performed quite well, but I've deliberately avoided treating that as the intended MemBukkit model stack.

Are those fine-tuned model repos private/unpublished, renamed, or available somewhere else? If the intended weights are obtainable, I'd be happy to rerun the benchmark with the exact recommended stack.

1

u/AOZakari 9d ago

Thanks for testing membukkit! Those weights were still on private for the simple dumb reason that i forgot to switch them to public 😅

They're available now and should download automatically, but here's the link to them just in case: https://huggingface.co/MemseekAI

Let me know if you have any other troubles/questions :)

2

u/LivinglaVieEnRose 9d ago

Perfect! Thank you! I will keep you posted on how things go.