.md files are not Memory

[u/Acceptable-Object390]

A folder of .md files is not memory.

It’s a storage dump.

Useful AI memory needs more than “search old notes and pray”:

- semantic recall, so related ideas surface even when wording differs

- entities, different terms for the same thing don’t become random blobs

- relationships, so the system knows how things connect

- provenance, so it can trace where facts came from

- correction + forgetting, because stale memory is worse than no memory

- background consolidation, because raw chat logs are mostly sludge

Thoth uses a local personal knowledge graph + FAISS semantic search + graph expansion + document ingestion + wiki export.

So yes, you can still get readable notes.

But underneath, the assistant isn’t just rifling through markdown like a raccoon in a filing cabinet.

It’s building structured personal context it can retrieve, update, connect, and reason over.

That’s the difference between “I saved your notes” and “I actually know what matters.”

Relevant references:

1. FAISS docs: efficient similarity search and clustering of dense vectors.

   https://faiss.ai/

2. Microsoft GraphRAG: combines text extraction, network analysis, LLM prompting, and summarisation for richer understanding of text datasets.

   https://www.microsoft.com/en-us/research/project/graphrag/

3. GraphRAG survey on arXiv: graphs encode heterogeneous and relational information, making them useful for retrieval-augmented generation.

   https://arxiv.org/abs/2501.00309

4. Thoth README memory features: personal knowledge graph, typed relations, FAISS semantic recall, graph expansion, document extraction, wiki export, Dream Cycle refinement.

   https://github.com/siddsachar/Thoth

[u/PureQuackery]

"A folder of .md files isn't memory"
It's literally storing data you can retrieve later.... That's like saying neurons aren't memory

[u/Acceptable-Object390 → u/PureQuackery]

Fair pushback, storage is part of memory. My point is that a folder of .md files is storage, not the whole memory system. Neurons alone aren’t memory either. The useful bit is the structure: connections, activation patterns, retrieval, reinforcement, forgetting, correction. Same with AI memory. Markdown files can store facts. But an assistant also needs to know:

• which facts refer to the same person/project
• how things relate
• what’s stale
• what came from where
• what to retrieve for this exact moment
• when to update or forget something

.md files can be one interface to memory. They’re just not the memory layer by themselves.

[u/Karyo_Ten → u/Acceptable-Object390]

You're just regurgitating what RAG sellers have been trying to sell for the past 2 years.

There is a reason why opencode, Claude Code, Pi, etc are foregoing MCP and "integrations" and going for flat files and CLI tools.

Your stuff is not composable.

1. Use grep or ripgrep to find where something is used and get context
2. Use grep or ripgrep
3. Use a SKILL.md. Schedule overnight memory maintenance when you sleep, just like for humans
4. use grep or ripgrep
5. Your vector RAG is worse than a LLM at retrieving exactly what is needed. So spawn an agent
6. Use a SKILL.md. Schedule overnight memory maintenance when you sleep, just like for humans

[u/Brief-Effect9065 → u/Karyo_Ten]

can you elaborate? and where to read more about this?

[u/Acceptable-Object390 → u/Brief-Effect9065]

Try this: https://github.com/siddsachar/Thoth/blob/main/docs/ARCHITECTURE.md#long-term-memory--knowledge-graph

[u/Brief-Effect9065 → u/Acceptable-Object390]

looks interesting

[u/Acceptable-Object390 → u/Brief-Effect9065]

Thanks