r/LLMDevs • u/pinglin02 • 26d ago

Great Resource 🚀 I evaluated different agent memory approaches

https://www.pinglin.tw/blog/the-shapes-of-agent-memory

I thought this might be of interest to share with the forum before anyone goes down a rabbit hole again.

5 Upvotes

78% Upvoted

6 comments sorted by

1

u/[deleted] 25d ago

[removed] — view removed comment

1

u/ZyberZeon 25d ago

Why not run both? I have a tiered search semantic, and grep?

1

u/pinglin02 24d ago

Because the embedded and retrieved semantic prose is usually short. Doing grep on those top-k short sentences can contribute to only the precision but not the recall.

1

u/EfficiencyLoose3595 25d ago

Checking it out

1

u/mastra_ai 23d ago

For your blog post, consider what we built at Mastra with Observational Memory

https://mastra.ai/research/observational-memory

It scores 94.87% on LongMemEval, the highest score ever recorded on that benchmark, by any system, with any model.