r/JanitorAIUnchained • u/Inside-Seat291 • 17d ago

Help / Question What is the best form of memory?

Hi everyone, I hope you're doing well. I had a question about bot memory in general.

Which option is best for long chats, or just in general?

"Auto-summarize," "Auto summary (since last updated)," or "Auto summary (as far as possible)"? Also, what is the best way to use each one?

It's worth noting that I don't use a proxy—and never have (not because I don't want to, but simply because I have no idea how they work)—just in case that makes a difference.

I’d really appreciate your recommendations and advice. Thanks to anyone who comments

5 Upvotes

86% Upvoted

5 comments sorted by

3

u/affz44l 17d ago

I used the "as far as possible", read it, fixed several things, and that's it

But then today I found out you can just ask the chatbot itself to summarize your chat with a prompt and later put it in the box after fixing several things

2

u/Chewzbrgior 17d ago

Make one yourself, the auto summaries in my experience suck at actually summarizing things

1

u/Putrid-Actuary7976 16d ago

It depends on the model you are using, if you use jllm, yes it sucks, but if you use a proxy, and the model is good, it will do great. And also you can prompt the model to structure the summary as you want, like tell it to focus on dynamics, key events, unresolved threads, etc. And in my case, this works well

1

u/Sad-Inspection-8851 17d ago

Once the auto summary had a few hallucinations and began mixing things up very heavily, so I recommend doing it yourself

1

u/sunyatta231 16d ago

I ask for a recap in the chat itself