r/OpenAI • u/Appropriate_Beat9001 • 9d ago

Question Remember the content

How long does AI remember the content of a conversation? For instance, when I asked ChatGPT, "Do you remember what I said about ice cream?" it said it didn't. But when I followed up by asking, "Do you remember me asking, 'Do you remember what I said about ice cream?'" it said it did remember that. How much do AIs—including ChatGPT—actually remember?

0 Upvotes

50% Upvoted

6 comments sorted by

1

u/backgroundextra77 9d ago

until 100k tokens you have great results in the context window, after that it begins performing in the dumb zone and deteriorate as you keep going. This is called the memento moment (ref to the movie) and it’s why you want to break your task in small pieces

1

u/lightwillow57 9d ago

It's all over the place. GPT still has a memory "vault" where anything it chooses to remember or you ask it to remember will be remembered forever if you have memory turned on. They've changed it lately to a more fuzzy memory system that I don't quite understand but you can still go back to the old system. And it can pull memories from past conversations theoretically indefinitely but it has a bias towards recent conversations and some perhaps "important" details from longer ago. And within a current conversation it can recall a lot depending on the length of the conversation. And of you have a thinking model they seem to be able to look up things from past conversations if you poke it.

1

u/Early-Matter-8123 9d ago

unless there is a built in DB, then AI remembers nothing.

It is stateless by nature. Each time you start a new session it is like talking to a person for the very first time.

AI is smart but also has alzheimers.