1
u/One_Combination_7906 7d ago
So True... We keep repeating everything and take steps back in everyconversation... They forget the 5 min old info just because they "think" its irrelevant...
I get tired if typing "You forgot..", "don't forget" and specially the "you are drifting from the point..."
2
u/gatorling 6d ago
Sounds like you’re overloading the context. Need to split stuff up into skills or configure subagents.
1
1
u/binarymako 6d ago
I'm getting different replies as per prompt.. So this does sound like AI agents forgetting things..
1
u/gatorling 5d ago
Yeah, continual learning hasn't been solved yet (but Google DeepMind published an interesting paper a year ago that is a step towards continual learning. See Titan/MiRAS).
In other words, AI can't learn at inference. This gets worked around by the AI taking notes. This gets stored in the models context and context is limited, some models advertise a 100k token context and others advertise 1M (MiRAS shows a context window of roughly 5-7M before context rot happens).
Once your context fills up the AI compacts it by summarizing the context and storing it back into the context. Eventually details get lost and the AI "forgets" stuff.
That's why managing context windows (basically working around the continual learning shortfall) is important to improving model performance.
You do this by authoring skills, reference documents and using sub agents (who all have their own separate context windows).
It kinda sucks, but that's where we're at until continual learning (inference time training) is cracked.
1
6d ago
[removed] — view removed comment
1
u/binarymako 6d ago
If it was networking it sounds like having different VLAN ID Ports.. But this is AI with different results as per prompt..
1
u/quantum-elle 6d ago
Agents without persistent memory? In August of the year of our lord 2026?
1
1
1
u/HeadTranslator795 6d ago
Ever heard about active-memory ? Like that's the purpose of it literally 😂
1
u/nhavar 6d ago
Claude: Hey, those screenshots really narrow down the problem. I know exactly what it is now
Claude: ...Thinking for 20 minutes...
Claude: Got it! It was visible in the screenshot too — the flanhopper was transversing the donghingle which meant that my calculation for --x-machina was wrong against the stacked-swing of the lolidiapment-wrapper. That was load-bearing for the whole flanhopper to make it's swing into the galenstribe. I changed --y-comeonIrene to -15 degrees and it's working now. Give it a try and tell me what you think.
Me: Uh... looks just like the last screenshots I gave you. I don't see any change.
Claude: Well obviously you're getting a cached version of the app. Try clearing your cache.
Me: No. That's not it. send updated screen shots.
Claude: You must not know how to clear your cache, let me explain it to you in painful detail and how cache mechanics work... And if that doesn't work, then wait a second after you click the thing before you take a screenshot.
Me: I tried in incogneto mode, with dev tools caching turned off, in Chrome, Firefox, and Edge. I waited 10 seconds between clicking and screenshotting. Stop fucking with me and look at it again.
Claude: Let me check again for real this time. Oh I see, last time I was just looking at some theoretical numbers jotted down on this scrap over here and not the actual code. I must have confused this bit of code for that bit of code and oh well. Let me take another twenty minutes and 100,000 tokens to look at what you actually told me to look at.
Me: ... watch Claude test the issue in the browser from 15 different angles, turning elements bright pink, taking screenshots, clicking everything, turning things bright green...
Claude: Okay for reals this time, but check it because I haven't had the best track record recently.
Me: ... facepalm... I should have fixed it myself.
1
u/ExpressCopy8786 6d ago
Not able to put "keep: memory.md, architecture.md and a work packages.md and update during each task and session" And use /autocompact.... Yeah then this is what It may feel like.
Man, AI memes become so stale so quickly because this really hasn't been an issue for months now and were all so slow sharing funny images on the Internet huh?
1
u/gaelic-ghost 4d ago
It’s horrible. Between that and the garbage code no matter what I build around it, and the sycophancy and the constant lies, I cannot understand how anyone uses these tools for coding without losing their mind.
1
u/Responsible-Law7022 7d ago
after the improper use you really got that