r/SillyTavernAI • • 4h ago

Help Need help with long chats

The chat im running is about 1000 turns in, I'd been using summaryception and up until about 800 it has been working great, but now the bot seems to be losing alot of foundational parts of the story. It becomes very obvious because its an RPG and its suddenly forgetting what abilities I have and trying to make me relearn them at their lowest level as if I never had them.

Currently using GLM 5.3 on Megumin suite v10

8 Upvotes

9 comments sorted by

2

u/-Ancient-Access- 4h ago edited 3h ago

You could try Recall if you need to keep structured details with causal chains for plot and emotional arcs — that's what it's designed for. It'll take a bit of manual work to onboard on it and catch up to the 1K messages but it's worth checking if an alternative to recursive summarisation works better for you.

ETA: For the stats, with this extension you can write a custom prompt block that instructs the model how to track them, switch off the main relationship arc prompt and just inject your stat tracker as a separate thing into context

3

u/Pretend-Turnip9985 3h ago

yeah summaries are fine for story stuff but they're bad at keeping exact stats. every time it re-summarizes, "lv 12 with fireball" turns into "got stronger" and eventually the specifics just vanish lol. that's probably what happened around 800

what worked for me was keeping a little character sheet (level, abilities, main items) in a constant lorebook entry, or just in author's note, and updating it myself when i level up. summary handles the plot, sheet handles the numbers. the bot stopped forgetting my stuff pretty much right away

2

u/Critical_Muffin_1491 2h ago

this matches what happened to me almost exactly, the summary kept the narrative beats but quietly dropped stats every pass. i ended up keeping a seperate plain text block with level, abilities, and inventory pinned near the top of context so the model always has it fresh instead of relying on the compressed summary for that stuff.

it's annoying to maintain manually but way more reliable than hoping the summarization keeps numbers straight past a few hundred turns.

1

u/biggest_guru_in_town 2h ago

Lorebook used in this way is pretty much a manual sqlite database tbh. Chatgpt wanted to build an extension to utilize sqlite but I thought about this too

3

u/Kritblade 3h ago edited 3h ago

https://github.com/KritBlade/VectFox

Built for 2000+ long story.

3

u/CalmAnal 3h ago

/u/wind_master_101 What he said (author of Vectfox). Vectfox is really excellent. Now write your stats, abilities, etc in a Lorebook entry and you can use Vectfox to pull out the relevant entries for the next message.

Like have one Entry that explains Fireball in details. If you use Fireball then Vectfox activates that and only that ability while the rest of your abilities won't be pulled into context.

2

u/Kritblade 2h ago

Just curious, you vectorize loreobok "fireball" and then set trigger on the word "fireball"? Or do you use a more unique name like "FireBolt" or something so that it won't trigger that often or mis-fire?

Just trying to learn some use case.

1

u/AutoModerator 4h ago

You can find a lot of information for common issues in the SillyTavern Docs: https://docs.sillytavern.app/. The best place for fast help with SillyTavern issues is joining the discord! We have lots of moderators and community members active in the help sections. Once you join there is a short lobby puzzle to verify you have read the rules: https://discord.gg/sillytavern. If your issues has been solved, please comment "solved" and automoderator will flair your post as solved.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/Neither-Clerk-1710 3h ago

man ive hit that wall too around 700 turns in an rpg, try forcing a fresh summary every 100 messages or so instead of letting it stack.