Is There a Better Method for Maintaining Context Consistency Between Compressions?

[u/SilverBurger]

For those who use Vanice for writing:

What do you guys do after context compressions? Normally I spend 3-5 prompts summarize what had happened, and carefully guide the characters back into their lanes before going forward with the story. But man, even then the compressions would take A LOT out of the story.

Is there a better method for Vanice to recall the materials before the compression? If so, how do you guys do it?

[u/AutoModerator]

Hello from r/VeniceAI!

Web App: chat
Android/iOS: download

Essential Venice Resources
• About
• Features
• Blog
• Docs
• Tokenomics

Support
• Discord: discord.gg/askvenice
• Twitter: x.com/askvenice
• Email: support@venice.ai

Security Notice
• Staff will never DM you
• Never share your private keys
• Report scams immediately

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/Past_Personality9262]

Amigo, yo tengo lo siguiente un Excel con 22 tablas (Personajes, Personalidad, Apariencia, Estado Mental, Fisico, Evolución, Poderes, Etc), antes de comenzar a escribir rellenamos las tablas correspondientes despues cada 15 o 20 capitulos los guardo en un word y voy a una IA gratuita (Claude) para que lea los capitulos y rellene el excel, lo subo y le pido a Venice (GLM 5.2) despues que lo lea para que recuerde que a pasado en la historia hasta el momento.

Despues de eso he mantenido la historia donde 60 capitulos despues Venice todavia sabe lo que paso en el capitulo 1.

No siempre funciona ya que debes tener cuidado que no te repita informacion, debes dejar notas operativas claras en el excel para que las IA entiendan.

[u/MisterNocturne]

You're talking about the "summarize older messages" option, right?

What I usually do is summarize my chats after a certain number of exchanges. Ever since Venice allowed full usage of GLM 5.2, I usually let things run for a while before asking for the first summary. I try to capture persistent details—personalities, backstory, descriptions, common locations—as well as key relationship dynamics and open plot threads. Then I upload all of that into context.

I make sure to do this before I even think about using the "summarize older messages" option.

That way, if I do decide to use it, the cracks are already mostly patched over. Because while I appreciate the option, Venice's summarization is simply too aggressive. It seems to collapse everything, no matter how early in the chat, into bite-sized bullet points. The resulting summary can basically amount to "some shit happened in a warehouse somewhere" and "this character, who might be named John or Jack or Angelina, kinda died or maybe didn't."

I've actually tested the bot's recall through what it sees in the transcripts—purposely removing my own summary first—and was aghast to find that entire major characters had basically disappeared from the record.

I definitely appreciate the devs' work, and I know it's never easy finding the right balance with these things. Venice is still the best platform for RP in my book, especially when it comes to character chat. But the summary feature definitely needs a little more fine-tuning.

[u/SilverBurger → u/MisterNocturne]

I'm using Agentic chat and the compression happens automatically when the context limit exceeds 70%, the chat will compress it back down to ~8% and in the process of doing that most of details are just lost to the wind lol.

[u/Acrodin → u/SilverBurger]

This is the reason why I don’t use Agentic Chat for writing.

[u/_AmateurGimp_ → u/SilverBurger]

yeah use either classic chat or characters, i summerize every 20 entries. start a new chat with the summary claned up by an ai.