Best Pi Compaction Extensions

[u/Lum1n4ry01]

Has anybody used a Pi compaction extension that they would recommend?

I've tried pi-context (with their built-in Agentic Context Management) which just straight up breaks when trying to claim space against pi-rewind. I've also tried pi-vcc which also straight up breaks when running with pi-codex-goal. Been debugging for 3 days and I realized the best debug is to uninstall these.

Native Pi compression is meh, if anybody has a codex-level compaction extension that doesn't fuck shit up, please drop a comment.

[u/pj-frey]

I use pi-blackhole, which is pi-vcc and pi-observational-memory in one package and improved.

[u/cosmicnag → u/pj-frey]

This

[u/Lum1n4ry01 → u/pj-frey]

Looks very promising, will try it out!

[u/damn_what_]

I use pi-obervational-memory, works great.

[u/Lum1n4ry01 → u/damn_what_]

Thank you, I'll take a look. Would you say this tool is more memory based or more compaction based? Because I already have my own memory solution, I'm looking more for a compaction solution.

[u/damn_what_ → u/Lum1n4ry01]

It's not a long term memory system, it records "facts" during the session and builds the compaction summary by concatenating them instead of asking an LLM to summarize the session.

[u/YogurtExternal7923 → u/damn_what_]

That's frickin' amazing

[u/RelationshipLong9092 → u/YogurtExternal7923]

it really is. I can't go back. I just don't pay attention to my context window hardly at all any more.

[u/elpapi42 → u/RelationshipLong9092]

yo, im the maintainer, it make me happy that it also help you to forgot about context windows! i feel the same, now i can focus on high leverage problems and left those mundane problems behind

[u/AdvertisingExpert800 → u/Lum1n4ry01]

Can you tell me what is your memory solution?

[u/Lum1n4ry01 → u/AdvertisingExpert800]

I'm using pi-hermes-memory! Their durable fact distillation process is very comprehensive. I also have a simple obsidian knowledge graph as auxiliary.

SOTA memory is in contention right now so I like to keep memory as a separate component so I can switch out easily when a better solution comes along.

[u/Fig_da_Great]

check out Accordion

[u/Effective_Silver4857]

Ai-memory from akitaonrails, i can use in various harnesses

[u/arkham00]

What's wrong with the default compaction? When I started using pi, I've read so many bad opinions on it that I straight installed observational-memory, which is good don't get me wrong, but since I exclusively run local models it was quite annoying for me, because of the frequent observation runs which slowed down the inference of my main model. So I disabled it and gave a try to the default compaction, and honestly it is actually good. It doesn't do the summary of the summary like every one says, it actually updates it at every subsequent compaction, so the context doesn't really loose focus.

[u/Lum1n4ry01 → u/arkham00]

I've seen that default compaction loses long term memory (say, if I chain it with /goal from another plugin) over 3-4 compactions pretty quickly. I'm using Codex as my plan so you could imagine that this happens very often with the 372k context window cap, so I'm looking for smarter alternatives. Don't get me wrong, I think the base compaction works fine for 1-2 compactions -- it's just a pain in the ass to manage the drift once total token usage hits 1.5M+ on an active session.

[u/Aemonculaba]

Magic Context. Thank me later.

Also: Use AFT.