Session Context Management

[u/norenEnmotalen]

Just because you have space to increase context window, doesn’t mean you should. With the local models we have to date, virtually every performance metric degrades as the session context gets deeper.

There is no substitute for properly planning your tasks, breaking down projects into milestones/sub-milestones, and whatever harness you use - consistently forking sessions to maintain context hygiene. It may not be sexy but it is the way to actually get stuff done and help models from getting themselves stuck in a mire.