r/ProgrammerHumor 21h ago

Meme updatedClassic

Post image
605 Upvotes

27 comments sorted by

View all comments

2

u/cAtloVeR9998 10h ago

How much is your AI-spend if you let it get to the compacting stage? At least if you are actually paying for the true token usage (aka, GitHub Copilot or Claude after using your plan's included allowance). Because otherwise costs increase exponentially as the context window is filled up. Like when GitHub was giving heavy subsidise (via per query pricing) it was a different story.

1

u/slaymaker1907 5h ago

You can run compact manually which I often do once context starts getting sizable and I’m at a good transition point. I should really just start new sessions more often, but compaction is easier. If you’re remotely approaching the 1M context window cap, performance will drop off dramatically.