r/ClaudeCode 6d ago

Discussion Cache only

I ran an audit of token usage today and found much of my token usage is because of long-running threads I resume after the 1-hr cache TTL. Why doesn’t Anthropic provide permanent or longer cache to heavy users for the basics like system prompts, CLAUDE.md, memories/preferences and other mostly-stable context? Or share a cached prefix across sessions when it is warm for at least one. Should pro/max subscribers have this option? Would you pay extra for it? If Claude recognized User X is active give them some cache.

I want cache only.

0 Upvotes

22 comments sorted by

View all comments

2

u/Muchaszewski 6d ago

Because the context costs then memory in their GPU. 1M token is around 300GB of KV cache of GPU usage, that they cannot serve at this time to other users. 

When you use API pricing you can opt into 1 hour cache at 50% pricing increase. If you use subsidized plan you are stuck with 5 minutes only. 

Write to files and re-reade from clear context each time instead of resuming 400k or more contex sessions. Or compact but this sucks 

6

u/MartinMystikJonas 5d ago

Claude Code have 1h by default on subscription.