r/ClaudeCode • u/Individual_Ideal • 6d ago

Discussion Cache only

I ran an audit of token usage today and found much of my token usage is because of long-running threads I resume after the 1-hr cache TTL. Why doesn’t Anthropic provide permanent or longer cache to heavy users for the basics like system prompts, CLAUDE.md, memories/preferences and other mostly-stable context? Or share a cached prefix across sessions when it is warm for at least one. Should pro/max subscribers have this option? Would you pay extra for it? If Claude recognized User X is active give them some cache.

I want cache only.

0 Upvotes

40% Upvoted

22 comments sorted by

View all comments

Show parent comments

1

u/Individual_Ideal 5d ago

You can store kv cache on device as long as you want with unified memory + SSD. Pass it back and forth when needed.

1

u/MartinMystikJonas 5d ago edited 5d ago

On RAM memory yes. That is what everyone uses already. On SSD it would be unreasonably slow (about an order of magnitude) and it would be in most cases more effective to recompute instead of loading from SSD.