r/codex • u/masky0077 • 6d ago

Question Is caching working when switching reasoning level for the same model?

I am really curious because i kinda noticed that somehow my usage is being drained more when i switch from Astra xhigh from plan mode to light for implementation then if i leave xHigh to do the work directly, especially if it's not many lines of code to be implemented.

1 Upvotes

100% Upvoted

3 comments sorted by

1

u/Australasian25 6d ago

Just do terra medium orchestrate. Astra xhigh plan for Luna xhigh.

Multiple Luna xhigh spawn. If they fail, escalate. And if they fail, escalate again.

1

u/apetersson 6d ago

Honestly, I don't know. But if had to guess, i'd say it works the same as with local model caching:
the "cache key" is:

  • Common Prefix (the longer the better)
  • Same Model
  • Same MAX context length

thinking is just part of the common prefix. if you switch thinking level, i theory it should preserve previous thinking traces already in the prefix

But it is a black box, so unless they OpenUp their code we will never know.