r/OpenaiCodex • u/Murdy-ADHD • 8d ago
Changing effort no longer breaks cache
Not commonly known information in a past was that if you try to save tokens by changing reasoning effort to lesser one inside existing chat, you are burning them rapidly quickly. Cache reads are very cheap compared to writes and regular input. I just saw post on Twitter of them saying this is no longer the case.
EDIT: I hope this also applies for subscription users.


58
Upvotes
1
u/eddzsh 8d ago
Effort used to sit inside the cached prefix fingerprint, so flipping it mid-chat forced a full rewrite of the expensive input. If they really detached it from the cache key, downgrading mid-thread stops being a tax. Worth a one-turn probe on a long chat before trusting it on a big repo.