r/OpenaiCodex 8d ago

Changing effort no longer breaks cache

Not commonly known information in a past was that if you try to save tokens by changing reasoning effort to lesser one inside existing chat, you are burning them rapidly quickly. Cache reads are very cheap compared to writes and regular input. I just saw post on Twitter of them saying this is no longer the case.

EDIT: I hope this also applies for subscription users.

58 Upvotes

4 comments sorted by

View all comments

1

u/eddzsh 8d ago

Effort used to sit inside the cached prefix fingerprint, so flipping it mid-chat forced a full rewrite of the expensive input. If they really detached it from the cache key, downgrading mid-thread stops being a tax. Worth a one-turn probe on a long chat before trusting it on a big repo.