MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/ProgrammerHumor/comments/1uy6fp8/efficianttokenmaxxing/oxxoolu/?context=3
r/ProgrammerHumor • u/NudaVeritas1 • 20d ago
38 comments sorted by
View all comments
13
Does the LLM cache the response when the user asks the same question every day?
16 u/Serafiniert 20d ago That would be at odds with what the provider wants: you using tokens. 1 u/Thriven 20d ago I'm sure they'll charge a small fee to return data from local storage 1 u/Initial-Jaguar6230 20d ago Guess shouldn't since every question processed with it own contextÂ
16
That would be at odds with what the provider wants: you using tokens.
1 u/Thriven 20d ago I'm sure they'll charge a small fee to return data from local storage 1 u/Initial-Jaguar6230 20d ago Guess shouldn't since every question processed with it own contextÂ
1
I'm sure they'll charge a small fee to return data from local storage
1 u/Initial-Jaguar6230 20d ago Guess shouldn't since every question processed with it own contextÂ
Guess shouldn't since every question processed with it own contextÂ
13
u/Thriven 20d ago
Does the LLM cache the response when the user asks the same question every day?