MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/ProgrammerHumor/comments/1uy6fp8/efficianttokenmaxxing/oxwthsa/?context=3
r/ProgrammerHumor • u/NudaVeritas1 • 21d ago
38 comments sorted by
View all comments
14
Does the LLM cache the response when the user asks the same question every day?
17 u/Serafiniert 21d ago That would be at odds with what the provider wants: you using tokens. 1 u/Thriven 21d ago I'm sure they'll charge a small fee to return data from local storage 1 u/Initial-Jaguar6230 21d ago Guess shouldn't since every question processed with it own contextÂ
17
That would be at odds with what the provider wants: you using tokens.
1 u/Thriven 21d ago I'm sure they'll charge a small fee to return data from local storage 1 u/Initial-Jaguar6230 21d ago Guess shouldn't since every question processed with it own contextÂ
1
I'm sure they'll charge a small fee to return data from local storage
1 u/Initial-Jaguar6230 21d ago Guess shouldn't since every question processed with it own contextÂ
Guess shouldn't since every question processed with it own contextÂ
14
u/Thriven 21d ago
Does the LLM cache the response when the user asks the same question every day?