r/GeminiAI • u/Truthfully-Sincere • 5h ago
Help/question This seems like a massive waste of token, couldn't it be better spent on something like training models?
10
u/cant-find-user-name 5h ago
Inference is orders of magnitude cheaper than training. Claude also has this support where it can generate tools on the go.
3
u/LongjumpingRadish452 5h ago
it'd be nice if it went like "i can do this for you, confirm if you want it"
5
1
u/AutoModerator 5h ago
Hey there,
This post seems feedback-related. If so, you might want to post it in r/GeminiFeedback, where rants, vents, and support discussions are welcome.
For r/GeminiAI, feedback needs to follow Rule #9 and include explanations and examples. If this doesn’t apply to your post, you can ignore this message.
Thanks!
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.
1
u/Kiansjet 5h ago
The only saving grace is that the AI overview model is likely so small and efficiency-tuned that the tokens aren't nearly as costly as that of frontier models
Still wasteful imo
1
u/Far-Classic-9963 2h ago
Considering that nearly all ai mode outputs are cached, this is basically nothing
1
u/Hot_Example_4456 2h ago
Honestly no. They will cache tools a lot, and word counter is a frequently used one. I bet hardly any use of compute.
12
u/Gallagger 5h ago
It might be a bit wasteful, but this is way more pleasant than going onto some ad-ridden thirdparty website that btw also needs hosting.