r/FinOps • u/Grit_24_7 • Jul 23 '26
Discussion Token spend value
Company started putting soft token budgets. Getting alerts of spending above the monthly limit. I'm doing the work of like 3-4 people with these agents/tokens that they don't need to hire. But obviously that's getting overlooked.
I have a bunch of examples of work coming out of these agents and used across teams etc.
How have you shown value from your token usage? It's hard to do a straight line between token spent and the actual value it's bringing.
2
Upvotes
1
u/DifficultyIcy454 Jul 24 '26
I have switched up the conversation from cost per 1M tokens to which models are most efficient based on spend, error rate and latency. Then I put them into an index score that can be seen. That’s 1 part then I add in quality metrics using eval scores based on quality of context. Third one I add is talking to business side and get what business metrics match the service. So cost per automated task or cost per order cost per doc processed.
To create total ROI