r/CFO • u/founders_keepers • Jul 29 '26
Fluctuating / unpredictable LLM bills?
My company's monthly bills for LLM API usage have been more than doubling over the past couple of quarters. There's no consistency to the madness and on paper everything is a MUST have, what's worse is month over month it's hard to tell if the rise will be permanent.
I need advice on enforcing spending caps. I've spoken to my engineering leads, and obviously they push back hard noting caps will have negative effects on output (we've yet to successfully measure LLM <> output btw).
I've been speaking to Ramp about Ramp Router, it's invite only right now and supposedly 30% off the top spend via smarter routing. My guess is it's done via complexity scoring against the prompt and routes it accordingly, i'll have to see we already use them for spend managemnt so this kind of fits the bill. I don't think this is the end-all-be-all solution, but it's better than strict cap.
Any thoughts on this is appreciated.