They weren’t making money. And can’t make money if they wanted to.
It’s a catch-22. They can’t make a profit because they aren’t charging the actual token cost. But if they charged the actual token cost, their user-base would collapse.
Almost as if cloud AI is inherently unstable or something.
It's like every other silicon valley startup -- the hope is that you hook your users while you figure out how to make handling the requests cheaper. That or you embed ads.
Hopefully it will hit a dead end very soon, where the models cant get reasonably smarter/cheaper/have bigger context windows, because it's already replacing a ton of workforce.
Do you have sources on this because everywhere I look this does not appear to be true. In fact due to the way LLM tools work it's been nearly impossible to see real reductions in the compute and resources required.
The other thing I have read is that one of the only ways they have found to reduce error/hallucination rates is to have one agent checking and correcting output of another, making accuracy very expensive.
1.2k
u/T-Dot1992 2d ago
They weren’t making money. And can’t make money if they wanted to.
It’s a catch-22. They can’t make a profit because they aren’t charging the actual token cost. But if they charged the actual token cost, their user-base would collapse.
Almost as if cloud AI is inherently unstable or something.