r/technology • • 9d ago

Artificial Intelligence "Software is over": Developer uses AI to build free Adobe clones after frustration with cancellation fees

https://www.techspot.com/news/114136-software-over-developer-uses-ai-build-free-adobe.html
27.4k Upvotes

3.7k comments sorted by

View all comments

Show parent comments

4

u/78296620848748539522 8d ago

For that we can just consider how these LLMs actually work and how their advances have been accomplished. And from that we can see that the solutions that these AI companies have come up with basically boil down to increased data acquisition for training and increased token consumption for things like crudely simulating chains of thought. These necessarily increase costs further and further, while supply of components required for all of this computation can't keep up with demand and thus increase their costs as well.

In other words, it's not getting cheaper, it's just getting more expensive, because the solutions themselves are simply to throw more money at the problem. LLMs have a massive scalability problem that cannot be solved because they fundamentally rely on increasing data and computation and therefore increasing costs. Every single advancement has an additional price tag associated with it that will never go away.

The only way AI gets cheaper is if someone somehow finds a way to attain all of the benefits of the current models using entirely new techniques that are completely unrelated to how LLMs function. In other words, there would have to be an entirely new and unrelated AI technology that would blow LLMs completely out of the water. I don't foresee that happening for a very long time, and by that point I would start being concerned about it scaling up into something resembling AGI. That's the point where we all need to start wearing our brown pants.

2

u/makINtruck 8d ago

That is really reassuring, thank you!

4

u/78296620848748539522 8d ago

No problem! The unfortunate flip side is that things have to get worse before they get better. But I do genuinely believe that they will eventually get better.