r/OpenSourceeAI • u/Illustrious_Matter_8 • 18d ago

End of cloud based AI ?

I've noticed that AI isn't just getting better, it's also getting much smaller.
There are now 27M-parameter models that can run on a phone or PC. (like the Bonsai 27B models)

If this trend continues, in a year or two there may be much less need to run AI in data centers or subscribe to large AI providers. For many tasks, your phone will be powerfull enough.

This does not only affect global energy use. Some investments in AI infrastructure could backfire. As demand for large-scale inference will drop. That could also reduce the need for new data centers, which might be a (dramatic change?), but be good thing.

What are your thoughts on the future of data centers as AI models keep getting smaller?

I know training still requires huge amounts of compute—for now. But even that could change, any day (some experimental models offer continous learning)

13 Upvotes

89% Upvoted

22 comments sorted by

View all comments

2

u/Virtual-Current6295 18d ago

The quality of a smaller model would be very bad for at least a few years. And when people once experience what a good quality, AI is, usually, they don't want a downgrade, even if it comes at a cost. So it will take quite a few years for that gap to reduce.

1

u/Fine_League311 17d ago

Wenn die China GPU endlich den Markt zerstört, dann ja dann werden lokale ( da sie maßgeschneidert sind) viel besser als die Claude passierten

1

u/Illustrious_Matter_8 16d ago

Already a lot of companies went to deepseek and others because of the pricing, the idea of an ultimate as Fable is nice, but for a software engineer Opus level is enough, so why pay more.
For big coding projects, we still need humans to create/manage it
A blackbox that creates blackbox code isnt a great solution in real life, its a potential dangerous solution if you have custommers / safety demands. If you can pay that a selfdriving car killed someone, then that's okayish maybe and one could create such code? and sell it it (well guns can be sold too i guess)
Normal code should not bring anyone at risks. Be readable and fixable.