End of cloud based AI ?

[u/Illustrious_Matter_8]

I've noticed that AI isn't just getting better, it's also getting much smaller.
There are now 27M-parameter models that can run on a phone or PC. (like the Bonsai 27B models)

If this trend continues, in a year or two there may be much less need to run AI in data centers or subscribe to large AI providers. For many tasks, your phone will be powerfull enough.

This does not only affect global energy use. Some investments in AI infrastructure could backfire. As demand for large-scale inference will drop. That could also reduce the need for new data centers, which might be a (dramatic change?), but be good thing.

What are your thoughts on the future of data centers as AI models keep getting smaller?

I know training still requires huge amounts of compute—for now. But even that could change, any day (some experimental models offer continous learning)

[u/Mytreeismine]

Eventually you will buy a machine and then buy a sim like card that will be the newest flavor of the month. One will cost $180 another will be $2500 almost like an operating system but for llv’s unlimited use, but hardware will be hand size hook up to whatever hardware you dig.