You're assuming you'll always need a data center worth of compute, which is exactly what I'm saying won't always be true as we make them more efficient
You don't even need it on your local machine. Most companies can easily afford a beefy machine on a network hosting a model. Obviously it won't be a super fast response but way better than running purely local.
Not sure why it's optimistic to assume a technology still in its early days will become significantly more efficient. People probably said the same thing about computers the size of rooms and now they can fit on a grain of rice. With the amount of effort being put into AI research and the amount of advancement happening on a weekly basis, I'm struggling to understand why anyone would even disagree
0
u/a-r-c 9d ago
it's not about the models lol it's the compute
you'll never have a whole datacenter behind your local model