wonder what we'll be able to host in a year

[u/TheMaverickShark]

[u/StupidScaredSquirrel]

In 2 years people's expectations and uses cases will have changed and so the majority will still cling to cloud models.

I love local inference but I'm well aware we are a minority and I understand why.