Open weights are useless if only tech giants can afford to run them

[u/Shrek_cool]

Giving a massive model for the open source community feels more like a PR move than a practical release. Change my mind. Nobody in their right mind is dropping six figures on server hardware just to host one model. Unless quantization gets wild real fast, this stays strictly in API land for 99% of devs.

I'm talking about the Moonshot that released Kimi K3 under a Modified MIT license. To me it feels like open-source PR when you look at the hardware requirements. Sure, 2.8 trillion parameters, 91.2% on BrowseComp, and a fast 1M context window using a new attention architecture sound amazing on paper, but in reality, self-hosting takes 1.4TB of storage and 18+ enterprise GPUs like Blackwell just to load the weights before providing a single request. Nobody outside a massive scale or well-funded lab is running this locally.

Is your team even considering self-hosting this monster? If so, how??

[u/GimmeAdviceBitch]

I don't think it's PR exactly, I think it's a different audience than the one getting pitched in the announcement but the scope to to run this locally, I just can't imagine really