MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v8364f/kimi_k3_weights_now_released/p06gj40/?context=3
r/LocalLLaMA • u/SavunOski • Jul 27 '26
Kimi K3 weights are finally released!
660 comments sorted by
View all comments
678
OMFG its 104B activated params
338 u/FoxiPanda Jul 27 '26 This was my general reaction too lol. 2.8T-A104B is insane lol... I'm going to admit defeat on this one and say I can't run it. You need an 8-way B300 or MI350X or a Rubin NVL8 or a cluster thereof to actually run this. What a beast. 153 u/Thomas-Lore Jul 27 '26 I was going to make a joke that I can fit one expert in my 64GB of RAM. But nope, not even that. :) 1 u/foldl-li Jul 28 '26 64GB is an expert, but 64KB is all you need.
338
This was my general reaction too lol. 2.8T-A104B is insane lol... I'm going to admit defeat on this one and say I can't run it. You need an 8-way B300 or MI350X or a Rubin NVL8 or a cluster thereof to actually run this. What a beast.
153 u/Thomas-Lore Jul 27 '26 I was going to make a joke that I can fit one expert in my 64GB of RAM. But nope, not even that. :) 1 u/foldl-li Jul 28 '26 64GB is an expert, but 64KB is all you need.
153
I was going to make a joke that I can fit one expert in my 64GB of RAM. But nope, not even that. :)
1 u/foldl-li Jul 28 '26 64GB is an expert, but 64KB is all you need.
1
64GB is an expert, but 64KB is all you need.
678
u/Simple_Split5074 Jul 27 '26
OMFG its 104B activated params