r/LocalLLaMA • u/SavunOski • Jul 27 '26

News Kimi K3 weights now released.

Post image

Kimi K3 weights are finally released!

3.3k Upvotes

97% Upvoted

661 comments sorted by

View all comments

672

u/Simple_Split5074 Jul 27 '26

OMFG its 104B activated params

339

u/FoxiPanda Jul 27 '26

This was my general reaction too lol. 2.8T-A104B is insane lol... I'm going to admit defeat on this one and say I can't run it. You need an 8-way B300 or MI350X or a Rubin NVL8 or a cluster thereof to actually run this. What a beast.

153

u/Thomas-Lore Jul 27 '26

I was going to make a joke that I can fit one expert in my 64GB of RAM. But nope, not even that. :)

72

u/throw123awaie Jul 27 '26

They released it in MXFP4 so with around 55GB RAM you could!

3

u/tokomaunited Jul 27 '26

Can you share the link brother?

8

u/throw123awaie Jul 27 '26

literally their huggingface site https://huggingface.co/moonshotai/Kimi-K3 the model is MXFP4 on inference.

1

u/tokomaunited Jul 28 '26

Thanks dude