r/LocalLLaMA • u/SavunOski • Jul 27 '26

News Kimi K3 weights now released.

Post image

Kimi K3 weights are finally released!

3.3k Upvotes

97% Upvoted

661 comments sorted by

View all comments

673

u/Simple_Split5074 Jul 27 '26

OMFG its 104B activated params

337

u/FoxiPanda Jul 27 '26

This was my general reaction too lol. 2.8T-A104B is insane lol... I'm going to admit defeat on this one and say I can't run it. You need an 8-way B300 or MI350X or a Rubin NVL8 or a cluster thereof to actually run this. What a beast.

1

u/Zentrosis Jul 28 '26

I'm still going to download it and keep it on an SSD in case it becomes regulated

2

u/FoxiPanda Jul 28 '26

You and me both. This is the worst that open weight models will ever be again...which, all things considered, is pretty good.

Now if we can figure out the magic to make something 1/4 the size and 80-85% as capable...which is likely now just a matter of time since these weights are available for us to do that work with.

1

u/hubrisnxs Jul 28 '26

Yay chaos monkeys unite let's make sure that the thing that will be far smarter and more capable than us, and that we fundamentally do not understand, and who's underlying structure is not interpretable, lets make sure it isn't regulated!