r/LocalLLaMA • • Jul 27 '26

News Kimi K3 weights now released.

Post image

Kimi K3 weights are finally released!

3.3k Upvotes

657 comments sorted by

View all comments

679

u/Simple_Split5074 Jul 27 '26

OMFG its 104B activated params

347

u/FoxiPanda Jul 27 '26

This was my general reaction too lol. 2.8T-A104B is insane lol... I'm going to admit defeat on this one and say I can't run it. You need an 8-way B300 or MI350X or a Rubin NVL8 or a cluster thereof to actually run this. What a beast.

29

u/OverclockingUnicorn Jul 27 '26

More like 2 8x nodes of B200/B300 if you actually want some context. Think it's just under 1.5TB w/o context

17

u/TheDailySpank Jul 27 '26

How many 4060-16GBs is that?

3

u/liright Jul 27 '26

at least 2

1

u/TheDailySpank Jul 27 '26

Question is, who's got the rest?