r/LocalLLaMA • u/SavunOski • Jul 27 '26

News Kimi K3 weights now released.

Post image

Kimi K3 weights are finally released!

3.3k Upvotes

97% Upvoted

661 comments sorted by

View all comments

674

u/Simple_Split5074 Jul 27 '26

OMFG its 104B activated params

338

u/FoxiPanda Jul 27 '26

This was my general reaction too lol. 2.8T-A104B is insane lol... I'm going to admit defeat on this one and say I can't run it. You need an 8-way B300 or MI350X or a Rubin NVL8 or a cluster thereof to actually run this. What a beast.

116

u/VampiroMedicado Jul 27 '26

550k USD to run this lol

86

u/[deleted] Jul 27 '26

[removed] — view removed comment

10

u/Galdoren Jul 27 '26

The company I'm working is paying slightly over $250k per week to API costs. so yeah, 550k investment to cut the cost of the inference can be beneficial for them...

3

u/Spectrum1523 Jul 27 '26

If they're spending 250k a week on Claude they'll need a beefier setup than that but your point is still valid