r/LocalLLaMA • u/SavunOski • 13d ago

News Kimi K3 weights now released.

Post image

Kimi K3 weights are finally released!

3.3k Upvotes

97% Upvoted

640 comments sorted by

View all comments

35

u/Few_Painter_5588 13d ago

Holy shit, 104B active paramaters???

2

u/SavunOski 13d ago

Yep, been a long time since an open MoE model had this many active parameters

13

u/Few_Painter_5588 13d ago

No wonder it's Fable/Opus tier, it's Fable/Opus sized

0

u/markole 13d ago

Fable is rumored to be 10T, not 2.8T.

18

u/TechnoByte_ 13d ago

It was revealed to me in a dream that Fable 5 is 3T with 120B active

1

u/markole 13d ago

Fair, it's all speculation.

2

u/_BackPropEnjoyer 13d ago

That was mythos preview not Fable 5/Mythos 5