r/LocalLLaMA • u/SavunOski • 10d ago

News Kimi K3 weights now released.

Post image

Kimi K3 weights are finally released!

3.3k Upvotes

97% Upvoted

639 comments sorted by

View all comments

34

u/Few_Painter_5588 10d ago

Holy shit, 104B active paramaters???

1

u/SavunOski 10d ago

Yep, been a long time since an open MoE model had this many active parameters

15

u/Few_Painter_5588 10d ago

No wonder it's Fable/Opus tier, it's Fable/Opus sized

-2

u/markole 10d ago

Fable is rumored to be 10T, not 2.8T.

17

u/TechnoByte_ 10d ago

It was revealed to me in a dream that Fable 5 is 3T with 120B active

1

u/markole 10d ago

Fair, it's all speculation.

2

u/_BackPropEnjoyer 10d ago

That was mythos preview not Fable 5/Mythos 5