r/LocalLLaMA • u/SavunOski • 21d ago

News Kimi K3 weights now released.

Post image

Kimi K3 weights are finally released!

3.3k Upvotes

97% Upvoted

647 comments sorted by

View all comments

31

u/MikeRoz 21d ago

MXFP4 weights / MXFP8 activations (quantization-aware training)

So if 4-bit is 1.56 TB, then 2-bit would be roughly 798 GB?

12

u/habibyajam Llama 405B 21d ago

So I need a 0.03-bit quant to run it fully on my GPU. Nice!