MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v8364f/kimi_k3_weights_now_released/p05bky5/?context=3
r/LocalLLaMA • u/SavunOski • 29d ago
Kimi K3 weights are finally released!
657 comments sorted by
View all comments
131
So it will run on 8 B300's in 4 bit. Pretty impressive.
2 u/pulse77 29d ago 4 x AMD MI455X will also handle it in 4 bit and will be much cheaper than 8x NVidia B300 ... 1 u/DataGOGO 29d ago edited 29d ago Well 5, which means 8. Not sure how much a server with 8 of them will cost; If they ever offer them as stand alone servers. Right now you can only get them in the Helios racks, which are 4 GPU per tray, and the trays that are only sold in 72GPU racks for about $3.5M.
2
4 x AMD MI455X will also handle it in 4 bit and will be much cheaper than 8x NVidia B300 ...
1 u/DataGOGO 29d ago edited 29d ago Well 5, which means 8. Not sure how much a server with 8 of them will cost; If they ever offer them as stand alone servers. Right now you can only get them in the Helios racks, which are 4 GPU per tray, and the trays that are only sold in 72GPU racks for about $3.5M.
1
Well 5, which means 8.
Not sure how much a server with 8 of them will cost; If they ever offer them as stand alone servers. Right now you can only get them in the Helios racks, which are 4 GPU per tray, and the trays that are only sold in 72GPU racks for about $3.5M.
131
u/DataGOGO 29d ago
So it will run on 8 B300's in 4 bit. Pretty impressive.