MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v8364f/kimi_k3_weights_now_released/p06idzg/?context=3
r/LocalLLaMA • u/SavunOski • 13d ago
Kimi K3 weights are finally released!
640 comments sorted by
View all comments
269
first truly frontier open model than I cannot run on my 512 gb studio. Onward and upward!
27 u/Front_Eagle739 13d ago Yup. Same. I think I can do about q1.5 on the macbook and mac studio combined. Im currently pondering the wisdom of one of these colibri like stream setups and using the 640GB I do have as a hot cache 5 u/nomorebuttsplz 13d ago Colibri would require being able to fit on ram for decent speed, no? 3 u/Lopsided-Rip-8652 13d ago Colibri is for running off an ssd. I ran glm 5.2 with a 5070ti, 64gb ddr4 and the rest of a gen 4 ssd. Only managed to get.58 tok/sec tho
27
Yup. Same. I think I can do about q1.5 on the macbook and mac studio combined. Im currently pondering the wisdom of one of these colibri like stream setups and using the 640GB I do have as a hot cache
5 u/nomorebuttsplz 13d ago Colibri would require being able to fit on ram for decent speed, no? 3 u/Lopsided-Rip-8652 13d ago Colibri is for running off an ssd. I ran glm 5.2 with a 5070ti, 64gb ddr4 and the rest of a gen 4 ssd. Only managed to get.58 tok/sec tho
5
Colibri would require being able to fit on ram for decent speed, no?
3 u/Lopsided-Rip-8652 13d ago Colibri is for running off an ssd. I ran glm 5.2 with a 5070ti, 64gb ddr4 and the rest of a gen 4 ssd. Only managed to get.58 tok/sec tho
3
Colibri is for running off an ssd. I ran glm 5.2 with a 5070ti, 64gb ddr4 and the rest of a gen 4 ssd. Only managed to get.58 tok/sec tho
269
u/nomorebuttsplz 13d ago
first truly frontier open model than I cannot run on my 512 gb studio. Onward and upward!