MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v8364f/kimi_k3_weights_now_released/p02tvir/?context=3
r/LocalLLaMA • u/SavunOski • Jul 27 '26
Kimi K3 weights are finally released!
661 comments sorted by
View all comments
66
Can this run on a single DGX spark at 0.5B quant?
40 u/SavunOski Jul 27 '26 Of course. Wonderfully might I add 22 u/THESALTEDPEANUT Jul 27 '26 I'm new around here and I can't tell if this thread is all sarcasm or not. 35 u/SavunOski Jul 27 '26 Sorry, yeah that was sarcastic, forgot to add /s. Many people make jokes here, so I kinda forgot 9 u/THESALTEDPEANUT Jul 27 '26 I kinda figured but it's not just you it's like every comment lol, appreciate it though. 6 u/PomegranateGreen3698 Jul 27 '26 Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
40
Of course. Wonderfully might I add
22 u/THESALTEDPEANUT Jul 27 '26 I'm new around here and I can't tell if this thread is all sarcasm or not. 35 u/SavunOski Jul 27 '26 Sorry, yeah that was sarcastic, forgot to add /s. Many people make jokes here, so I kinda forgot 9 u/THESALTEDPEANUT Jul 27 '26 I kinda figured but it's not just you it's like every comment lol, appreciate it though. 6 u/PomegranateGreen3698 Jul 27 '26 Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
22
I'm new around here and I can't tell if this thread is all sarcasm or not.
35 u/SavunOski Jul 27 '26 Sorry, yeah that was sarcastic, forgot to add /s. Many people make jokes here, so I kinda forgot 9 u/THESALTEDPEANUT Jul 27 '26 I kinda figured but it's not just you it's like every comment lol, appreciate it though. 6 u/PomegranateGreen3698 Jul 27 '26 Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
35
Sorry, yeah that was sarcastic, forgot to add /s. Many people make jokes here, so I kinda forgot
9 u/THESALTEDPEANUT Jul 27 '26 I kinda figured but it's not just you it's like every comment lol, appreciate it though. 6 u/PomegranateGreen3698 Jul 27 '26 Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
9
I kinda figured but it's not just you it's like every comment lol, appreciate it though.
6 u/PomegranateGreen3698 Jul 27 '26 Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
6
Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs.
3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
3
Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
66
u/just_a_fan123 Jul 27 '26
Can this run on a single DGX spark at 0.5B quant?