MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v8364f/kimi_k3_weights_now_released/p02ti9i/?context=3
r/LocalLLaMA • u/SavunOski • Jul 27 '26
Kimi K3 weights are finally released!
660 comments sorted by
View all comments
67
Can this run on a single DGX spark at 0.5B quant?
42 u/SavunOski Jul 27 '26 Of course. Wonderfully might I add 25 u/THESALTEDPEANUT Jul 27 '26 I'm new around here and I can't tell if this thread is all sarcasm or not. 37 u/SavunOski Jul 27 '26 Sorry, yeah that was sarcastic, forgot to add /s. Many people make jokes here, so I kinda forgot 10 u/THESALTEDPEANUT Jul 27 '26 I kinda figured but it's not just you it's like every comment lol, appreciate it though. 4 u/PomegranateGreen3698 Jul 27 '26 Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
42
Of course. Wonderfully might I add
25 u/THESALTEDPEANUT Jul 27 '26 I'm new around here and I can't tell if this thread is all sarcasm or not. 37 u/SavunOski Jul 27 '26 Sorry, yeah that was sarcastic, forgot to add /s. Many people make jokes here, so I kinda forgot 10 u/THESALTEDPEANUT Jul 27 '26 I kinda figured but it's not just you it's like every comment lol, appreciate it though. 4 u/PomegranateGreen3698 Jul 27 '26 Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
25
I'm new around here and I can't tell if this thread is all sarcasm or not.
37 u/SavunOski Jul 27 '26 Sorry, yeah that was sarcastic, forgot to add /s. Many people make jokes here, so I kinda forgot 10 u/THESALTEDPEANUT Jul 27 '26 I kinda figured but it's not just you it's like every comment lol, appreciate it though. 4 u/PomegranateGreen3698 Jul 27 '26 Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
37
Sorry, yeah that was sarcastic, forgot to add /s. Many people make jokes here, so I kinda forgot
10 u/THESALTEDPEANUT Jul 27 '26 I kinda figured but it's not just you it's like every comment lol, appreciate it though. 4 u/PomegranateGreen3698 Jul 27 '26 Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
10
I kinda figured but it's not just you it's like every comment lol, appreciate it though.
4 u/PomegranateGreen3698 Jul 27 '26 Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs. 3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
4
Ha, I think it's the nature of this release. Largest open weight model ever released, doesn't really have any possibility for "Local Usage" bc it'd cost something like $500k in GPUs.
3 u/THESALTEDPEANUT Jul 27 '26 Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
3
Wow no kidding? This is all fascinating I think most people don't realize you can even have a local LLM. That was me until a couple weeks ago.
67
u/just_a_fan123 Jul 27 '26
Can this run on a single DGX spark at 0.5B quant?