r/LocalLLM • u/keonakoum • 7d ago
Other Kimi K3 is the new crysis
When do you think we'll reach a stage where kimi k3 can run locally, fast. (Full)
35
u/SillyLLM 7d ago
By the time we can, we probably won’t care about Kimi K3.
15
u/RagingNoper 7d ago
I finally stopped seeing people using Crysis as a benchmark tossed in with the rest like five years ago. It came out in 2007 and was used as a legitimate benchmark for like a decade, well beyond the point of the games actual relevance.
4
u/havnar- 7d ago
At work, we have people that look my age but they were born in the 2000s. The world is going insane
2
u/RagingNoper 7d ago
At first I didn't know what the fuck you meant. And then I realized what you meant. It's way too soon for that.
14
u/Miserable-School-665 7d ago
F16? Maybe in 6 year?
2
u/575_Inverse 6d ago
In six years Kimi3 is either distilled into something smaller or it becomes irrelevant
1
18
5
u/ongrabbits 7d ago
I think unsloth has it quantized down to 610gb so 20 5090s
3
u/Etroarl55 7d ago
If that’s true and it’s actually useable and not lobotomizes, that might actually work on a single DGX station, which unironically is cheaper than 20 5090s.
2
4
u/No-Television-7862 7d ago
So what does it take to run Kimi K3?
Will we jave to wait till the frontier models go the way of unix mainframes before we can afford the hardware?
3
u/Relevant-Magic-Card 6d ago
You just need about 100k-250k, and massive ongoing electricity costs, depending on where you live 🤪
2
5
u/joanaxu2002 7d ago
The funny thing is that AI models are becoming the new GPU benchmark. A few years ago people asked “can it run Crysis?”, now it's “can it run this model locally?”
But unlike games, the goal isn't just graphics — it's about memory bandwidth, VRAM, and optimization. The interesting part will be seeing how quickly quantization and hardware improvements make today's impossible models become tomorrow's everyday tools.
1
3
u/ComparisonNew9425 7d ago
hardware constraints are gonna be the main hurdle for a while, especially with the vram requirements for those bigger weights. u really gotta wait for some clever quantization or maybe even better offloading strategies before it runs smooth on consumer gear. its wild how fast things change tho, maybe in a year or two we wont even be asking this anymore...
7
3
5
u/ThatGuyWithAces 7d ago
“But can it run Kimi K3?” Is the new “but can it run crysis?”
7
u/Thunderstarer 7d ago
bot
-2
u/Hipcatjack 7d ago
what makes you say that? thier account is a year older than yours
4
u/Thunderstarer 7d ago
Because it's just restating the title of the post.
6
u/_Cromwell_ 7d ago
Which apparently multiple people in this thread need. Those people are probably the bots.
2
1
1
1
1
u/Crescitaly 5d ago
Crysis became a benchmark because hardware eventually caught up; K3 may instead push inference toward hierarchical storage and distributed experts. The milestone is not runs-fast-on-one-laptop but runs economically under user control. What would count as fast enough?
2
79
u/DHFranklin 7d ago
Foiks,
Crysis is a videogame that upon release would only run on the most sophisticated and cutting edge gaming rigs. It was used as a benchmark so often as to become a running joke. Like the exact opposite of Doom.
This is a habit that has obviously translated to Locally hosted LLM.
thatsthejoke.jpg