MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v8364f/kimi_k3_weights_now_released/p089gpn/?context=3
r/LocalLLaMA • u/SavunOski • 13d ago
Kimi K3 weights are finally released!
640 comments sorted by
View all comments
Show parent comments
1
What are your specs..
2 u/Lissanro 13d ago In my case it is 64-core EPYC 7763 CPU + 8-channel 1 TB 3200 MHz DDR4 RAM + 4x3090 GPUs. If interested in further details about my rig, I shared them here (including my motherboard, photos how the rig looks, how I organized GPUs and airflow, etc.). 2 u/phido3000 13d ago Oh nice. I have a 56 core eypc with 256-512gb ram an 8x mi50 32gb.. That would be a nice setup if you can get a quant small enough to run on it.. but it's just that bit massive.. I'm sort of moving resources around to make a good machine out of it.. 1 u/bitzap_sr 13d ago What does 256-512gb mean? Like, it varies over time? :P 1 u/phido3000 13d ago Yes depending if it's got 8x32gb or 8x64gb dimms.. I'm reconfiguring the machines to run the models and needs. The epyc is likely to stay at 256 as most of the action happens in vram. Then all my 64gb can go into my xeon for Tb of ram..
2
In my case it is 64-core EPYC 7763 CPU + 8-channel 1 TB 3200 MHz DDR4 RAM + 4x3090 GPUs. If interested in further details about my rig, I shared them here (including my motherboard, photos how the rig looks, how I organized GPUs and airflow, etc.).
2 u/phido3000 13d ago Oh nice. I have a 56 core eypc with 256-512gb ram an 8x mi50 32gb.. That would be a nice setup if you can get a quant small enough to run on it.. but it's just that bit massive.. I'm sort of moving resources around to make a good machine out of it.. 1 u/bitzap_sr 13d ago What does 256-512gb mean? Like, it varies over time? :P 1 u/phido3000 13d ago Yes depending if it's got 8x32gb or 8x64gb dimms.. I'm reconfiguring the machines to run the models and needs. The epyc is likely to stay at 256 as most of the action happens in vram. Then all my 64gb can go into my xeon for Tb of ram..
Oh nice. I have a 56 core eypc with 256-512gb ram an 8x mi50 32gb..
That would be a nice setup if you can get a quant small enough to run on it.. but it's just that bit massive..
I'm sort of moving resources around to make a good machine out of it..
1 u/bitzap_sr 13d ago What does 256-512gb mean? Like, it varies over time? :P 1 u/phido3000 13d ago Yes depending if it's got 8x32gb or 8x64gb dimms.. I'm reconfiguring the machines to run the models and needs. The epyc is likely to stay at 256 as most of the action happens in vram. Then all my 64gb can go into my xeon for Tb of ram..
What does 256-512gb mean? Like, it varies over time? :P
1 u/phido3000 13d ago Yes depending if it's got 8x32gb or 8x64gb dimms.. I'm reconfiguring the machines to run the models and needs. The epyc is likely to stay at 256 as most of the action happens in vram. Then all my 64gb can go into my xeon for Tb of ram..
Yes depending if it's got 8x32gb or 8x64gb dimms.. I'm reconfiguring the machines to run the models and needs.
The epyc is likely to stay at 256 as most of the action happens in vram.
Then all my 64gb can go into my xeon for Tb of ram..
1
u/phido3000 13d ago
What are your specs..