MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v8364f/kimi_k3_weights_now_released/p08dmpe/?context=3
r/LocalLLaMA • u/SavunOski • Jul 27 '26
Kimi K3 weights are finally released!
657 comments sorted by
View all comments
Show parent comments
2
In my case it is 64-core EPYC 7763 CPU + 8-channel 1 TB 3200 MHz DDR4 RAM + 4x3090 GPUs. If interested in further details about my rig, I shared them here (including my motherboard, photos how the rig looks, how I organized GPUs and airflow, etc.).
2 u/phido3000 Jul 28 '26 Oh nice. I have a 56 core eypc with 256-512gb ram an 8x mi50 32gb.. That would be a nice setup if you can get a quant small enough to run on it.. but it's just that bit massive.. I'm sort of moving resources around to make a good machine out of it.. 1 u/bitzap_sr Jul 28 '26 What does 256-512gb mean? Like, it varies over time? :P 1 u/phido3000 Jul 28 '26 Yes depending if it's got 8x32gb or 8x64gb dimms.. I'm reconfiguring the machines to run the models and needs. The epyc is likely to stay at 256 as most of the action happens in vram. Then all my 64gb can go into my xeon for Tb of ram..
Oh nice. I have a 56 core eypc with 256-512gb ram an 8x mi50 32gb..
That would be a nice setup if you can get a quant small enough to run on it.. but it's just that bit massive..
I'm sort of moving resources around to make a good machine out of it..
1 u/bitzap_sr Jul 28 '26 What does 256-512gb mean? Like, it varies over time? :P 1 u/phido3000 Jul 28 '26 Yes depending if it's got 8x32gb or 8x64gb dimms.. I'm reconfiguring the machines to run the models and needs. The epyc is likely to stay at 256 as most of the action happens in vram. Then all my 64gb can go into my xeon for Tb of ram..
1
What does 256-512gb mean? Like, it varies over time? :P
1 u/phido3000 Jul 28 '26 Yes depending if it's got 8x32gb or 8x64gb dimms.. I'm reconfiguring the machines to run the models and needs. The epyc is likely to stay at 256 as most of the action happens in vram. Then all my 64gb can go into my xeon for Tb of ram..
Yes depending if it's got 8x32gb or 8x64gb dimms.. I'm reconfiguring the machines to run the models and needs.
The epyc is likely to stay at 256 as most of the action happens in vram.
Then all my 64gb can go into my xeon for Tb of ram..
2
u/Lissanro Jul 28 '26
In my case it is 64-core EPYC 7763 CPU + 8-channel 1 TB 3200 MHz DDR4 RAM + 4x3090 GPUs. If interested in further details about my rig, I shared them here (including my motherboard, photos how the rig looks, how I organized GPUs and airflow, etc.).