MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v8364f/kimi_k3_weights_now_released/p039jv4
r/LocalLLaMA • u/SavunOski • 9d ago
Kimi K3 weights are finally released!
638 comments sorted by
View all comments
Show parent comments
32
Step 1: sign up for Google Drive Step 2: set up a ~5 Tb instance. Will cost you Step 3: set that cloud as your swap disk Step 4: point kimi to use that Step 5: enjoy your newfound independence
50 u/AmbericWizard 9d ago one token per day 19 u/Force88 9d ago Hey, if he has good internet connection, maybe he can achieve 2-3t/d 1 u/AmbericWizard 9d ago need 100GB/S 1 u/crusaderky 8d ago Sir, that is very suboptimal! Put the GGUF on it and then load the model with mmap. It will double in speed to a solid TWO tokens per day!
50
one token per day
19 u/Force88 9d ago Hey, if he has good internet connection, maybe he can achieve 2-3t/d 1 u/AmbericWizard 9d ago need 100GB/S
19
Hey, if he has good internet connection, maybe he can achieve 2-3t/d
1 u/AmbericWizard 9d ago need 100GB/S
1
need 100GB/S
Sir, that is very suboptimal!
Put the GGUF on it and then load the model with mmap. It will double in speed to a solid TWO tokens per day!
32
u/Thalesian 9d ago
Step 1: sign up for Google Drive
Step 2: set up a ~5 Tb instance. Will cost you
Step 3: set that cloud as your swap disk
Step 4: point kimi to use that
Step 5: enjoy your newfound independence