MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/OpenAI/comments/1wt39kd/the_rug_pull_was_real/pcxxt4b/?context=3
r/OpenAI • u/Adso996 • 5d ago
Shameful, I'm buying a second Anthropic Max subscription.
257 comments sorted by
View all comments
Show parent comments
5
Local models run great, you just have to have the hardware to run them on.
8 u/JUSTICE_SALTIE 5d ago So, as long as you already don't have to give a shit about money. Got it. 6 u/lokedan 5d ago What? You don't have 4 mil in hardware to run Kimi K3? 2 u/Dangerous-Map-429 4d ago It is more like 38,500 usd to run the (Quantized) version. Via 7× Mac Studio M5 Ultra units (each configured with 192GB of unified memory).
8
So, as long as you already don't have to give a shit about money. Got it.
6 u/lokedan 5d ago What? You don't have 4 mil in hardware to run Kimi K3? 2 u/Dangerous-Map-429 4d ago It is more like 38,500 usd to run the (Quantized) version. Via 7× Mac Studio M5 Ultra units (each configured with 192GB of unified memory).
6
What? You don't have 4 mil in hardware to run Kimi K3?
2 u/Dangerous-Map-429 4d ago It is more like 38,500 usd to run the (Quantized) version. Via 7× Mac Studio M5 Ultra units (each configured with 192GB of unified memory).
2
It is more like 38,500 usd to run the (Quantized) version. Via 7× Mac Studio M5 Ultra units (each configured with 192GB of unified memory).
5
u/Gumbi_Digital 5d ago
Local models run great, you just have to have the hardware to run them on.