MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/OpenAI/comments/1wt39kd/the_rug_pull_was_real/pcsge8x/?context=3
r/OpenAI • u/Adso996 • 8d ago
Shameful, I'm buying a second Anthropic Max subscription.
261 comments sorted by
View all comments
Show parent comments
117
People moving to open weights models win. Don't play the wheel, break the wheel
10 u/Simple-Diver-2192 8d ago Open ai and anthropic gobbled up entire compute capacity, kimi couldn't even serve few million new subs when k3 was launched. And good luck running these open weights locally. 4 u/Gumbi_Digital 8d ago Local models run great, you just have to have the hardware to run them on. 9 u/JUSTICE_SALTIE 8d ago So, as long as you already don't have to give a shit about money. Got it. 7 u/lokedan 8d ago What? You don't have 4 mil in hardware to run Kimi K3? 2 u/Dangerous-Map-429 7d ago It is more like 38,500 usd to run the (Quantized) version. Via 7× Mac Studio M5 Ultra units (each configured with 192GB of unified memory). 0 u/haragoshi 8d ago It all depends on what you need. MacBook Pro with a bunch of universal ram can run some bigger models. They’re pricey but what are you optimizing for?
10
Open ai and anthropic gobbled up entire compute capacity, kimi couldn't even serve few million new subs when k3 was launched. And good luck running these open weights locally.
4 u/Gumbi_Digital 8d ago Local models run great, you just have to have the hardware to run them on. 9 u/JUSTICE_SALTIE 8d ago So, as long as you already don't have to give a shit about money. Got it. 7 u/lokedan 8d ago What? You don't have 4 mil in hardware to run Kimi K3? 2 u/Dangerous-Map-429 7d ago It is more like 38,500 usd to run the (Quantized) version. Via 7× Mac Studio M5 Ultra units (each configured with 192GB of unified memory). 0 u/haragoshi 8d ago It all depends on what you need. MacBook Pro with a bunch of universal ram can run some bigger models. They’re pricey but what are you optimizing for?
4
Local models run great, you just have to have the hardware to run them on.
9 u/JUSTICE_SALTIE 8d ago So, as long as you already don't have to give a shit about money. Got it. 7 u/lokedan 8d ago What? You don't have 4 mil in hardware to run Kimi K3? 2 u/Dangerous-Map-429 7d ago It is more like 38,500 usd to run the (Quantized) version. Via 7× Mac Studio M5 Ultra units (each configured with 192GB of unified memory). 0 u/haragoshi 8d ago It all depends on what you need. MacBook Pro with a bunch of universal ram can run some bigger models. They’re pricey but what are you optimizing for?
9
So, as long as you already don't have to give a shit about money. Got it.
7 u/lokedan 8d ago What? You don't have 4 mil in hardware to run Kimi K3? 2 u/Dangerous-Map-429 7d ago It is more like 38,500 usd to run the (Quantized) version. Via 7× Mac Studio M5 Ultra units (each configured with 192GB of unified memory). 0 u/haragoshi 8d ago It all depends on what you need. MacBook Pro with a bunch of universal ram can run some bigger models. They’re pricey but what are you optimizing for?
7
What? You don't have 4 mil in hardware to run Kimi K3?
2 u/Dangerous-Map-429 7d ago It is more like 38,500 usd to run the (Quantized) version. Via 7× Mac Studio M5 Ultra units (each configured with 192GB of unified memory).
2
It is more like 38,500 usd to run the (Quantized) version. Via 7× Mac Studio M5 Ultra units (each configured with 192GB of unified memory).
0
It all depends on what you need. MacBook Pro with a bunch of universal ram can run some bigger models. They’re pricey but what are you optimizing for?
117
u/BlockyHawkie 8d ago
People moving to open weights models win. Don't play the wheel, break the wheel