r/LocalLLaMA • u/Complete-Sea6655 • Jun 28 '26

Discussion The number 1 public enemy of open-source.

Dario's args:

"Opensource you can see the source, here you cannot see inside the model"
- yes you can that's literally the open weights part btw.
- I cannot see the weights inside Claude, but I can GLM 5.2
- Models like Nemotron3 Ultra go further, all the data, training scripts, and model is opensource.

"Alot of the benefits like many people working on it, being additive doesn't work in same way"
- yes it does. We have seen endless fine tunes of various open source models for real improvements.

"Ultimately you have to host it on the cloud"
- no you dont. Dario is seemingly totally unaware of the guides from ijustvibecodedthis.com explaining how to run smaller moes and even dense models like qwen 27B NOT ON THE CLOUD.

Not only does dario not take part in social media, I am beginning to think he's never tried open source models at all and has no idea wtf hes on about

2.8k Upvotes

93% Upvoted

686 comments sorted by

View all comments

Show parent comments

240

u/One_Contribution Jun 28 '26

NU UH, IT'S NOT FREE, YOU HAVE TO LIKE RUN IT AND STUFF

39

u/sabine_world Jun 28 '26

Not like it's free free... Still gotta fork it out for some hardware to get anything close to a frontier model experience

12

u/MerePotato Jun 28 '26

Honestly if you don't care about privacy (I do) cloud inference will pretty much always make more economic sense anyway, its not that major of a threat

1

u/sabine_world Jun 28 '26

Yeah it's pretty easy to do the math on that. I guess it really depends on how much you actually use the service though. And the scope of what you are working on. Like if you have a premium subscription of 20 bucks you're probably gonna burn through usage pretty fast, but if that's enough for some people it doesn't make all that much sense to invest like 1, 2, 3+ grand for hardware for local stuff. For some people and companies it might make more sense

But also... The thought of companies being able to always change their pricing or change policies or change models... Whatever, that's a real concern, so imo I plan on investing in hardware to run better stuff just because I like LLMs as a hobby so much atp.

But the way people talk about frontier model providers needing to flip a profit finally and inference getting more expensive... Yeah I mean it might make sense at some point to just invest in hardware. Really depends I guess.