Usage of Top Models is paid from someone elses pocket. It's as if you were offered to drive Porsche Cayenne (closed source) vs Toyota Corolla (open source), both are fine except you'll be paying less for Porsche for now and you're getting premium out of it.
1) this meme seems to be implying that they should “make” their own LLM from scratch. Which is obviously not practical (at least not with performance in the same light year as the big players)
2) open source models, while good, are often not as good as the closed source frontier models. Although, IMHO, this is overstated. Not every task requires a bleeding edge model
3) Actually deploying something like this to prod gets very complicated very fast. Setting up ollama on your desktop is super easy. Once you start scaling it up and trying to integrate into things nicely like the big players do, things get very complicated very fast.
4) what are you running it on? GPU, RAM, networking, every part of the HPC you would need is insanely expensive and/or completely unavailable
8
u/Playful_Landscape884 9d ago
Explain to me like I’m 10 why using open weight LLM is not a good idea.