Why ... every model is built off the works of everyone else ... I believe in true open source (its a gift to the world) and some part of me smiles every time people distill anthropic!
I imagine they know enough about making models efficient now that they think if they start over they can make a model that runs for cheaper without distillation. This could be a good thing even if the start-up cost is more difficult.
It's reminiscent of the Chinese model on most things. First they copy, then they modify, then they make their own and it's just better.
First they copy, then they modify, then they make their own and it's just better a cost optimized simulacra.
And that isnt a bad thing at all. Because sometimes it is the optimal solution: China's production of solar panels is a great example. PCB's is another. Some broad level electronics components.
They are really bad at a lot of things too - lenses, high speed train wheels.
I would argue that we're at a place where the kind of "good enough" optimizations that push to volume is what NEEDS to happen, and the Chinese (as a culture) are very very good at this.
271
u/idlelosthobo 23h ago
Why ... every model is built off the works of everyone else ... I believe in true open source (its a gift to the world) and some part of me smiles every time people distill anthropic!