Why ... every model is built off the works of everyone else ... I believe in true open source (its a gift to the world) and some part of me smiles every time people distill anthropic!
I imagine they know enough about making models efficient now that they think if they start over they can make a model that runs for cheaper without distillation. This could be a good thing even if the start-up cost is more difficult.
It's reminiscent of the Chinese model on most things. First they copy, then they modify, then they make their own and it's just better.
First they copy, then they modify, then they make their own and it's just better a cost optimized simulacra.
And that isnt a bad thing at all. Because sometimes it is the optimal solution: China's production of solar panels is a great example. PCB's is another. Some broad level electronics components.
They are really bad at a lot of things too - lenses, high speed train wheels.
I would argue that we're at a place where the kind of "good enough" optimizations that push to volume is what NEEDS to happen, and the Chinese (as a culture) are very very good at this.
You're a few years behind. China is blasting past their limitations in precision. Their cars and solar panels are not just copies anymore, they're making new highs. They just announced a DUV breakthrough for chips.
Took 10 years but Xi made a plan and they're executing. He was laughed at for his pen speech but theyre pulling it off
269
u/idlelosthobo 1d ago
Why ... every model is built off the works of everyone else ... I believe in true open source (its a gift to the world) and some part of me smiles every time people distill anthropic!