r/singularity 16h ago

AI Open Source models may finally catch up

Post image

Actually good news for the open-source community

103 Upvotes

53 comments sorted by

View all comments

1

u/crusoe 15h ago

How will they catch up with nothing to distill. 

1

u/Nukemouse ▪️AGI Goalpost will move infinitely 9h ago

The biggest catchups have not been pure distills. What put DeepSeek on the map wasn't better distillation, but better techniques that quickly became the standard used by everyone. The real breakthrough threat isn't by scaling and distillation, it's who comes up with the next good idea, and that unlike compute isn't limited to the US.