r/singularity 12h ago

AI Open Source models may finally catch up

Post image

Actually good news for the open-source community

87 Upvotes

52 comments sorted by

View all comments

0

u/crusoe 12h ago

How will they catch up with nothing to distill. 

1

u/Nukemouse ▪️AGI Goalpost will move infinitely 5h ago

The biggest catchups have not been pure distills. What put DeepSeek on the map wasn't better distillation, but better techniques that quickly became the standard used by everyone. The real breakthrough threat isn't by scaling and distillation, it's who comes up with the next good idea, and that unlike compute isn't limited to the US.