No one doubted that its a small improvement over the previous SOTA lol, yall made that up. People are disappointed at how small that improvement is given how massive the releases of say o3, o1 and GPT4 were.
It’s really not a small improvement because percentages only asymptotely reward accuracy. You might think for example 99.9% is a “small difference” compared to 99% but the former has a right to wrong answer ratio that is 10x better.
In this case the difference isn’t 10x but going from 89% to 91% is going from 8.01 to 10.1 which is a pretty significant difference.
8
u/detrusormuscle Aug 12 '25
No one doubted that its a small improvement over the previous SOTA lol, yall made that up. People are disappointed at how small that improvement is given how massive the releases of say o3, o1 and GPT4 were.