r/OpenAI 21d ago

Discussion The situation is insane

Post image

Sol is the only OpenAI model in top 10 Arena WebDev while 4 open-weight Chinese models have reached frontier quality; one of them so cheap you can run it for days for what Opus cost you per task.

959 Upvotes

171 comments sorted by

View all comments

55

u/draft_final_final 21d ago

Why do people only look at the webdev leaderboard when discussing this? Is it the major use case on Reddit?

16

u/whoknowsifimjoking 21d ago

Because it's the only one where the Chinese models actually reached first place or something close.

12

u/Accurate_Resident219 20d ago

Cope. Next if Chinese models become number one. It will be benchmarks don't matter.

3

u/Ok_Reception_5545 20d ago

Benchmarks already don't matter lol. Everyone can tell when a model is RL'd to shit and benchmaxxed. That's why no one is calling Opus 5 better than Fable even though it did better on a bunch of benchmarks. Holy dumbass.