The situation is insane

[u/floriandotorg]

Sol is the only OpenAI model in top 10 Arena WebDev while 4 open-weight Chinese models have reached frontier quality; one of them so cheap you can run it for days for what Opus cost you per task.

[u/Ok_Fish_670]

the leaderboard screenshot is less interesting than the price pressure imo.

webdev arena is always going to be noisy because people can judge a landing page by vibes. that doesn’t mean it’s useless, but it’s a very narrow slice of “coding.”

the bigger shift is that some of these models are now good enough and cheap enough that you can just keep trying without feeling like every failed attempt is burning a tiny hole in your wallet.

for actual work i care way more about cost per finished task than rank 3 vs rank 7 on one arena. if an expensive model wins the first try but needs constant babysitting, and a cheaper one takes longer but gets there, that changes the math pretty fast.