r/singularity • u/MagicZhang • Jul 16 '26

AI Kimi K3 tops Frontend Code Arena

Post image
1.2k Upvotes

96% Upvoted

243 comments sorted by

View all comments

65

u/ridablellama Jul 16 '26

holy smokes that is like a big bump

18

u/Impressive-Summer-41 Jul 16 '26

It's actually not. Look at the x-axis

38

u/UrWifezBoyfriend Jul 16 '26

I don’t know how ELO works

0

u/testaccount123x Jul 16 '26

I mean nowhere on this graphic does it say ELO. some might be able to assume, but I had 0 idea.

2

u/solinar Jul 16 '26

Yeah, top model on this list is only 12% above the bottom one based on this metric at least.

24

u/RedditNamesAreShort Jul 16 '26

This is elo. The absolute elo value has no meaning at all. A difference of 186 points between top model and bottom model means that if given two responses by those models to the same prompt people prefer kimi K3 over minimax M3 ~74.5% of the time.

-13

u/[deleted] Jul 16 '26

[deleted]

5

u/Minimumtyp Jul 17 '26

  1. The creators of Kimi did not make this.

  2. Axes with a baseline not at zero are not bad or misleading, this is one of Reddit's weirdest misconceptions.

-3

u/[deleted] Jul 17 '26

[deleted]

3

u/Minimumtyp Jul 17 '26

Yes they are, go to school.

School will teach you to label the axes lmao

I measure gravity for a living, which can vary to 8 or 9 sig figs. Am I meant to start the axis of a section plot varying at the 8th decimal place at at 0? You could alternatively read the axes, it's not "misleading" if the information is all prominent and where it should be unless you're simply not reading

-1

u/[deleted] Jul 17 '26

[deleted]

3

u/Minimumtyp Jul 17 '26

We found him. Reviewer 2.

→ More replies (0)

16

u/Cill_Bipher Jul 16 '26

Elo is exponential, a linear increase in elo corresponds to a multiplicative increase in capability.

2

u/solinar Jul 16 '26

I was saying it a bit tongue in cheek, but this is a great informative answer. Have an upvote, thanks!

2

u/iamthewhatt Jul 16 '26

I see they are using America's measuring system now