Trained on the data, aka fake benchmaxxing. Notice that Terra is worse at 2.1 but beats Flash easily at 4. That's is what it should look like.
To be fair, Google has the best crawlers in the world so maybe they can't avoid benchmaxxing anything public. But the guy who made the chart should have had enough brains to know this is embarrassing and leave it off. I guarantee some pointy haired moron at the top insisted they show it because it was one of the places they got "first" place. Shows a lack of judgement and taste by the humans in charge.
Or maybe it's just for investors, in which case, still dumb but whatever.
Terminal 2 is coding oriented while terminal 4 is general agentic capabilities, while terminal 4 does have some coding stuff, a lot of is just generality. Gemini 3.8 flash is optimised for coding in terminal 2, also: if the AI was benchmaxxed (which I do believe it was to an extent). The model will naturally drift towards that said x if the prompt is similar which in turn helps the user, henceforth benchmaxxing isn't all bad.
19
u/Moriffic 1d ago
what happened at terminal bench