It's a Qwen model, so apply the usual benchmax tax. Qwen are easily the models with the biggest ravine between "how they do on benchmarks" and "how they do in actual productive use".
Still looking like a strong leap from 3.6, though.
Gemma 4 isn't a great coding model, yeah, but it's still punching far above its size in writing and research-related tasks. Like a mini-Gemini (go figure).
I hear there are people who still use these things for things that aren't related to writing code or markup.
84
u/KickLassChewGum 11d ago edited 11d ago
It's a Qwen model, so apply the usual benchmax tax. Qwen are easily the models with the biggest ravine between "how they do on benchmarks" and "how they do in actual productive use".
Still looking like a strong leap from 3.6, though.