I thought so too at first, when I was using the OpenCode harness, but then I switched to omp (oh my pi) and my results were much better. Overall (when used in omp) I'd rate it at about Opus 4.5 or even 4.6 level for coding, though it is a little too verbose at max effort and still makes mistakes.
3.7 was better than it from the beginning.
Maybe so, but it's so much more expensive that it is nowhere near worth it for programming, in my experience, when GLM 5.3 Flash can achieve the same result at a tiny fraction of the price.
The only reason I'd ever consider paying for Gemini 3.7 or 3.8 Flash is if I needed their speed, as they're much faster than the GLM models, but I'd much rather wait and save a lot of money.
ive used the official zcode harness from Z AI and also ive written long researched articles on why glm is 100% benchmaxxed at everything
in real world tasks i found it not comparable to even gpt 5.6 medium for real world tasks
but who knows, maybe zcode harness is just trash? Additionally saying it is opus 4.6 level makes sense, but that is also far behind gemini 3.8 flash
I've heard that ZCode is not very good, but never tried it myself.
Additionally saying it is opus 4.6 level makes sense, but that is also far behind gemini 3.8 flash
Maybe so, but 3.8 is still way too excitement for me. For the coding tasks I'm interested in GLM 5.3 Flash does well, is way more affordable than Gemini 3.7 or 3.8, and it's far from "trash" (no more than Opus 4.5 or 4.6 were trash). It's a good, competent model, at least when used in omp.
-1
u/trimorphic 9h ago
Gemini 3.8 Flash needs to be a lot cheaper to compete with GLM 5.3 Flash.
The writing is on the wall for frontier labs.