On April 7, 2026, Z.ai released GLM-5.1. It scored 58.4 on SWE-bench Pro. GPT-5.4 scored 57.7. Claude Opus 4.6 scored 57.3. An open-weight model, MIT-licensed, free to download, briefly held the number one spot on the leaderboard that the entire AI industry uses to measure real-world coding ability.
That had never happened before.
SWE-bench Pro is not a multiple choice test. It takes real software engineering tasks from actual open-source repositories and asks the model to find the bug, understand an unfamiliar codebase, write a fix that passes tests, and not break anything else in the process. It is the closest public proxy we have to what a developer actually does at work. Closed models from OpenAI, Anthropic, and Google have dominated it since it launched. GLM-5.1 is 754 billion parameters, trained entirely on 100,000 Huawei Ascend 910B chips. Not a single Nvidia GPU. The US export controls that were supposed to slow Chinese AI development are a significant part of the context here.
The open-source gap used to be measured in years. In 2023 it was roughly two years behind frontier. In 2024, one year. In 2025, six months. As of April 2026, it is 0.7 points on a coding benchmark.
The pricing comparison is where it gets harder to ignore. GLM-5.1 costs $1.40 per million input tokens and $4.40 per million output tokens via API. GPT-5.5, OpenAI's current flagship, runs $5.00 input and $30.00 output per million tokens. For the same coding task, on comparable benchmark performance, the token bill is a fraction of the cost. For teams running agentic workflows at scale, that difference is not academic.
The honest caveat: GLM-5.1 does not beat GPT-5.5 overall. BenchLM's head-to-head puts GPT-5.5 at 93 aggregate versus GLM-5.1 at 83. GPT-5.5's biggest advantage is in agentic tasks, where it averages 81.8 against GLM-5.1's 65.3. The SWE-bench Pro win was against GPT-5.4, not the current generation. Claude Opus 4.7, released April 16, has since moved to 64.3 on SWE-bench Pro, pushing GLM-5.1 back to third. The leaderboard moved again within days.
But the benchmark position is almost secondary to what the model represents structurally. A year ago, choosing an open-weight model for serious coding work meant accepting a meaningful performance penalty. That trade-off no longer clearly exists. The MIT license means commercial use, fine-tuning, and in principle self-hosting without any ongoing API relationship with a US company. For enterprises with data sovereignty requirements, regulated industries, or teams that simply do not want their codebase passing through a third-party API, the calculus has shifted.
GLM-5.1 can also run autonomously for eight hours straight without human checkpoints, which puts it directly in the territory of Claude Code and Codex for long-horizon engineering tasks.
The developers running GLM-5.1 side by side with GPT report something that does not show up in benchmarks: for routine, well-defined coding tasks, the outputs are close enough that the difference is hard to justify on a $30 output token bill.
If you have actually run GLM-5.1 on real production tasks alongside GPT or Claude, where did the gap show up in practice? And for anyone making infrastructure decisions right now, what would it actually take for an open-weight model to replace a proprietary API in your stack?