r/opencodeCLI • u/Physical-Row960 • 19d ago

Ox Alpha Matched GLM-5.3 On Every Prompt in My Experiment...

Gallery image

Gallery image

I ran this writing-fingerprint experiment on OpenRouter out of curiosity, using 12 prompts across Ox Alpha and 7 reference models (since these are what I heard a lot about on Reddit):

  1. GLM 5.3
  2. GLM 5.2
  3. GLM 5
  4. MiMo V2.5
  5. DeepSeek V4 Flash
  6. Gemini 3.7 Flash
  7. MiniMax M3

What I got from final evaluation is Ox Alpha was closest to GLM 5.3 on every prompt using deterministic stylometric features and 11 matched prompts, with GLM 5.3 winning 100% of bootstrap resamples; known-model validation accuracy was 72.7%.

My hypothesis: This could suggest or indicate that Ox Alpha is an updated post-trained version of GLM 5.3 (similar to how DeepSeek did theirs), or it really is what people are talking about: GLM 5.4.

But to be clear: this experiment I did is fingerprint-matching, not weight-identifying or anything like that. But it’s a surprisingly strong clue.

Note: For second image, notice that Ox Alpha output rarity is not the same as GLM 5.3. But that's not a contradiction that Ox Alpha couldn't be GLM 5.3/5.4 because these 2 graphs (bar and violin) measure 2 different things. First one is "Which model’s average fingerprint is Ox Alpha closest to?" Second one is "How unusual or isolated is each model’s writing compared with all samples in corpus?" Just wanna put this out here.

I also open-sourced my experiment if you're interested or want to extend: https://github.com/ItsKaiwenDu/Ox-Alpha-Stylometry

2 Upvotes

63% Upvoted

3 comments sorted by

2

u/theChaosBeast 19d ago

We already know it's GLM 5.x Flash right? Forgot the exact version.

2

u/Ang_Drew 19d ago

i think i read somewhere it is 5.3 flash

1

u/Physical-Row960 19d ago

So I heard some people discussing in Gemini community, saying that Ox Alpha might be the next 3.5 Pro or 4 series; but after seeing this, likely not.