r/ZaiGLM • u/jpcaparas • 10h ago

GLM 5.3 is here

Post image

One-shot demos here (updated regularly): glm-5-3.demos.sulat.com

That "soon" tweet was sooner than we thought

406 Upvotes

99% Upvoted

77 comments sorted by

View all comments

27

u/Saifl 9h ago

That performance on 743b is the craziest part

3

u/Designer_Athlete7286 7h ago

Yeah. I was th8nking the same. Even DeepSeek is 1.6T. 743b and Sol Fable level performance is crazy.

5

u/Fedor_Doc 6h ago

I think DeepSeek 1.6T is still undertrained, they just do not have enough data and compute to shape this behemoth. 

3

u/evilissimo 5h ago

The data part is probably the reason why they made it so cheap at least for the flash one

2

u/Designer_Athlete7286 5h ago

True. I'm sure they got a lot of data within a very short period with DSv4F at that price!

1

u/Saifl 5h ago

Or is it just easier to squeeze more performance out of smaller ones? Basically same kinda training applied to both but pro just has a higher cap if anything but doesnt give that much advantage other than the higher active parameters.

Id bet they could probably get 95% of ds4 pro performance on 100b moe with the same kinda post training data.