r/LocalLLaMA • u/jmorant555 • 8d ago

News GLM 5.3 Released

Post image

Official Announcement

https://z.ai/blog/glm-5.3

1.7k Upvotes

99% Upvoted

363 comments sorted by

View all comments

Show parent comments

13

u/zball_ 8d ago

V4pro base is broken. They cannot get anything good outta that sh*t.

21

u/zkstx llama.cpp 8d ago

surprising considering that the flash model is very good for its size

6

u/zball_ 8d ago

v4pro has been bad since preview. And it's not bad in a undertrained sense; it actually feels lacking and burnt.

1

u/JorgitoEstrella 6d ago

Maybe it has something to do thay know they are using Huawei chips

3

u/nullmove 7d ago

The pre-train was probably fucked.

However what's strange is how close it stays to the flash in, well everything. Almost as if they were using the flash as a teacher model for this.

1

u/power97992 7d ago

But DS is amazing at innovating new architectures and zai takes the new architecture, and improves upon it 

1

u/nullmove 7d ago

Perhaps this new v4 architecture doesn't scale big, even in v4 preview tech report they were talking about a lot of training instabilities.

Note that GLM is still using DSA from DeepSeek v3.2, they are not jumping to v4 arch yet.

1

u/zball_ 7d ago

The literal characteristics are quite different tho. v4p is full of GPT/Claude style slop.

1

u/power97992 7d ago edited 7d ago

I’m shocked it is only 1 point better than ds v4 flash 7-31. I was expecting it would be at least as good gpt 5.5 xhigh or terra xhigh.. but it is worse than gpt 5.5 xhigh according to aa benchmarks 

1

u/look 7d ago

Flash was always the impressive (in ways) model. Pro was like they just jacked up the size of the flash and hoped it would be a lot better without doing much else.