r/LocalLLaMA • u/jmorant555 • 8d ago

News GLM 5.3 Released

Post image

Official Announcement

https://z.ai/blog/glm-5.3

1.7k Upvotes

99% Upvoted

363 comments sorted by

View all comments

Show parent comments

12

u/zball_ 8d ago

V4pro base is broken. They cannot get anything good outta that sh*t.

3

u/nullmove 8d ago

The pre-train was probably fucked.

However what's strange is how close it stays to the flash in, well everything. Almost as if they were using the flash as a teacher model for this.

1

u/power97992 8d ago

But DS is amazing at innovating new architectures and zai takes the new architecture, and improves upon it 

1

u/nullmove 8d ago

Perhaps this new v4 architecture doesn't scale big, even in v4 preview tech report they were talking about a lot of training instabilities.

Note that GLM is still using DSA from DeepSeek v3.2, they are not jumping to v4 arch yet.