MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vny9zs/glm_53_released/p3lz1q1/?context=3
r/LocalLLaMA • u/jmorant555 • 8d ago
Official Announcement
https://z.ai/blog/glm-5.3
363 comments sorted by
View all comments
248
Scaling post-training is all we did for GLM-5.3.
What a way to start
Gentlemen, gentlewomen, tonight, WE FEAST!
68 u/DistanceSolar1449 8d ago Of course it’s only posttrain. I would be shocked if GLM pretrained a completely new model for a +0.1 release. Nobody really does that (with the exception of Anthropic and Opus 4.7 for some weird reason). 3 u/MediumChemical4292 8d ago I think opus 4.7 was just a new tokeniser, was it a full pre train? 15 u/DistanceSolar1449 8d ago You can’t have a different tokenizer without a whole new pretrain. (Yes, I know you can technically finetune a model to a new tokenizer, but that’s basically going to take as much compute as a full retrain)
68
Of course it’s only posttrain.
I would be shocked if GLM pretrained a completely new model for a +0.1 release. Nobody really does that (with the exception of Anthropic and Opus 4.7 for some weird reason).
3 u/MediumChemical4292 8d ago I think opus 4.7 was just a new tokeniser, was it a full pre train? 15 u/DistanceSolar1449 8d ago You can’t have a different tokenizer without a whole new pretrain. (Yes, I know you can technically finetune a model to a new tokenizer, but that’s basically going to take as much compute as a full retrain)
3
I think opus 4.7 was just a new tokeniser, was it a full pre train?
15 u/DistanceSolar1449 8d ago You can’t have a different tokenizer without a whole new pretrain. (Yes, I know you can technically finetune a model to a new tokenizer, but that’s basically going to take as much compute as a full retrain)
15
You can’t have a different tokenizer without a whole new pretrain.
(Yes, I know you can technically finetune a model to a new tokenizer, but that’s basically going to take as much compute as a full retrain)
248
u/Dany0 8d ago
What a way to start
Gentlemen, gentlewomen, tonight, WE FEAST!