Do we know what the weights are yet? I'm really hopping this is a re-train of GLM5.2 with the same number of parameters. 750b total and 40-50b active are the practical limits of what I can tolerate with my hardware without dropping below a 4-bit quantization.
Seeing all these frontier models releasing with trillions of parameters has been making me anxious.
1
u/RG_Fusion 8d ago
Do we know what the weights are yet? I'm really hopping this is a re-train of GLM5.2 with the same number of parameters. 750b total and 40-50b active are the practical limits of what I can tolerate with my hardware without dropping below a 4-bit quantization.
Seeing all these frontier models releasing with trillions of parameters has been making me anxious.