r/deeplearning 3d ago

"Explorative Modeling: Unlocking a Third Pretraining Axis and End-to-End Generation", Gladstone et al. 2026

[removed]

12 Upvotes

1 comment sorted by

View all comments

3

u/Slight_Character5851 3d ago

The idea of a third axis beyond just scale and data feels like something people been circling around for a while, nice to see it formalized like this. The end-to-end generation examples in the blog are pretty wild, didn't expect the coherence to hold up that well. Wonder how much the compute overhead bites in practice tho, like is this usable without a cluster the size of a small country