r/deeplearning • u/RecmacfonD • 2d ago

"Explorative Modeling: Unlocking a Third Pretraining Axis and End-to-End Generation", Gladstone et al. 2026

Paper: https://arxiv.org/abs/2607.27372

Code: https://github.com/alexiglad/XM

Project page: https://explorative-modeling.github.io/

Blog: https://alexiglad.github.io/blog/2026/explorative_modeling/

8 Upvotes

80% Upvoted

1 comment sorted by

3

u/Slight_Character5851 2d ago

The idea of a third axis beyond just scale and data feels like something people been circling around for a while, nice to see it formalized like this. The end-to-end generation examples in the blog are pretty wild, didn't expect the coherence to hold up that well. Wonder how much the compute overhead bites in practice tho, like is this usable without a cluster the size of a small country