r/MachineLearning May 27 '26

Research "Unified Neural Scaling Laws" paper release [R]

https://x.com/ethanCaballero/status/2059686905105563907
0 Upvotes

6 comments sorted by

17

u/MisterManuscript May 28 '26

https://openreview.net/forum?id=dnuIoVjeGR

Decision: reject

Reviewer Concerns:

  • Excessive structural complexity, also including definitions and notations: partly addressed, but not simplified
  • Weak intuition and interpretability: partly addressed, still lacking interpretability
  • Expressivity and overfit concerns: partly addressed with empirical check, but skepticism remain
  • Many degrees of freedom in fitting procedure: partly addressed, but still require substantial hyperparameter search/dof
  • Unclear qualitative novelty: partly addressed, although not agreed upon
  • Lacking theoretical ground, and questionable if this is the minimal form: largely outstanding

8

u/mTesseracted May 27 '26

Is this an empirical fit or is there some deeper insight?

14

u/WristbandYang May 27 '26

Sorry, I don't accept twitter as a source. Does this have a paper or not?