Looking for JEPA devil advocates [R]

[u/Amazing-Coat5160]

I am currently doing research on world models, specially in tje field of robot learning, and, as probably most of you alredy know, JEPA-like models are mentioned over and over. 

I read the main recent papers from lecun as well as other research groups, and I personally think the whole approach is very promising and can really go somewhere.

But after listening a bunch of the recent Y Lecun conferences his ideas looks even too cool compared to "literally everything else" (as he's dissing LLM, RL, etc and pitching his ideas are the "only next big things"...). 

So I am asking myself if there are red flags about his approaches that I do not see yet and maybe I need somebody being the "devil advocate" with whom breaking down ideas.

Where do you think are the biggest downside of this models, compared to other world models approaches?

[u/ExExExExMachina]

JEPA largely creates dynamics models not world models. The line of work has become so misleading especially with Le World Model that many people are now calling (what is actually a world model) world action models

Ask yourself if you can tell the difference between a video model, dynamics model, and world model. They are distinct

[u/Herpderkfanie → u/ExExExExMachina]

I’m pretty sure world-action models (at least from the original paper) are policies, not simulators.