3 ms·
Interesting he isn't just working with Feifei Li if he's really interested in 'world models'.
by gregjw 11mo ago
Interesting he isn't just working with Feifei Li if he's really interested in 'world models'.
- muragekibicho 11mo agoExactly where my mind turned. It's interesting how the AI OG's (Feifei and Cunn) think world models are the way forward.
- dauertewigkeit 11mo agoCorrect me if I'm wrong but LeCun is focused on learning from video, whereas Fei-Fei Li is doing robotic simulations. Also I think Fei-Fei Li's approach is still using transformers and not buying into JEPA.
- Legend2440 11mo agoJEPA is not an alternative to transformers, it is built out of transformers.
- HarHarVeryFunny 11mo agoJEPA is trying to learn real world regularities by predicting internal perceptual representations (using a transformer). It seems a good direction to go in, but tbh he doesn't seem to have taken it very far, and it is the transformer doing all the heavy lifting.
- intalentive 11mo agoLeCun is not interested in generative models which predict in pixel space. He wants "energy based" models which predict in the representation space.