3 ms·
I don’t know enough about this to be sure, but this feels like a white whale.
by techblueberry 1y ago
I don’t know enough about this to be sure, but this feels like a white whale.
- andrewflnr 1y agoHuman-level language was a white whale just a few years ago.
- krainboltgreene 1y agoA.L.I.C.E. was published in '95.
- CrackerNews 1y agoI think video and agentic and multimodal models have led to this point, but actually making a world model may provide to be long and difficult. I feel LeCun is correct that LLMs as of now have limitations where it needs an architectural overhaul. LLMs now have a problem with context rot, and this would hamper with an effective world model if the world disintegrates and becomes incoherent and hallucinated over time. It'd doubtful whether investors would be in for the long haul, which may explain the behavior of Sam Altman in seeking government support. The other approaches described in this article may be more investor friendly as there is a more immediate return with creating a 3D asset or a virtual simulation.
- Fricken 1y agoA trillion dollars are now riding on that white whale. An entire naval fleet is being raised for the purposes of chasing down that whale. LeCun and Fei-Fei merely believe that the whale is in a different ocean.