3 ms·
> “Most of human knowledge is actually not language so those systems can never reach human-level intelligence — unless you change the architecture,” LeCun said.
by mitthrowaway2 3y ago
> “Most of human knowledge is actually not language so those systems can never reach human-level intelligence — unless you change the architecture,” LeCun said.
... Is his point that LLMs will not reach human level intelligence because they're limited to text, but other approaches like Sora might, because they work on video?
If so, this is a rather shallow point.
- boristsr 3y agoNo, one of his other interviews he delved a bit more into it with examples, things like puzzles and quizzes like start at the North Pole, move south 1km, left 2km and up 1km. Where are you and how did you work that out? His point was there's spatial reasoning among other things happening. It's not purely a vision thing, or a language thing. There's a deeper world understanding there than just language can convey. He raised some similar points about image and video generation how they failed to produce meaningful results with a similar approach. I think it was his latest lex fridman interview. Was pretty interesting. Definitely raised some strong points.
- cyanydeez 3y agoThe argument is that random tezxr is not intelligence. And the word random here.id exactly precariously intetwondd with both probablistic and coincidwntal