5 ms·
For the same reason Yann LeCun and everyone else says language won’t lead to AGI, nothing will lead to AGI. Yann says language models need to be updated with n
by rusuereboutdat 1y ago
For the same reason Yann LeCun and everyone else says language won’t lead to AGI, nothing will lead to AGI.
Yann says language models need to be updated with new language to describe new observation.
But that’s not just with language. That’s physics. We cannot solve going to Mars or anything without the process.
But space time is endless and eventually some composition of it will come along the continuous learning machine has no ability to adapt to before it’s destroyed.
We’ve lost the information of the past and merely store simulation. We cannot see all of the future, just reduce to simulation.
Eventually any autonomous thing hits a snag it cannot solve before its destruction because in any reference frame it cannot know all the next best steps and know which past options to eliminate to simplify.
Energy based models will streamline away nonessential state to generating media and making a robot lift a box, like Linux and software like we know, but without 100% accurate data of the past and future (generation of which is impossible) whatever autonomous thing will eventually encounter a problem it never had time to solve and be smashed by the immutable churn of physics.
- BriggyDwiggs42 1y agoI just… why can’t it adapt over time?
- johnsmith1840 1y agoNobody knows. It's one of those seemingly simple problems to which the solutions imply contradicting answers.
- BriggyDwiggs42 1y agoI just don’t get why we’re talking about cosmic scales but modern AI tech and not a hypothetical ASI a thousand years out with an iq of 2 million that would actually encounter these limits.
- johnsmith1840 1y agoYeah that's not what I was talking about I was only talking about continual learning. Just hijacked thr comment because my focus is on CL on current systems not the hypothetical.
- BriggyDwiggs42 1y agoGotcha sorry. Got the wrong impression.
- achierius 1y agoEverything you're saying applies to humans too, though. We evolved, learned over time, and are now "AGI".