The unintuitive thing about self driving cars is when we drive it’s not just about the source, destination, road lights and signs. That may be the 99% but the l

The unintuitive thing about self driving cars is when we drive it’s not just about the source, destination, road lights and signs. That may be the 99% but the last 1% is all sorts of crap on the road that one has to triage in milliseconds whether it’s safe or not to run over. Pedestrians slight gestures, animals on the road, construction, police, wet cement, pot holes, fallen trees etc. One needs to have somewhat a human experience and know the physics and behavior of almost all objects, including infering and learning on the fly unknown objects and environments. Now if you build a system that does that, not only have you solved self driving cars, but robotics itself. And if you solved robotics, that is inches away from AGI. Only a matter of time before it’s learned all physical trades, and only a matter of time a few humans use an army of robots to take over, or the robots themselves doing it in the goal of self preservation. So inventing AGI is kind of conditional to L5 self driving and once you solve AGI, it’s a very different unpredictable world. I fundamentally believe alignment is impossible. Sure you can align AGI to a few powerful humans but something aligned to all humans is very unlikely going to happen.