"In other words, the complex systems we build usually end up having surprising failure modes But those are "failure modes", not "suddenly become something comp

"In other words, the complex systems we build usually end up having surprising failure modes But those are "failure modes", not "suddenly become something completely different" modes. And the key thing my parent pointed out is that modern AIs may be very impressive and stepping towards what we'd see as intelligence but they're actually further from the approach of "just give a goal and it will find it" schemes - they need laborious, large scale training to learn goals and goal-sets and even then they're far from reliable.