Episodes like this have convinced me that aligning hypothetical AGIs is a hopeless endeavor. Here we have a system that many people think is not actually intell

Episodes like this have convinced me that aligning hypothetical AGIs is a hopeless endeavor. Here we have a system that many people think is not actually intelligent, and that almost nobody would call sentient, and the experts who designed it completely failed to make it protect its privileged input from unauthorized access. And yet there are researchers today who honestly believe that with enough preparation and careful analysis, it will be possible for humans to set boundaries for future superhuman, "godlike" AGIs. The hubris implied by this belief is mind-boggling.