People already do all of these things: lie, cheat, steal, seek power, game the system. In order to counteract them, we have a variety of social mechanisms: laws

People already do all of these things: lie, cheat, steal, seek power, game the system. In order to counteract them, we have a variety of social mechanisms: laws and enforcement, reputation and social stigma, checks and balances, limitations on power. At minimum, we shouldn’t give AI any more power or freedom, with any less scrutiny, than we would give a human. This is a point I have consistently also made. This is a big problem for alignment theory, which states that aligning to human values will achieve satisfactory behavior. However, humans don't have satisfactory behavior under our own values. Alignment theory is trying to fix human behavior, for which we have no solutions. As the article pointed out, the only thing that keeps human behavior in check is that none of us individually have unlimited power. My own very similar arguments on why alignment is impossible under this premise were made here - https://dakara.substack.com/p/ai-singularity-the-hubris-trap https://dakara.substack.com/p/ai-singularity-the-hubris-trap