The real trouble with the alignment problem is that there's no such thing as "human values" with which to align in the first place. There are a lot of people an

The real trouble with the alignment problem is that there's no such thing as "human values" with which to align in the first place. There are a lot of people and they don't all value the same thing — and to such an extent that their values are often quite contradictory.