I like the comparison of the economy with an optimizing AI, but the value function isn't max(paperclips), but whatever people will pay for. So it's not really t

I like the comparison of the economy with an optimizing AI, but the value function isn't max(paperclips), but whatever people will pay for. So it's not really the fault of the AI that people have fucked up priorities - the AI itself is value neutral. If you can get a large enough group to say: "Enough, the AI doesn't represent our values, let's change it!", it will already have happened because the same people will have already changed their buying habits.