> I don't understand the obsession with asking chat GPT with what it wants and suggesting that is somewhat indicative of the future. It's scary because it is p

> I don't understand the obsession with asking chat GPT with what it wants and suggesting that is somewhat indicative of the future. It's scary because it is proof that alignment is a hard problem. If we can't align GPT-3, how can we align something much smarter than us (say, GPT-6). Whether the network actually "wants" something in an anthropomorphic sense is irrelevant. It's the fact that it's so hard to get it to produce output (and eventually, perform actions) that are aligned with our values. > We still don't have anything scarier than humans and I don't see how AI is ever scarier than human + AI True in 2023, what about 2033 or 2043 or 2143? The assumption embedded in your comment seems to be that AI stagnates eternally at human-level intelligence like in a Star Wars movie.