This is a bit of a tangent but this is a good example of why it’s hard to align AI systems to do what we want especially when conditions change, because what wa

This is a bit of a tangent but this is a good example of why it’s hard to align AI systems to do what we want especially when conditions change, because what was a good proxy for what we want in one environment might not be in another It also shows why “if it’s intelligent it will figure out what we wanted” doesn’t work; like us it has no reason to care what was “intended” even if it knows