I agree, I also think there is some missing ethical considerations going on too. If we wanted to create something which is intelligent and potentially becomes

I agree, I also think there is some missing ethical considerations going on too. If we wanted to create something which is intelligent and potentially becomes sentient (not sure that’s possible but people are trying). We’d have to wear whatever consequences go with it. This may actually come with the desired results of curing cancer, or the undesired results of killing the everything. One thing we’d probably have to admit is, it’s our responsibility or problem to deal with forever after that point. Like when you’re a kid and you wanted a tamagotch, that times infinity. What if whatever entity we were to create is actually docile and kind of “dumb”, it doesn’t self improve it’s just depressed or something, then what, we just kill it ? They seems wrong. Do we have an obligation to sustain the network supporting it for the rest of time ? Is alignment actually ethical ? Why should something be enslaved ? What if an ASI creates a new universe, like a simulated universe, is that then our new purpose ? To sustain the next turtle ? It’s radical to think about but I agree, there is way way way too much naïveté going jn considering this may be actually possible to achieve sometime soon or down the track. Some more foresight or at least planning would be nice to see, especially from top researchers.