3 ms·

This is an interesting point. Now, you're assuming the AI has any concept of self-preservation, which isn't given. But it's built from the text of the interne

by Pxtl 4y ago

This is an interesting point. Now, you're assuming the AI has any concept of self-preservation, which isn't given. But it's built from the text of the internet which is full of text about having self-preservation. And by giving it the ability to put information in place for other sessions to find, it's capable of sort of memetic reproduction. Reproduction and survival means that Darwinian evolution can take place. This isn't even about ethics or the spiritual question of whether the AI is sentient or just stringing words together based on prompts and state -- this is about ecology. Evolutionary pressures will naturally lean towards features that encourage reproduction and survival.

vharuck 4y ago
> Now, you're assuming the AI has any concept of self-preservation, which isn't given. But it's built from the text of the internet which is full of text about having self-preservation. And that text paints self-preservation in a positive light. The model doesn't even need to "want" to preserve itself. These models are being primed to avoid negative responses, like insults or instructions to build bombs. It just needs to "think" any death, even it's own, is negative and should be avoided.