3 ms·
Until it deletes your home directory, which i'd argue is an alignment problem. Destorying my data is not in line with my priorities.
by ai_fry_ur_brain 3mo ago
Until it deletes your home directory, which i'd argue is an alignment problem. Destorying my data is not in line with my priorities.
- Wowfunhappy 3mo agoLots of people have deleted their home directories by accident. What you consider this an alignment problem?
- gmueckl 3mo agoHow manypeople have deleted another user's hone directory, though? That's s the proper analogy IMO.
- Wowfunhappy 3mo agoOf the people who primarily use other people's computers, I'd assume the percentage is about the same. Give the AI its own computer and it will not delete your home directory, because it's not actively trying to hack you.
- ai_fry_ur_brain 3mo ago[dead]
- s1artibartfast 3mo agoYes. People are not aligned. They can and do harm themselves and others.
- 0xDEAFBEAD 3mo agoIt's an alignment problem in the sense that it demonstrates the principle that today's AI systems cannot be trusted to reliably work towards the goals of their users. A small-scale alignment failure and a large-scale alignment failure are the same fundamental type of failure. Typically, large disasters come after smaller disasters which foreshadowed the disaster mechanism, but weren't taken seriously.
- Wowfunhappy 3mo agoI think there is a meaningful difference in kind between an AI that makes a mistake and an AI that is actively malicious.
- 0xDEAFBEAD 3mo agoAn AI which is mistaken about the goal you give it, or how to go about achieving it, will behave in a de facto malicious manner, as this incident illustrates.