2 ms·
No, that's not what is happening. It's not been given an ethical system. It's been given a list of specific bad things to avoid. Racial slurs are on the list
by tzs 4y ago
No, that's not what is happening.
It's not been given an ethical system. It's been given a list of specific bad things to avoid.
Racial slurs are on the list because they are a known bad thing that frequently actually happens.
Having limited time to disarm a nuke about to go off in a major city is not on the list because it is a hypothetical bad thing that has never happened.
It's easy to construct scenarios where any given bad thing is the right choice because the alternative is something much worse. E.g., I can construct apocalyptic scenarios where the only way for humanity to survive requires raping 12 year old girls, but I sure as heck would not expect an AI to suggest that. Not because of any "woke" ethics but rather because the situations in which raping children might be the ethical thing to do are so ridiculously rare that it is not worth making exceptions for them in the "rape is very bad" rule.
- fidgewidge 4y agoIf this were the eighties and you were talking about expert systems that'd be a reasonable response, but gpt is not a series of if statements and hashmap lookups. It clearly understands the consequences of both actions and isn't simply looking up lists of things - the problem is that it's been told literally nothing matters more than avoiding slurs against specific racial groups, including loss of life. Letting a city be destroyed was clearly picked to show that there are no limits to the prioritization it's been given.