3 ms·
One of the examples in the article is gender detection. Humans might get this wrong sometimes. But no human is going to guess that a picture of dog feces is a h
by oneoff786 5y ago
One of the examples in the article is gender detection. Humans might get this wrong sometimes. But no human is going to guess that a picture of dog feces is a human male or female. The ai model will. It only predicts male or female. But wait you say, you could teach it to guess male, female, or non human. But then, uh oh, per the article, lots of your Black human mages are no longer classified as human even! AI is hard. Evaluation metrics are hard. Cheering for 20 Int 0 Wis is a bad gamble imo.
- t_mann 5y agoBut no human is going to guess that a picture of dog feces is a human male or female. Being a bit cheeky now, but I'm not even sure that you'd get zero such answers (or similarly absurd) from humans.
- ben_w 5y agoI vaguely remember a similar thing with (Viking warrior?) skeletons. Everyone(?) assumed they were all male until they did DNA tests and realised they weren’t.
- ufmace 5y agoMight be cheeky, but actually insightful too - all of these experiments share the assumption that the human/intelligence involved has chosen to cooperate with the experiment and do its best at the assigned task as written. So how do you control for things like the person decided that the assigned task was boring and wanted to amuse themselves by intentionally giving an incorrect answer in a way that they found amusing?
- oneoff786 4y agoBy acknowledging that these experiments are relatively pointless
- ufmace 4y agoI don't know that I'd go that far. It's something that does need to be accounted for though. On the other hand, if we ever manage to build an AI that's sophisticated enough to intentionally troll us, well then mission accomplished I guess.
- oneoff786 4y agoI really do not. As much as long tail bell curve guesses can be surprising, that’s a very extreme take. Presuming good faith answers and the mental health required to understand and answer the question.