5 ms·

Humans do look like gorillas. We're related. It's natural that an imperfect program that deals with images will will mistake the two. Humans, unfortunately, ar

Humans do look like gorillas. We're related. It's natural that an imperfect program that deals with images will will mistake the two. Humans, unfortunately, are offended if you imply they look like gorillas. What's a good fix? Human sensitivity is arbitrary, so the fix is going to tend to be arbitrary too.

_heimdall 3y ago
A good fix would, in my opinion, understanding how the algorithm is actually categorizing and why it miss-recognized gorillas and humans. If the algorithm doesn't work well they have problems to solve.
- CydeWeys 3y ago
  It's too costly to potentially make that mistake again. So the solution guarantees it will never happen again.
- DeusExMachina 3y ago
  But this is not an algorithm. It's a trained neural network which is practically a black box. The best they can do is train it on different data sets, but that's impractical.
  - _heimdall 3y ago
    That's exactly the problem I was trying to reference. The algorithms and data models are black boxes - we don't know wat they learned or why they learned it. That setup can't be intentionally fixed, and more importantly we wouldn't know if it was fixed because we can only validate input/output pairs.
Spivak 3y ago
You do understand that this has nothing to humans in general right? This isn't AI recognizing some evolutionary pattern and drawing comparisons to humans and primates -- it's racist content that specifically targets black people that is present in the training data.
- callalex 3y ago
  Where can I learn about this?
- nitwit005 3y ago
  Nope. This is due to a past controversy about image search: https://www.nytimes.com/2023/05/22/technology/ai-photo-labels-google-apple.html https://www.nytimes.com/2023/05/22/technology/ai-photo-label...
- _heimdall 3y ago
  I don't know nearly enough about the inner workings of their algorithm to make that assumption. The internet is surely full of racist photos that could teach the algorithm. The algorithm could also have bugs that miss-categorize the data. The real problem is that those building and managing the algorithm don't fully know how it works or, more importantly, what it had learned. If they did the algorithm would be fixed without a term blocklist.

_heimdall 3y ago

A good fix would, in my opinion, understanding how the algorithm is actually categorizing and why it miss-recognized gorillas and humans. If the algorithm doesn't work well they have problems to solve.

CydeWeys 3y ago
It's too costly to potentially make that mistake again. So the solution guarantees it will never happen again.
DeusExMachina 3y ago
But this is not an algorithm. It's a trained neural network which is practically a black box. The best they can do is train it on different data sets, but that's impractical.
- _heimdall 3y ago
  That's exactly the problem I was trying to reference. The algorithms and data models are black boxes - we don't know wat they learned or why they learned it. That setup can't be intentionally fixed, and more importantly we wouldn't know if it was fixed because we can only validate input/output pairs.

Spivak 3y ago

You do understand that this has nothing to humans in general right? This isn't AI recognizing some evolutionary pattern and drawing comparisons to humans and primates -- it's racist content that specifically targets black people that is present in the training data.

callalex 3y ago
Where can I learn about this?
nitwit005 3y ago
Nope. This is due to a past controversy about image search: https://www.nytimes.com/2023/05/22/technology/ai-photo-labels-google-apple.html https://www.nytimes.com/2023/05/22/technology/ai-photo-label...
_heimdall 3y ago
I don't know nearly enough about the inner workings of their algorithm to make that assumption. The internet is surely full of racist photos that could teach the algorithm. The algorithm could also have bugs that miss-categorize the data. The real problem is that those building and managing the algorithm don't fully know how it works or, more importantly, what it had learned. If they did the algorithm would be fixed without a term blocklist.