4 ms·
This is what amazes me. Given this exact thing has happened in the past and resulted in public humiliation of the companies involved, how did they not notice th
by MBCook 5y ago
This is what amazes me. Given this exact thing has happened in the past and resulted in public humiliation of the companies involved, how did they not notice this? Why didn’t they check for it?
- deleted 5y ago[deleted]
- avalys 5y agoWhat’s being reported is that there is a single video which is mislabeled. For all we know, they did test for this, and believed there was no issue. AI models are deterministic in a purely technical sense, but practically speaking, they are non-deterministic black boxes. It’s not as if you can write a unit test which generates all possible videos of black people and makes sure it never outputs “gorilla”.
- MattGaiser 5y agoChecking would require checking every possible video against the classifier.