3 ms·
And tell me, how can you verify that these were the inputs used? How can you check to see how those inputs were used within the algorithm? How can you audit suc
by windsurfer 7y ago
And tell me, how can you verify that these were the inputs used? How can you check to see how those inputs were used within the algorithm? How can you audit such a system?
- xwdv 7y agoYou rebuild the system using the same inputs and initial conditions and observe the outcome. Thank you, next.
- naasking 7y agoTalk about underplaying the difficulties. Computer science needed a whole new package system (Nix) just to guarantee reproducible builds. Compilation is pretty much the definition of a pure input/output function, and most builds are simply not reproducible. If even builds aren't reproducible, good luck reproducing anything more complex like machine learning.
- xwdv 7y agoAuditing is a complicated process, if you don’t want to do the work you’ll just have to take their word for it.
- naasking 7y agoThe problem is the feasibility of auditing, not whether the motivation exists. And no, taking their word for it is not adequate.
- xwdv 7y agoThen what do you propose be done? If you accuse someone of having an extremely racist AI you need a way to prove they set out to make it that way. You don’t just get to say “It’s racist” and shut it down.
- pjc50 7y agoYou look at the outcome distribution.
- naasking 7y agoThe danger here is of assuming the conclusion, in this case, that race doesn't correlate with anything meaningful. This is still a hotly disputed point. Ultimately, transparency and reproducibility are the key criteria I think, like it is in science.
- xwdv 7y agoAnd then what? Shut it down if it doesn’t conform to your expectations or world view?