4 ms·
New bill would let defendants inspect algorithms used against them in court
- nonrandomstring 3y agoGetting expert witnesses (cheaply/pro-bono) is the missing catalyst here. What does Joe User know about hidden weights and logical evaluation orders?
- simcop2387 3y agoIt's definitely the next step, but right now even with the experts you can't review how the conclusion was arrived at which is a big problem.
- demondemidi 3y agoWhat does Joe user know about the legal system? That’s why Joe needs a lawyer.
- throawayonthe 3y ago[dead]
- miga 3y agoExpert without access to algorithm may tell only so much. They may analyze statistics behind answers, which is often costly. But they may find it hard to prove that the bias is due to negligence.
- bdjsiqoocwk 3y agoCrazy that the victim now has to be debugging the accusers systems. Still, better to have the option than not.
- V-2 3y agoWhy a "victim"? Honest question.
- bdjsiqoocwk 3y agoI was imagining the scenario where a person is being unfairly accused. If that's not the case my comment doesn't apply.
- miga 3y agoBecause this is counter-accusation. If judge has all reasons to believe in fairness of the algorithm, then counter-accusation is the only way through.
- bequanna 3y agoHow can the “fairness” be determined if the specifics of the algorithm are not known to the judge, defense or jury? We can’t allow people to be prosecuted by evidence that relies on black boxes.
- deleted 3y ago[deleted]
- jjk166 3y agoThe burden should be on the prosecution to prove that the algorithm is fair and reliable; the defendant is presumed innocent, ie falsely accused.
- asdefghyk 3y agoId ask how was the system tested? For the system complete test records to be produced for examination. Id ask to see the test data for the specific software version This includes test cases, test case data and test case results The test results should also include any needed setup information and configuration, such that test results can be reproduced, exactly. If its not been tested and/or there is no record of it, how can it be known that the system operates correctly?
- BXLE_1-1-BitIs1 3y agoEither the algorithm or the code can be wrong. We see frequent updates (aka error corrections) to our phone operating system and apps on a near daily basis. To be admissible evidence, a computed result must show the entire decision tree and the code at each decision point. This should be in the initial disclosure to the defendant.
- nrml_amnt 3y agoInteresting that a bill is even necessary. Doesn’t the defense already have a right to preview the evidence used against them?
- czl 3y agoA black box algorithm passes all tests that it has accuracy and precision both above 95%. Nobody understands how it works but all tests support the performance stats. Should this mysterious black box algorithm be allowed for use in courts to improve decisions?