8 ms·
Bayes' theorem strikes again. Even if the odds of a false positive are only 1 in 1000, if 1 in a million are criminals then out of 1000 flagged people only 1 mi
by whatshisface 7y ago
Bayes' theorem strikes again. Even if the odds of a false positive are only 1 in 1000, if 1 in a million are criminals then out of 1000 flagged people only 1 might be a criminal.
- mpoteat 7y agoAn acolyte of the conspiracy... Seriously though, for anyone interested in understanding this interesting statistical principle, check out the "Intuitive Explanation of Bayes Theorem" [1] [1]: https://betterexplained.com/articles/an-intuitive-and-short-explanation-of-bayes-theorem/ https://betterexplained.com/articles/an-intuitive-and-short-...
- Jorge1o1 7y agoFirst thing that came to mind
- randyrand 7y agoI feel like saying “its correct 99.9%” of the time should only said for real sample sets of input data.
- itwasntandy 7y agoIndeed. And considering the hundreds of millions[1] of people who pass through london’s stations each year, that would means hundreds of thousands of false positives. [1] https://en.m.wikipedia.org/wiki/List_of_busiest_London_Underground_stations https://en.m.wikipedia.org/wiki/List_of_busiest_London_Under...
- turk73 7y agoI have written on this exact subject beginning around 2000. Nobody freaking listened! You would think that "best minds" at the NSA and places would understand the basic statistical reality of what they are doing and why it can't work, but no, statism clouds the mind and profits cloud good judgement. Basically, if the natural error rate of a database is 5%, you aren't going to data mine a terrorist out of it if terrorists are < 1% (try .001%) of the population. Not. Gonna. Happen. What is happening is our rights are being stripped and we have a rogue FBI that manufactures criminals when it wants to grab headlines and what's more, we have PROOF that they done exactly that.
- emanreus 7y agoYep. The lack of understanding of false positives truly never ceases to amaze.
- deleted 7y ago[deleted]
- educationdata 7y ago"if 1 in a million are criminals"? NYC population is 8.6 million in 2017, so there are only 8~9 criminals in NYC? Wow. Come on, you should give a much better estimate.
- kurthr 7y agoFor each individual crime there probably is only one or a small number of perpetrators. You can't just say... hey we found 1000 (or even 5) of you face matched for a single crime (assault) which you almost certainly (or even probably) didn't commit, but after a search or warrant some of you appear to have committed a different other crime (drug possession, tax evasion, public urination, evading arrest, immigration status) so go to jail and wait for court. Once police have the right to search, enter, confiscate. and arrest probable cause is out the window.
- educationdata 7y agoI don't follow. Do they match faces to crimes or match faces to faces of criminals?
- kurthr 7y agoThey match faces out of a crowd for criminals, but to be a criminal you have to have committed a specific crime... usually that means a single person. For any one crime, they are looking for a single person and that's worst case for false positive recognition. For a large sample set 50k-1000k, they are lucky they don't match any one person to multiple criminals (birthday paradox) ... that would be obviously disqualifying. I suppose it could be worse and they just take an aggregate face of all (accused?) criminals or for particular crimes (white collar?) and match against that... hey your skin was brown, or hey you didn't shave... you appear Male.
- agumonkey 7y agoThis might be weighted with a very high risk coefficient
- jdietrich 7y ago...which makes an 81% false positive rate remarkably good. You've massively whittled down your list of potential subjects and made the job of humans immeasurably easier. An 81% false positive rate would be nightmarishly awful if this system served as judge, jury and executioner, but it's incredibly useful as a means of improving the signal-to-noise ratio of surveillance data.
- e40 7y agoThat would be true if wiggling out of the net of justice when you are innocent were not so expensive. There are a lot of poor people who can't afford the system you speak of.
- jdietrich 7y agoThe world is not America. Your criminal justice system might be a Kafkaesque nightmare, but ours is mostly OK.
- bradknowles 7y agoJust wait. If yours isn't already as bad as ours, then just wait.
- jdietrich 7y agoI'm sure that's comforting to believe, but it just isn't true. America's criminal justice system is uniquely dysfunctional in a multitude of ways, best exemplified by your extraordinarily high incarceration rate. There is no law of nature that dictates that all criminal justice systems inexorably deteriorate into tyranny, it's just a specific and fixable set of policy failures. The iniquities of pre-trial detention and cash bail are fixable. Racially biased arrest, conviction and sentencing rates are fixable. Needlessly punitive sentences and an over-reliance on incarceration are fixable. Miscarriages of justice due to pseudoscientific forensic evidence and under-funded public defenders are fixable.
- throw20102010 7y ago
- est 7y agoConviction by human court has a success rate.
- paultopia 7y ago^ this. Reasons why I teach basic Bayes to my first-year law students. If at least one of them becomes a competent defense lawyer...
- DanBC 7y agoYou might find "reckoning with risk" by here giggerenzer interesting. He presents useful tools for everyday people to understand this, mostly by converting percentages to real numbers and drawing probability trees.
- deleted 7y ago[deleted]