11 ms·
China using big data to detain people before crime is committed
- arialeks 9y agoPysho pass anyone?
- zitterbewegung 9y agoThat’s probably the closest to the article because the system justifies itself to be right. Other commenters have said that it’s a case of parallel reconstruction . (Which would rule out minority report).
- FridgeSeal 9y agoThis is not the world we want.
- liberte82 9y agoBut is it the world we need?
- Dangeranger 9y agoNo, but it's the world we deserve by allowing mass surveillance and the police state to exist.
- duncan_bayne 9y agoAllowing? People will literally pay for it to happen. Witness smartphones, social media, smart homes, ...
- yanaccount 9y agoThe blame should not be on people who choose not to forgo the comfort of modern technology, it should be on a state which abuses that technology for dubious purposes.
- duncan_bayne 9y agoNo-one (perhaps except folks like Stallman?) is blameless here. One of the responsibilities of citizenship is to preserve your liberty against encroachment by State and private actors. Neglecting to consider that is a moral failure, and one I've been guilty of in the past. I'm not saying that it's necessarily immoral to, say, have a FB account. But it is to have one without considering the implications and acting accordingly.
- z2 9y agoIs it also a failure (moral or otherwise) for the State to not tell citizens of this particular duty? Speaking anecdotally, citizens' duties are vaguely described as "participate, stay informed, obey and support laws." It took me decades to notice the subtle and complex intentions of the State and private actors that counter freedoms in said laws. Not being Stallman or a full-time civil liberties defender, what's a good way for the basic citizen to be more informed, and better evaluate FB-like services?
- duncan_bayne 9y ago> Is it also a failure (moral or otherwise) for the State to not tell citizens of this particular duty? Yes - but realistically, what do you think State education is _for_? Primarily, it's to ensure a citizenry that obeys and supports laws. Staying informed is a very distant second, and participation is actively quashed from the get-go. (What proportion of your local school board consists of children?) As for how to stay informed - learn the basics of the technologies involved, and follow the news feeds of folks with a deep interest in the field. In this case, the EFF is a good start. But realistically, there's too much for one person to cover. Tech? Sure, perhaps. But then there's medicine, finance, real estate, construction ... So really, what you're left with is electing representatives who will provide responsible oversight. But realistically, almost all of them are in the pockets of lobbyists at this point. TBH I'm not sure what the solution is, here. So perhaps it _isn't_ a moral failure any more, because the scope has grown to the point where most people say "fuck it" and give up.
- elmar 9y ago"Minority Report"
- anujdeshpande 9y agoFor the uninitiated, it's an amazing movie starring Tom Cruise which talks about "precrime" - although no big data involved. Highly recommend that one watch it https://en.wikipedia.org/wiki/Minority_Report_(film) https://en.wikipedia.org/wiki/Minority_Report_(film)
- Noted 9y agoBased on a short story by Philip K. Dick https://en.wikipedia.org/wiki/The_Minority_Report https://en.wikipedia.org/wiki/The_Minority_Report
- miketery 9y agoFor those into Black Mirror or PKD, new show called "Electric Dreams" is based on PKD short stories - I recommend it, a few excellent episodes.
- bluewave 9y agoReal world is actually different from Hollywood movies. It's more nuanced.
- JumpCrisscross 9y agoDoes it actually work? Or are the "criminals" just social activists?
- Dangeranger 9y agoThey are not "criminals" if they never committed a crime, they are people being detained based on probabilities.
- redial 9y agoThat's the point where you rule probabilities to commit a crime is an actual crime.
- Dangeranger 9y agoUsing probabilities as "evidence" of a future action is the real crime.
- JumpCrisscross 9y agoHas it had an effect on crime rates? If so, this is interesting. It means crime is predictable based on the inputs the system is measuring. It also means the Chinese AI effort is more fruitful than I expected it to be. If this is reducing crime, then we have a discussion of trade-offs. That is interesting, and potentially nuanced. If it's the latter, however, this is not interesting and there is no reasonable discussion to be had.
- neolefty 9y agoTo rephrase: You could define whether it is being used corruptly by measuring whether it reduces crime. This is a loaded research question, of course, because it's studying something that we find abhorrent: Prosecuting people for crimes they haven't actually committed. Scientifically it's super interesting. Socially and ethically it's a minefield.
- SerLava 9y ago
- Dangeranger 9y ago“The existence of a majority logically implies a corresponding minority.”
- polskibus 9y agoAs described by Martin Kleppmann at the end of his great book, big data analytics, when used without proper regulation, creates a downward spiral. Western world enforced rules against discrimination based on sex, race, etc., yet everyone seems fine when it's the algorithm spotting and executing on the biases, which statistically are fine, but nevertheless, may be wrong in many individual cases.
- visarga 9y agoYou're spot on. They are just using biases to sentence people to brainwashing camps.
- smogcutter 9y agoMaciej Ceglowski on this: "machine learning is like money laundering for bias." http://idlewords.com/talks/sase_panel.htm http://idlewords.com/talks/sase_panel.htm
- ghostcluster 9y agothe problem is 'bias' is often based on a model that is statistically and operationally accurate, but unfair from a higher order social moral framework. a sufficiently layered net will pick up second and third order consequential effects that are not formally protected by anti-bias laws, but end up effectively mapping onto the sorts of people in categories the laws were intended to protect. that's the fundamental problem as I see it, and it's necessarily complicated and nuanced.
- breitling 9y agoDon't we all already do this to some extent? Our intelligence agencies (at least try to) predict terrorist activity and put a stop to it be before anything happens.
- Thriptic 9y agoFlagging people for human review and monitoring =\= detaining them
- Cacti 9y agoYou're assuming it's being used to "predict terrorist activity" and not for general population control.
- walshemj 9y agoYes but so you can try and target your scare resource against those more likely to commit illegal acts not round up all insert ethnic group of your choice.
- Paul_S 9y agoOnce the algorithms realise that everyone commits at least a few crimes a day they will become 100% infallible by issuing arrest warrants for anyone with a pulse.
- corysama 9y agoI never read Brave New World, but I've heard that was a theme. Everyone used illegal drugs, but there was no enforcement. Instead, if they wanted to bring you in, they just charged you with illegal drug use --because everyone knows that everyone uses illegal drugs.
- rotskoff 9y agoNot quite... In Brave New World there is a drug called "soma" that is an opium for the masses; it's rationed by the government. The subplot around soma focuses more on trying to get people to not take it so that their minds can be freed.
- sli 9y agoThat's also a major (and non-spoiler, if you're familiar with films at all) plot point of Equilibrium.
- antisthenes 9y agoThat is not at all what the book is about. Not only was the drug legal, the premise of bringing people in has nothing to do with the plot and theme of the book.
- 45h34jh53k4j 9y agoThis will be rolled out further and further, first the rest of China, then other parts of Asia, eventually Europe and the Americas. Strongly resist the rollout of this technology, along with the social credit rating systems. This is like the last chapter of humanity before we stagnate for hundreds of years.
- IntronExon 9y agoIn the US at least, there are probably enough people with a significant number of firearms that it would take a war to make this work. I’m not usually fond of anti-government fanatics, but I have to admit that in extremes they can be useful.
- majormajor 9y agoA less militarized society could reach the same point. "Sending in the special cops with guns" === "sending in the tanks and bombers." In both cases the government withholds superior strength for itself, regardless of the baseline. The question of "are people willing to risk their life" and "is the government willing to kill in large numbers" seem unchanged.
- IntronExon 9y agoSure, but that assumes a government willing to literally go to war with its populace, and why I explicitly said a war would be required. I have no illusions about how that war would end of course... tanks and B-52’s reliably best handguns and rifles. The difference between a country drowning in guns and one without them is that in the latter case it’s just that much easier, a “lower barrier to entry” if you will.
- jstarfish 9y ago> I have no illusions about how that war would end of course... tanks and B-52’s reliably best handguns and rifles. Plenty of US adversaries have met these odds and held their own. Aside from some targeted campaigns to eradicate individuals, we haven't truly "won" any notable military conflict since 1945. IEDs tend to level the playing field, but see how far you get trying to build or acquire those today. You'd be among the first wave of dissidents swept up in the ML-aided dragnet looking for purchasers of batteries and fertilizer.
- CyberDildonics 9y agoI would like the see analysis of the politicians that allowed this.
- duncan_bayne 9y agoWould it surprise you to learn that they resist being exploited by the very systems they promote? http://www.zdnet.com/article/fcc-chairman-browsing-history-freedom-of-information/ http://www.zdnet.com/article/fcc-chairman-browsing-history-f...
- MikeGale 9y agoMany countries are using these pre-crime estimators. What we need to see are the false positive and false negative rates. Anybody got measures of those?
- 3pt14159 9y agoWell it's pretty easy to generate the ROC curves for this one. We're talking discrete events over a defined timespan, right? Just create a control group and monitor the difference.
- cdepman 9y agoWe’re on our way there too in the US: https://www.theverge.com/2018/2/27/17054740/palantir-predictive-policing-tool-new-orleans-nopd https://www.theverge.com/2018/2/27/17054740/palantir-predict...
- leggomylibro 9y agoCompanies which name themselves after dystopic objects or ideals with a 'nod and wink' always creep the living hell out of me. There's never a good answer when they inevitably ask, "well what did you think was going to happen?" http://lotr.wikia.com/wiki/Palant%C3%ADri http://lotr.wikia.com/wiki/Palant%C3%ADri
- dekhn 9y agothe palantiri weren't dystopic objects. they were positive items used for communication until some of them were captured. I think the name of the company is highly apt.
- leggomylibro 9y agoFair enough, I'm not very steeped in the intricacies of Lord of the Rings. I got the feeling that it was the nature of their power and omniscience that corrupted most individuals who used them, sort of like the Ring, but that could be completely wrong.
- dekhn 9y agoThat's completely wrong. The Palantiri were created by the Noldor (one of the powerful old races of elves) and used without corruption, and then given to the Numenoreans as a gift; they were used for a long time without corruption. They were so powerful that even Sauron could not make arbitrary images appear. But the weak-minded were easily influenced by him through it; not through the nature of the stones. The ring was created by Sauron and embedded most of his life-force, and nobody alive at the time of the LotR had enough strength to resist his will.
- zitterbewegung 9y agoSo as many of the comments echoed they are using big data to perform parallel reconstruction to detain people and justify it using some kind of computational technique ?
- anonytrary 9y agoFor those of you who find this interesting and also enjoy anime, Psycho-Pass explores this premise. https://en.wikipedia.org/wiki/Psycho-Pass https://en.wikipedia.org/wiki/Psycho-Pass TLDR: > The story takes place in an authoritarian future dystopia, where omnipresent public sensors continuously scan the mental states of every passing citizen. Collected data on both present mentality and aggregated personality data is used to gauge the probability of that citizen committing a crime, the rating referred to as that citizen's Psycho-Pass.
- Noos 9y agoPsycho-Pass is excellent. They also released a visual novel in the states, Psycho-Pass: Mandatory Happiness. I also found when watching it it felt like it was decently inspired from the older anime Cyber City Oedo 808, which had the plot of the criminal enforcers hunting others.
- zombieprocesses 9y agoOr if you like good movies, Minority Report...
- coldacid 9y agoPlease. Compared to the actual short story, the movie is utter trash.
- arnaudsm 9y agoThe NSA is already doing the same thing https://arstechnica.com/information-technology/2016/02/the-nsas-skynet-program-may-be-killing-thousands-of-innocent-people/ https://arstechnica.com/information-technology/2016/02/the-n... Machine learning is still a black box, and politicians don't seem to understand this.
- shmerl 9y agoAlmost Watchbird: http://www.gutenberg.org/ebooks/29579 http://www.gutenberg.org/ebooks/29579
- ejlangev 9y agoIt's a shame we moved a lot of the US industrial base to an authoritarian and potentially hostile country like China. A bit scary to think of the generation or two of people who won't have the knowledge to manufacture things should they ever need to because of conflict in some form. Seems like it reduces any leverage the US has for holding China accountable for much that it does.
- anthonyleecook 9y agoWe need some investors to band up and recreate the hardware environment in Shenzhen. There would be a lot of money made that way too so not sure why there wouldn’t be one in Nevada or Arizona or something.
- Slansitartop 9y agoYeah, I kinda wish that Apple, as a condition of repatriating its billions at a lower tax rate, had to spend that money standing up Shenzen-like infrastructure somewhere in the US to build its products.
- bb88 9y agoI think the problem is that even if they did, they wouldn't use the facilities, because the labor in the Chinese/Taiwanese facilities would still be cheaper.
- korethr 9y agoWhile I like the idea, I think there are presently cultural barriers in the way of that succeeding, mainly the Western view of IP vs the Eastern view of IP. Bunnie talks about it on his blog here: https://www.bunniestudios.com/blog/?p=4297 https://www.bunniestudios.com/blog/?p=4297
- bb88 9y agoThis is pretty spot on. A fun channel on Youtube to watch is BigClive where he tears the stuff from china apart and comments on it. Here's one where he tears down a flicker flame lamp. https://www.youtube.com/watch?v=_KhtBA0EHDM https://www.youtube.com/watch?v=_KhtBA0EHDM
- rw 9y ago"Your scientists were so preoccupied with whether or not they could, that they didn't stop to think if they should." - Jeff Goldblum as Dr. Ian Malcolm in Jurassic Park
- freecodyx 9y agoreminds me of pychopass
- liberte82 9y agoIf you want a vision of the future, imagine a boot stamping on a human face - forever.
- liberte82 9y agoIt appears that police are still building profiles themselves by sifting the big data for terrorist-matching patterns. The next step is to let AI do it all. We don't even have to know what is being matched on what, just that Citizen A's "profile" is sufficiently similar to Terrorist B's "profile". This is how AI takes over the world without requiring sentience.
- smsm42 9y agoMore correct headline should be "China using big data to detain people who did not commit any crime". At that point you're realizing this has already routinely been done by many countries, including China, without using any big data at all. In fact, detaining people who didn't commit any crime has been done before people knew what "data" is.
- luizfzs 9y agoPerson of Interest
- kwhitefoot 9y agoTony Blair apparently wanted to do the same by psychiatric examination of pre-school children: http://news.bbc.co.uk/2/hi/uk_news/politics/5301824.stm http://news.bbc.co.uk/2/hi/uk_news/politics/5301824.stm.