4 ms·
Kathy ONeill has written a book covering some of this new area of concern (hers is the use of poorly controlled algorithms in making life altering decisions (wh
by lifeisstillgood 10y ago
Kathy ONeill has written a book covering some of this new area of concern (hers is the use of poorly controlled algorithms in making life altering decisions (which teachers to fire, how long a prison sentence to recommend))
The existence of algorithms intending to help head teachers run their schools, or here in technology intended to help police catch criminals, the existence is not the problem.
It's the poor use, the lack of transparency and the lack of oversight
I expect cameras covering public spaces to be ubiquitous in a decade - but the difference between crime free neighbourhood and oppressive police state is who has access to the video feed, what algorithms they use to process the faces and so on.
This seems a sneaky move by the sheriffs department to avoid negative headlines. A bad PR move one suspects but the principle ... that's what we need to spend the next decade debating publically
- noir_lord 10y ago> It's the poor use, the lack of transparency and the lack of oversight. And the fact as (many of us are) programmers we know just how buggy, generally unreliable and flaky software can be. Much like my instinctive recoil from IoT - "You want to put lowest cost manufactured network devices that have access to tonnes of personal data on my internal network and connect them to the internet..!", I find this trend deeply worrying, people who aren't techies tend to put undue weight on computer systems that usually give the correct results but can fail in subtle and not subtle ways with "Well it worked last time". I've had people tell me "Well that's not what the computer says" when I absolutely knew that what the computer says is wrong, most recently that I'd submitted electricity meter readings (I had a screenshot of both the submission and the corresponding "Your meter reading was recieved" success message, not my first rodeo..). To quote Jurassic Park "You where so busy figuring out if you could no one stopped to consider if they should".
- marchenko 10y agoIt is interesting to consider that we may not actually want a 'crime-free' neighborhood, depending on how crimes are defined, and the distribution of personal and public costs associated with policing behavior and punishing offenders.
- cooper12 10y agoWired has a great article on this and how there has to be some latitude for law breaking: https://www.wired.com/2013/06/why-i-have-nothing-to-hide-is-the-wrong-way-to-think-about-surveillance/ https://www.wired.com/2013/06/why-i-have-nothing-to-hide-is-....
- lifeisstillgood 10y agoI quite agree. Facial recognition could have spotted Rosa Parks and simply shut the door to the bus. Again, how we use the technology is vital. But open and free technologies and data feeds are far far less likely to be abused or if they are are much easier to spot.