10 ms·
'I was misidentified as shoplifter by facial recognition tech'
- deleted 2y ago[deleted]
- blindriver 2y agoHow is this not slander? Falsely telling someone that you're a thief with real worldly consequences like getting kicked out of a store should have real legal consequences.
- nothercastle 2y agoThis is the uk, you probably don’t have much rights to stop intrusive public private rights violations
- _lvbh 2y agoOnly if you have the money to sue. Things being the way they are, rather than fixing the issue, they would more likely simply increase the confidence threshold based on whether you look wealthy enough to sue
- OptionOfT 2y agoSlander requires a third person. The person from the store telling you you're a thief might be wrong, but it's not slander. I'm not sure about the computer program though. It telling a third person (i.e. the person from the store) would be libel, but since it is the result of a calculation, I'm not sure if it's considered libel.
- prepend 2y agoFacewatch is telling the store. Technically, it’s probably saying “there’s an 80% chance this person matches a thief” and the store is interpreting that as “ban them.” I don’t know UK slander laws, but in the US, it has to be incorrect to be slander. So this probably wouldn’t pass the test.
- michaelmrose 2y agoIf its said in public the general public is the audience that hears the slander. If the store had even the slightest amount of brains they would have simply asked the person to leave without saying anything about the cause.
- mytailorisrich 2y agoAs long as the accusation was made in public with other customers around it can be slander. In the UK it would be for the defendant (I.e. security guard/store) to prove that the claim was actually true. So in this case they would be stuffed. The person should definitely contact a solicitor.
- throwaway14356 2y agoshe should get a free candybar.
- whimsicalism 2y agomistaken arrests aren’t slander
- michaelmrose 2y agoFrom the story. "Within less than a minute, I'm approached by a store worker who comes up to me and says, 'You're a thief, you need to leave the store'." Knowing that one in 40 people so flagged aren't guilty of a crime means they are deliberately imposing upon those so flagged. The choice to use a faulty tech isn't itself a mistake its a choice. EG if you exposed a million people to this tech daily you would falsely arrest 11,000 people.
- ajb 2y agoIn the UK, only police ('sworn constables') have legal protection when conducting an arrest. Ordinary people conducting a 'citizens arrest' are committing a crime if they make a mistake (false imprisonment). Store workers are not usually sworn constables. In any case, the article is not about an arrest. Making someone leave is not an arrest, it's the opposite (an arrest is detaining someone).
- mikrotikker 2y agoRemember that doco on Netflix where black people were complaining and trying to solve for not being correctly detected by facial recognition tech? They had a genetic advantage against FRT.
- smitty1e 2y agoIn ancient times, one was innocent until proven guilty. But, hey: Progress.
- throwaway14356 2y agoThat was not long ago. In ancient times you wouldn't be on trial if you were innocent.
- upon_drumhead 2y agoSalem might want a word...
- dspillett 2y agoThat is the sort of thing Mx Throwaway was getting at: the fact that you were on trial was often seen as a sign of guilt, because why would an innocent person be on trial? Almost everybody else on trial was found guilty, so why should this trial be any different?
- eesmith 2y agoThe Code of Hammurabi says otherwise. Quoting from http://www.general-intelligence.com/library/hr.pdf http://www.general-intelligence.com/library/hr.pdf, linked-to from https://en.wikipedia.org/wiki/Code_of_Hammurabi https://en.wikipedia.org/wiki/Code_of_Hammurabi: 1. If any one ensnare another, putting a ban upon him, but he can not prove it, then he that ensnared him shall be put to death. 2. If any one bring an accusation against a man, and the accused go to the river and leap into the river, if he sink in the river his accuser shall take possession of his house. But if the river prove that the accused is not guilty, and he escape unhurt, then he who had brought the accusation shall be put to death, while he who leaped into the river shall take possession of the house that had belonged to his accuser. 3. If any one bring an accusation of any crime before the elders, and does not prove what he has charged, he shall, if it be a capital offense charged, be put to death.
- whimsicalism 2y agoi think you might have an overly romanticized view of justice in ancient times
- forrestthewoods 2y ago> The Metropolitan Police say that around one in every 33,000 people who walk by its cameras is misidentified. But the error count is much higher once an someone is actually flagged. One in 40 alerts so far this year has been a false positive. A 97.5% accuracy rate seems… really really high! Obviously facial recognition shouldn’t be the only bit of evidence. But that’s remarkably accurate.
- nullc 2y agoIt should also get worse as more people are added: In a large enough population almost every person has some look alike who happens to be a thief. Another way to look at it is for the worst case person what is their false positive rate? It's going to be 100%: Joe Blow, who did nothing wrong to no one, will go from place to place getting kicked out for the rest of his (/the system's) life. The failures aren't random (or at least not entirely)-- some people will get a heap of error in their lap. So while getting punted 1:10000 times you go somewhere unfairly isn't too bad, getting always punted is awful. The unequal distribution of errors creates bad incentives: the system is almost risk-less for those of us who aren't the victims of false hits, so why should we demand improving or banning it?
- Nextgrid 2y agoSo high in fact that either the numbers are cooked or the threshold required for a positive match is set really really high, so they get a lot of false negatives, which opens the possibility that the threshold can be lowered in the future.
- defrost 2y agoIt lacks context, it could misidentify half of the people scanned and still have the police report that number. eg: 33,000 people walk past cameras but only two are flagged as matching a person of interest on the watch list. One of those is a mistake, the other was correctly identified. From the Police PoV that's one mistake in 33,000 .. but whose to say the remaining 32,998 people were correctly identified? Perhaps they were all criminals that weren't identified, perhaps they were all not criminals but not correctly matched. Perhaps 2,000 were criminals and on the watch list but not identified.
- throwaway14356 2y agoI would like to put our officials under cameras 24/7 with the footage publicly available complete with the means to put them on trial and lock them up. When we've accomplished that im fine with monitoring everything always forever. But no sooner.
- kingkawn 2y agoWhy should public service be even more inhumane ?
- morkalork 2y agoWhat's good for the goose is good for the gander, no? Besides, stealing a random item from a super market shelf is much less damage than what a corrupt politician could do. Perhaps we should prioritize them instead..
- philipov 2y agoPeople who want power are the ones who can be trusted the least to have it.
- kingkawn 2y agoMaybe the people who run for office are so bad because only someone who can accept constant abuse from the public can stand it. Maybe this attitude is the problem.
- philipov 2y agoNo, the problem is that those who don't play ball with their political machine's interests are shut out from opportunities to advance. Tammany Hall is a famous historical example that goes back much farther than the public has had as strong a voice as it does today, and though the faces have changed this is still how things get done. The game is rigged at the level of who gets to stand for election, particularly in safe-seat districts that get decided in the primary. Very few people are able to get elected without help from their local political machine getting out the vote - enough to provide plausible deniability, but not enough to create an effective opposition. Remember the monopsony of Sheldon Silver? He used his position to control which politicians would receive contributions for their campaigns, creating a network of people dependent on him for political survival. It's that kind of power broking that's the problem. The clear and present danger of entrenched power is why politicians must not be allowed a shred of privacy.
- subroutine 2y agoA few questions here... How did they know she shoplifted in the first place? Does the tech also identify shop lifting, or do they just search a database of people convicted of shoplifting (in which case they could have just checked this person's ID and realized it was mistaken identity). Is being caught shoplifting a credible reason to deny someone access to basic goods indefinitely? What if all supermarkets in a town use the same facial rec service?
- crooked-v 2y ago> How did they know she shoplifted in the first place? She didn't.
- asveikau 2y agoSeems like they're trying to match against known people and it has false positives.
- michaelmrose 2y agoIt uses facial recognition ergo a computer flagged her face as similar to the face of someone known to be banned from the store. This tech is known not to be good enough for this use case. If you match a large population of users you are going to get an unacceptable level of false positives. Even putting a human being in the loop is trouble prone because people aren't on average good enough at this. It would be more useful to require a free membership to shop there and validate allowed users via bluetooth and ban users devices and phone numbers.
- abdullahkhalids 2y ago> they could have just checked this person's ID If random store employees start walking up to people and asking them to show ID, is that an acceptable state for society?
- johnnyanmac 2y agoIt is at Costco /s But note that this is the UK. Different issues from the States (where this wouldn't ever pass. We have weak social security specifically becsuse citizens rejected a national ID).
- throwaway14356 2y agoThe Chinese solved this by adding more cameras. If you can lookup where the potential suspect came from and pull their full details from the fuzzy query false positives become unlikely. More data is the answer! lol
- nitwit005 2y agoIt's essentislly impossible to eliminate false positives. With billions of people on the planet, the odds of someone looking extremely similar is high. Plenty of actual twins around as well.
- int_19h 2y agoI'm sure there are other things that could be captured and analyzed aside from images. Gait, perhaps? It's similar to web tracking - each individual method might be very unreliable, but the intersection of them can be extremely specific. Or just implant RFID into every citizen at birth. It's for your safety, after all - if you get lost or abducted, that's how they'll find you.
- perihelions 2y agoNot sure why this comment's gray; it's a good point (and a sobering one). In the very near feature, Western countries likely won't be relying on individual surveillance cameras; we'll have end-to-end chains of cameras that will confirm, with confidence, which house a person walked out of 2 hours ago, right down to their interior flat entrance inside an apartment block. (As the PRC is currently trialing). We'll have near-perfect panopticon identity systems, associating facial recognition with place of residence, and dozens of other factors. It's very important to ponder what the PRC is pioneering today because we're about three years behind doing exactly the same things, and for the same reasons. It's only going to be a brief time before things we're horrified about, and vitriolically condemn totalitarian states for, are things we're going to fully normalize within our own culture.
- nurple 2y agoThis is why predator drones orbiting for days over protests is so scary, this is exactly the functionality their payload powers. https://en.wikipedia.org/wiki/ARGUS-IS https://en.wikipedia.org/wiki/ARGUS-IS https://yewtu.be/watch?v=CpLdL8ONEm4 https://yewtu.be/watch?v=CpLdL8ONEm4
- viraptor 2y agoHN yesterday: EU is so silly trying to regulate AI usage, "The Banned and High-Risk lists read like a call for startups (outside the EU)." https://news.ycombinator.com/item?id=40473533 https://news.ycombinator.com/item?id=40473533 HN today...
- betaby 2y agoGov exempts themselves and the powerful from regulations.
- armchairhacker 2y agoAs always, it's the details of the regulation that matter. Or perhaps more important, how it gets enforced.
- deleted 2y ago[deleted]
- jellicle 2y agoIf China surveils people, it's because they are evil and authoritarian. If we surveil people, it's because we're just keeping the public safe.
- altcognito 2y agoNobody here is cheerleading this, I think the overwhelming sentiment is that it is invasive (and inaccurate but that’s beside the point)
- Nextgrid 2y ago> Nobody here is cheerleading this By "here" do you mean in the UK? Somehow the UK is consistently the first non-China nation where this authoritarian surveillance crap takes hold. Other countries make pushes towards it, but UK appears to be consistently leading.
- altcognito 2y agojust this particular post on hn. I'm not from the UK so I can't fully comment, but based on the stories I read here, I'd agree with your general sentiment.
- jellicle 2y agoThe BBC is, for one.
- int_19h 2y agoAs the article points out, most people they've asked around those cameras were provisionally supportive of them (so long as they "help with crime").
- daveoc64 2y agoAs the article points out, given the rampant levels of shoplifting in the UK (and the associated abuse of staff), all of the major retailers and a lot of their staff are going to be on board with this. For the government and police, it's a cheap option to deal with the problem.
- swayvil 2y agoIt's better than being identified as somebody who has a high probability of becoming a thief in the future, I suppose. Do we do that? Do we want to do that?
- kwhitefoot 2y agoTony Blair wanted to do exactly that with psychological profiling of kindergarten children.
- johnnyanmac 2y agoI don't think we have that tech yet (outside of good ol' racism, of course). Given current controversies around Her, I'm sure some techie will see Minority Report and view it as a dream to pursue rather than a cautionary tale.
- seanmcdirmid 2y agoI don’t know. Whenever I see those amber alerts to be on the lookout for a grey Nissan with license plate number something, I think isn’t that a great opportunity to use at least OCR or something. Or be on the look out for some kidnap victim kid who looks like other kids, asking people to do what technology can already do much better sounds dumb. Machines are going to come up with false positives, but so will human beings who are asked to be on the lookout for some kid of some redacted race in a hoody.
- ghaff 2y agoThe amber alert stuff seems useless. Maybe I’m a bad person but I just have that disabled. The emergency weather warnings are also pretty high false positive with respect to things like flash flooding but at least worth being aware of.
- r2_pilot 2y agoOh it is quite useless where I am. Before I disabled it, I would routinely get ear-shriekingly loud alerts at 4:30 in the morning for events happening hundreds of miles away. Worst waste of resources that are mandatory on phones, ever, except for the presidential alert.
- int_19h 2y agoThe difference here is that people are asked to be on the lookout at some specific moments when a crime is known to be occurring, while cameras can - and are, per TFA - being used for straight up fishing expeditions. That said, yes, it would be nice if there was a way for my car to automatically scan car plates around, linked to my phone so that when an amber alert comes in and I explicitly choose to enable the scanner at that point, it would report matches for that particular number automatically. But we all know that's never going to happen. Well, the automatic plate scanners in every car will probably happen eventually - it's too easy technologically for someone to not come up with a bright idea to mandate them "for safety". But they will be enabled and effectively controlled by law enforcement 24/7.
- anonshadow 2y agoHaven't UK learnt anything after unjustly accusing and imprisoning all those people that the Postmaster thoughts had stolen money when it turned out eventually to have been a software bug?
- dspillett 2y agoAll the people who need to learn from that seem to be learning, is new and interesting ways to pass the buck.
- varispeed 2y agoI don't think it was a "bug", but it is probably described as such to minimise what happened. My understanding is that people with admin access were manipulating Postmaster transactions which resulted in creating artificial losses and Post Office was denying it was possible, despite having knowledge it was happening.
- richrichie 2y agoWe have many studies that show vulnerabilities of these image classification models to noise (adversarial or otherwise). The confidence levels are just not enough to fit into our "innocent until proven guilty (beyond reasonable doubt)" justice system. The danger is that big tech/AI can pump enough money into politics that justice system parameters will be rewritten.
- vector_spaces 2y agoLet's say this technology was basically infallible: only known shoplifters were flagged. What then? Should shoplifting once mean that a person is banned from all stores that use this service for life? Also: I assume that this service wouldn't just impact shoplifters, but anyone that a store saw fit to ban for any reason. What about people who experience mental health crises? I had a friend who had psychotic breaks while her issues were still undiagnosed and untreated I know that this ultimately depends on the store's own policies, the facial recognition tech just provides information. but frankly I don't want to live in a world where making such a minor mistake in your youth could basically ruin your life
- fwlr 2y ago> Should shoplifting once mean that a person is banned from all stores that use this service for life? I mean, it depends, right? Barred from buying any groceries for stealing a candy bar is obviously wrong… but if you walk out the door with a five-figure watch you didn’t pay for, I’m happy for you to be banned from Rolex shops for life, yeah.
- withinboredom 2y agoUnless you already went to jail for it? People do change over the timelines of an entire life.
- brokenmachine 2y agoIf a decision needs to be made, I think "access to public businesses" should be something that is decided in a court, and not by shady AI surveillance corporations.
- jordansmithnz 2y agoWhen I was 18 years old, a security guard kicked me and a friend out of a grocery store, much to our confusion. After talking to them and requesting the store manager, it turns out they had a photo of a shoplifter that looked very similar to me. Eventually we were let back in the store and it was all OK. So, it’s not an entirely new problem? Although with facial recognition I guess there is less recourse; a manager is not as likely to believe they got it wrong if their computer tells them otherwise.
- vector_spaces 2y agoThere isn't much recourse anyway, you were entirely lucky that they were willing to be reasonable. At least if you live in the US, not sure what laws are like around this in Europe I don't think this status quo should be empowered further by error prone tech
- uni_baconcat 2y agoEven without the facial recognition system, security guys can ask customers out, since those are private property. And you are lucky that store manager helped you with the issue. Most cases I heard around me are that the security guy and the manager just gives no explanation.
- DavidPiper 2y agoI have deliberately not clicked on the link yet. My thought process just based on the title: 1. Okay well maybe the technology was wrong. 2. Or maybe the shoplifter is lying? 3. Surely "my word against yours" in the case of "human vs. computer" is solved by believing the human? 4. Isn't the whole point of this technology to catch humans who lie? 5. Then surely, if it's a shoplifter, there is video footage and that will clear up the issue. 6. But what if there isn't footage. What if it's just an AI that's detected someone as a shoplifter based on their face? 7. The technology for this is really mature, now I'm inclined to believe the computer. 8. But what about the guy? (Yay, gender assumption based on the word "shoplifter") 9. Well, in order to believe him I would want to understand why the AI was wrong. 10. Oh, the whole thing with AI in many contexts is that YOU CAN'T KNOW THIS. 11. This is why people care about understanding how AI makes decisions and have serious reactions to technology that just "magics" a decision out of thin air, even when it's the right one this time. 12. But what about the guy? Well, I've just newly understood some things about the social impacts of pervasive AI. Time to read the article.
- farrarstan 2y ago[dead]
- deleted 2y ago[deleted]
- mr_toad 2y ago“ The Metropolitan Police say that around one in every 33,000 people who walk by its cameras is misidentified. “ Given the UK population of 67 million, that’s about 2000 false matches.
- alex_young 2y agoPer time they venture near one of these cameras…
- akdor1154 2y agoIt's an absolute bullshit statistic. There is no way they have established ground truth to evaluate accuracy at this scale. $100 says they've taken the numerator of 'people we detained where it turned out we dun goofed' over the denominator of total people scanned.
- takinola 2y agoThere seems to be a misunderstanding of the place of technology in the criminal justice system. There is nothing wrong with using technology to sift through a mass of data points to narrow down suspects or point the investigation in a particular direction. However, this does not obviate the need for investigation to actually verify that the initial identification is correct. There should never be a case where people are arrested or prosecuted solely on the word of a database query.
- garspin 2y agoAgree. A better response to '80% chance that this is a known shoplifter' is for security to keep an eye on them. It should very quickly become apparent that it's a false positive (or not).
- hnbad 2y agoThe problem is that this technology is not sold that way, it's sold as a way to detect shoplifters. It's also extremely important how the result is phrased and presented: even "80% chance that is is a known shoplifter" simply means "this is a known shoplifter" to a layperson. But even a 99.9% or 100% confidence might be wrong so this isn't even an 80% chance - at best it's 80% times the statistical likelihood of this not being a false positive at 100% confidence, and that can never be a 100% chance. The (psychologically) correct way to think of this is as a colleague making a claim and telling you how certain they are. But this tech is not sold as a colleague, it's sold as a machine that is better than humans. It's not a perfect super cop but that's how it is marketed and why people buy it.
- jimmySixDOF 2y agoI am afraid the Appeal to Authority fallacy is one we as a society are about to be exposed to on a massive level and recognize as a side effect of integrating AI into our daily lives.
- fwlr 2y agoI’m worried that opponents of facial recognition are shooting themselves in the foot with the inaccuracy argument. Sure, maybe face rec ends up like Siri or self-driving cars. Even if it ends up like DallE or ChatGPT they probably still have a point. But I’m a little bit afraid that it might have an AlphaGo moment and just become extraordinarily superhuman at facial recognition, becoming much more dangerous while simultaneously dismantling the case they’d been building against it.
- int_19h 2y agoThis is in UK. The "but what about privacy?" argument has been lost there a long time ago, so they make do with what they have.
- defrost 2y agoFrom the same article, meanwhile, out on the street in public space: On a humid day in Bethnal Green, in east London, we joined the police as they positioned a modified white van on the high street. Cameras attached to its roof captured thousands of images of people's faces. If they matched people on a police watchlist, officers would speak to them and potentially arrest them.
- swarnie 2y agoThat seems perfectly reasonable?
- defrost 2y agoSure, it may be reasonable, it's still worth pointing out that the article is not just about people entering a specific chain of shops, it's also mentioning police vans sitting in the middle of pedestrian concourses outside such shops doing the same face scanning.
- jjbinx007 2y agoIt places a burden on someone to somehow prove their innocence, if they can. What if a person refused to speak to the police? Or what about this? A man covered his face when walking past one of these vans in a public street. He protested and was then fined £90 for swearing (swearing is not illegal but The Pubic Order Act is another law that is often abused by police but that's tangential) https://www.independent.co.uk/news/uk/crime/facial-recognition-cameras-technology-london-trial-met-police-face-cover-man-fined-a8756936.html https://www.independent.co.uk/news/uk/crime/facial-recogniti...
- foldr 2y agoThis is the same burden a person would be under if a police officer simply noticed someone on the street who looked like a wanted suspect (without computer assistance). I agree that the automated system makes this situation more likely to occur, but it has always been the case that you can potentially be arrested because you look a bit like someone else. And in that situation you would have to do your best to convince the police officer that you were in fact someone else.
- reify 2y agoLive CCTV offenders here on Airstrip One John Lewis, Co-op, Tesco, Sainsbury's, Waitrose, Next, Marks & Spencer, Boots Primark
- aembleton 2y agoProbably easier to list who doesn't have CCTV
- reify 2y agoLive CCTV offenders here on Airstrip One John Lewis, Co-op, Tesco, Sainsbury's, Waitrose, Next, Marks & Spencer, Boots Primark
- Lio 2y agoWaitrose self-checkouts point a camera at your face when pay so that you can see yourself on screen. I dislike shoplifting and petty crime but I also dislike this form of cheap, petty intimidation. I don’t want to live in this dystopia.
- stoneman24 2y agoThe large Asda near me does this, too. Not happy about it but not sure what can be done to stop it. Probably needs either Scottish Parliament or Westminster to enact a privacy law and I can’t see that happening. Perhaps it’s already covered under the European convention on human rights, but I don’t know if that still applies.
- YeGoblynQueenne 2y agoThat's the one the Tories tried to tear down as a "villain's charter" isn't it? And Labour are very keen to show they're "tough on crime". So I guess, not.
- gizajob 2y agoI think Asda’s is so bad and intrusive that I’ve long since stopped shopping there. Also the worst of supermarkets on the quality front. Even Lidl is better.
- YeGoblynQueenne 2y agoWhoever designed the Waitrose self-checkout was a master in the art of annoying one's customers. Not only there's a camera pointed at you, the machine will urge you to bag an item "or press finish and pay" as soon as you take a few extra seconds e.g. to solve a Backpack Problem with a can of sardines and a packet of pasta etc. And they're supposed to be the up-market chain?
- viking123 2y agoThe Hikvision facial recognition camera in my previous condo sometimes recognized me as an Indian man, and sometimes it scrolled through tons of faces and unlocked the door. I am from northern Europe btw. Sometimes it also had difficulty recognizing me when my hair grew longer.
- AndrewDucker 2y agoCan happen without technology too, of course. I was nearly thrown out of a pub before I opened my mouth and the staff realised I wasn't the person who caused trouble there the week before.
- huhtenberg 2y agoThe UK has been trying for decades to become the surveillance society, hasn't it? I remember being taken aback by the amount of street CCTV cameras back in the early '00s. Coming from Canada for a visit that feeling of being observed nearly constantly was really uncomfortable and bizarre. For Brits it looked like a norm (or they didn't show it). Also the parallels with 1984 were uncanny, especially given that Orwell was English.
- pjc50 2y agoOrwell understood the authoritarian streak in the national character.
- tazjin 2y agoDon't forget the incredible posters that used to be up in London! http://soerenkern.com/web/wp-content/uploads/2014/06/uk-met1.jpg http://soerenkern.com/web/wp-content/uploads/2014/06/uk-met1...
- moffkalast 2y agoThat's gotta be satire right? Looks straight out of V for Vendetta. I'm really glad the EU just completely banned predictive policing.
- deleted 2y ago[deleted]
- _joel 2y agoIt's got a red bus on it, must be one of Boris's...
- tazjin 2y agoIt's not satire! It really was an official poster campaign (some 20 years ago).
- ecjhdnc2025 2y ago
- ItsBob 2y agoFor me the solution is clear: require written authorization from everyone you want to capture with facial recognition software. It prevents privacy issues and doesn't stop research. Exceptions could be made in gov buildings perhaps due to national security but the idea of unlimited private companies taking my photo, or using video for gait analysis, facial analysis etc is abhorrent. I'm not against tech and love what AI can do but private companies using my images for facial recognition is a step too far.
- lambdaxyzw 2y ago>It prevents privacy issues Next step: every big company/store requires a written authorization to enter. Back to square one.
- hgyjnbdet 2y agoThat was what I was going to say. All the stores need to do is warn potential customers that by entering the stores premises the potential customer agrees to x technology being used for the purpose of y. It's the potential customers choice then, leave or enter.
- ozzcer 2y agoThe jakes have recently started parking these facial recognition vans up at protests and introduced a brand new imaginary law making face coverings illegal if they so deem it. We really aren't ok over the here.
- smusamashah 2y agoIs there a better way to avoid shoplifting or catch shoplifters using tech?
- JohnFen 2y agoHumans watching CCTV cameras, maybe?
- rwmj 2y agoPrivate shops largely have a right to bar whoever they want from being a customer, except in protected categories ("shoplifter" isn't one of those). The problems here are (a) no one understands type I / type II errors, (b) everyone trusts computers must be right all the time, and (c) there's no easy way for this particular customer to prove that she's not the shoplifter. (c) could be fixed by a process. (a) and (b) are very hard nuts to tackle.
- mytailorisrich 2y agoShe can contact a solicitor and go after the store/security guard for slander if they made the claim in public. Under UK slander law it would be for the store to prove that the claim was true, not for her to prove that it was not.
- pjc50 2y agoYou can't get legal aid for that, so the astronomical cost wouldn't be worth it.
- mytailorisrich 2y agoThere are steps. A good solicitor letter may prompt a financial settlement and would serve its purpose, not least as the story is making headlines... In any case, contacting a solicitor does not hurt.
- hugh-avherald 2y agoThe damages for defamation would be severely limited. Considering that most people in the store would barely notice, and would probably not even remember the following day, you'd be entitled to zero damages, and probably not even costs, for defamation. You might be entitled to a bus fare (not a taxi) to a different supermarket, but that's about it.
- ajb 2y agoSeems like an opportunity for the lawyers to me. Being evicted from a store is necessarily a public act. Telling someone wrongly that they are a thief, in public, seems like libel. Since most people go to stores in their neighbourhood, this could easily happen in front of your friends, neighbours, parents of other kids at your school, fellow members of social clubs or worship clubs, etc. If this happened to me, I'd be going and seeing if I could get any lawyers to take this on a no-win no fee basis. It seems like businesses are increasingly failing to think through what their process will look like to real human beings.
- Latty 2y agoWhen I worked on analysis software for police & intelligence agencies, it quickly became clear that no matter how much you present something with clear "this is a heuristic, it can give you leads", a scary number of people will take it as "this will tell you whodunit" and just assume it's infallible. If people are going to treat these things like they are forensic evidence and not lead generation, then they shouldn't be legal. Some precedent that people need to check these things before acting on them would be very good.
- ajb 2y agoVery interesting - thanks for giving us the benefit of your experience. In the case of store workers, it's not obvious what other checking they could do. The only reasonable use I can see is for them to keep an eye on the person that has been flagged. But I expect that the entire purpose of this tech is to reduce the number of store guards they need to pay, so they are likely not to have the manpower. If the policy is 'don't let them in the store', I don't see how a store worker can avoid making false accusations.
- namaria 2y agoThere's something fundamentally wrong with these probabilistic analysis tools being sold currently as "artificial intelligence". The nuance in "probabilistic" is quickly lost and the output is taken as deterministic. Any piece of software that puts out data that is acted upon should have clear disclaimers attached. Calling it "intelligent" is irresponsible.
- Aeolun 2y agoDo they think it’d be better if the police did not use the facial identification tech? If they’re standing there with a van and immediately stopping you the only thing you have to do is pull out your ID?
- btasker 2y agoEasy answer: yes it'd be better. TFA says that it has a failure rate of 1:33,000. That's a "do not ship" rating for almost anything else. > immediately stopping you the only thing you have to do is pull out your ID? Someone I know was detained on the side of the M25 for an hour sorting things out after being pulled over. He presented the police with his ID and they decided it was a fake. His name was almost identical to someone who was wanted - his middle name and date-of-birth were different. The Police said that was common on fake IDs - just change a few small bits of information - and that they'd have to take him to the station where he could sort it. The only reason he didn't get taken in in the end is because the description of the wanted person noted that he had tattoos on his chest. On the side of the M25, at night, the only thing that stopped my mate being hauled into a London police station was taking his top off. Anecdotes don't make data, but the idea that a copper will simply accept ID despite a system saying "this is your guy" is incredibly naive and suggests you've not had to interact with them much.
- Aeolun 2y ago> suggests you've not had to interact with them much. Or the opposite is true and this has been enough to solve all my police problems? I’ll admit it is not in the UK, but I doubt they have a significantly less professional police force. > TFA says that it has a failure rate of 1:33,000. That's a "do not ship" rating for almost anything else. For anything where failure means death, sure. For situations where failure means a minor inconvenience, maybe not so much. To me, the only relevant point of comparison here is the rate of misidentification by officers while _not_ relying on the face id tech. Because that’s the alternative, not having no arrests or searches at all.
- btasker 2y ago
- krisoft 2y agoI understand that my viewpoint differs from that of many here. I don’t see the problem with the live face detection. What I see as a problem is the process followed after the detection. Simply saying with any system like this there will be mistakes. The reaction should be designed such that we account for these mistakes. It sounds like the system as designed has at least three unhandled exceptions: - your system thinks I am someone who stole something but I am not that someone. (Mis-identification) - your system thinks I am someone who stole something, and I am that someone but I did not stole anything ever. (Mistake in the database) - your system thinks I am some who stole something, and I did, but I have already been properly punished for it. (Rehabilitation) If you just bar people from the shop automatically on a positive identification you are going to make the above mistakes on a massive scale. And because of the nature of these system if they made a mistake once with someone it is possible they will make the mistake again and again, so you better handle the exceptions in a gracefull and sensible maner. And shops will absolutely not do the right thing on their own. Because it is just so much cheaper to hassle the few who has fallen off from the happy path than build in the proper safeguards, so shops on their own will just decide to “eat” the losses caused by persecuting innocents. And that is the part which is not right. That is where laws should come in and mandate proper procedural safeguards. What are the proper safeguards? I don’t know. I have ideas on how that could go, but this comment is already getting very long. What I am saying is that I think the correct solution is not “no cctv with facial detection allowed” as many here seems to propose, but it is also not letting shops persecute innocent victims of the above exceptions. There is a third way with regulated and safeguarded procedures where I think we should be looking.
- EnigmaFlare 2y agoMaybe a solution is the cost of lawsuits from false positives vs the cost of theft from false negatives means shopkeepers or their insurance companies have to make a reasonable trade-off in how they use that information that keeps most people happy. The odd incorrectly identified person can still get cleared after a bit of inconvenient legal procedure and be paid for their trouble.
- krisoft 2y ago
- cm2187 2y agoIn my experience, when face recognition gives you a false positive, it's because there is a high likeness in the first place, and a human would likely have made the same mistake. How different is it from a police officer stopping someone in the street based on some photo on his most wanted cheat sheet? Or a shopkeeper denying entry to a customer based on the likeness to a list of mugshots held under the counter. Those are faillible processes too. Where face recognition is really useful is where it can match faces that would have otherwise fooled the human eye, just because it focuses on specific traits and ignores others like hairstyle.
- Macha 2y agoThe difference is scale. "You look a bit like a shoplifter from across the country" is not a productive use of a police officer's time, so will basically never happen. Whereas the people in this article are going to get challenged, if not outright refused or arrested, in an increasing number of stores as this tech spreads.
- bsenftner 2y agoThe problem is the dumb ass users of FR think an FR Match has authority, AND the industry does not discourage that attitude, not at all.
- BLKNSLVR 2y agoAnd there's a lack of, for want of a better word, punishment for false positives for all of: the law enforcement officers, the software publishers, the policy makers.
- JohnFen 2y ago> How different is it from a police officer stopping someone in the street based on some photo on his most wanted cheat sheet? There's a big difference. The cop knows that the resemblance could be coincidental and will (usually) do further investigation before actually harming the suspect. If an automated system fingers someone, the assumption is that the system is correct and innocent people caught up will suffer harm.
- lifeisstillgood 2y agoNot this case specifically, but the harm done by misidentification by a computer is seemingly no different for the harm done by a human misidentification - if the doorman / security guard / croupier thinks you are a miscreant then the same harm applies What might matter is the actions taken - but would they be any different if a human said “oh look that’s the well known shoplifter, keep her out”
- withinboredom 2y agoThe difference is if this shitty doorman worked at every shop.
- BLKNSLVR 2y agoHumans apply much more judgement to their own choices, and actions resultant from them, than instructions from the infallible machine. Humans may also be disciplined for not attending to an instruction from the infallible machine, whereas there are no stats or electronic records of human judgement of "is that the lady who shoplifted the other day? Hmmm, maybe... Maybe's not really good enough for how little I'm paid".
- leke 2y agoI'm wondering if this woman is still barred from stores that use Facewatch. It would be a terrible inconvenience to only be allowed in a select few shops. Where is the line defining certain private businesses as essential resources for day to day life? I think this sentence sums it up perfectly... > "It felt intrusive… I was treated guilty until proven innocent," he says. I don't want to live in this kind of society.
- jagrsw 2y agoThe trespassing laws for commercial establishments are very problematic. I'm in favor of laws that prohibit refusing service when selling openly offered goods or publicly offered services, with clear exceptions such as aggressive behavior, outrageously bad hygiene, requirements for proper attire etc. Rude behavior, shoplifting and other annoyances fall under separate laws. This should apply even to past criminals. Such laws protect against racism and other forms of discrimination, and they help integrate convicts back into society, at the cost of "commercial freedom". In jurisdictions with these laws (I know at least one), it's impossible to create, for example, bars only for men or only for women or refuse service to people we don't like (also, because they belong to some group, incl. morally reprehensible groups). There are some hacks around this and exceptions, but generally, it works and solves more problems, than it creates. Private gatherings or clubs are likely ok (nondiscrimination laws should still apply). UK and US are outliers here with their "can refuse service to anyone" approach.
- Waterluvian 2y agoCan you name the “at least one” jurisdiction? I’m curious where there’s a law saying you can’t reject service to, say, Nazis. I’ve only known examples where you’re free to reject anyone for any or no reason as long as it’s not because they’re one of a very small list of protected groups.
- jagrsw 2y agoPoland is one: 138 misdemeanor law: Whoever, professionally engaged in the provision of services, demands and collects a payment higher than the applicable fee for the service, or intentionally, without a justified reason, refuses to provide the service to which he is obliged, shall be subject to a fine. Some forms of propagation of fascism, communism and nazizm is prohibited in Poland, but I guess it probably would be illegal to refuse service to someone who otherwise declares support for some reprehensible ideas, and does that privately, so it doesn't fall under hate or other laws.
- Waterluvian 2y ago
- Retr0id 2y agoThe best silver-lining of COVID was that, for a while, we'd normalized covering our faces in the presence of CCTV. Unfortunately it didn't stick. If you wear a mask these days, you only stand out more.
- louwrentius 2y agoI firmly believe that the harm done to misidentified people is not worth the capture of people who are sought after. In the story I also noticed that people flagged are not treated as innocent until their identity has been truly established. What kind of society do we want? Was the money spent on facial recognition systems better spent on “prevention”? Probably not as this money would not have gone to the police so we can’t have that! /s
- _joel 2y agoI think another part to this is the police not attending shoplifting incidident (amongst many others) due to the reduction in the police numbers. It's definitely out of order, what the tracking company is doing, of course. Perhaps if we had a functioning police service and reduced the need for people to shoplift (yes, a lot of this is run by gangs now, but still some steal to feed).
- skywhopper 2y agoYou’ve listened to a lot of misinformation about this topic. There aren’t huge gangs of shoplifters, and police force numbers have been growing in recent years. If anything is to blame for whatever increase there has been in shoplifting, it’s the stores who have tried their best to eliminate every bit of human staff.
- _joel 2y agoShow me the data to back that up as everything being reported is completely the opposite of what you suggest. https://www.bbc.co.uk/news/uk-england-london-67742042 https://www.bbc.co.uk/news/uk-england-london-67742042
- skywhopper 2y agoThe only data point in your article is that London police don’t follow up on shoplifting calls very often. That doesn’t indicate anything other than how seriously the police take the crime.
- _joel 2y agoSo that's a no then.
- skywhopper 2y ago“it is also clear there are plenty among the public who are willing to put up with having their faces scanned - if it means safer streets.” Unfortunately it doesn’t mean anything of the sort. This tech doesn’t prevent typical street crime like muggings or assault. And the chance of getting hurt or killed by a police officer whose dispatcher just identified you as a criminal is much higher than what the random folks who skipped bail that are in this system would do to you (ie nothing). Then there’s the “low” false positive rates. They say only one of 33,000 people scanned is falsely identified. Okay, that’s pretty high. If they scan one percent of the UK population with these devices each day, that’d be 20 false positives a day, and 20 more potentially violent encounters with police a day. Compared to what’s likely a much smaller number of correct identifications of actual wanted individuals, most of whom could probably be found by much cheaper, less problematic methods.
- jessamyn 2y agoIn the United States local drug store Rite Aid got in some serious trouble for using AI facial recognition. Looking at some of the Federal Trade Commission's complaints against them can give you some creepy insight into how the technology supposedly works and how few checks for accuracy or oversight there are in place. https://www.ftc.gov/news-events/news/press-releases/2023/12/rite-aid-banned-using-ai-facial-recognition-after-ftc-says-retailer-deployed-technology-without https://www.ftc.gov/news-events/news/press-releases/2023/12/...
- o999 2y agoEventually, criminals learn how to use makeup to circumvent this technology and it will be just the poor people who get wronged, just like ban on E2EE.
- aendruk 2y agoJust today when a Kroger self-checkout machine failed to detect an item on the scale, instead of just calling the attendant over, it implied that it had caught me shoplifting and replayed a surveillance video of me. The video only showed me standing there miffed by the machine’s nonsensical instruction, but even that felt humiliating.
- pavel_lishin 2y ago> The BBC understands the mistake might have been due to a family resemblance. The Metropolitan Police declined to comment. The BBC should understand that much facial recognition software struggles with non-white faces, like Mr. Thompson's. "Family resemblance" my ass.
- fennecfoxy 2y agoI think the technology is fine, but as per usual it's misuse and abuse of the tool that's the problem; why is their policy "throw the person out"? Surely a sane policy would be "if it alerts keep an eye on the individual in the store while still being respectful" ie acknowledging that the system does not have 100% accuracy. And for anyone that complains about tech being used this way; you're too late, it's already happened, when you apply for a bank account, mortgage, any kind of insurance...the list goes on and they've been profiling people for decades and decades. It is impossible to prevent facial recognition being used...so laws need to be updated to ensure that the public have fair rights around this tech. But since when did laws or public opinion/understanding ever keep pace with technology?