3 ms·
> The false positive rate on quality facial recognition is actually very low. It depends on the purpose. For identity verification purposes, when you already
by Majromax 4y ago
> The false positive rate on quality facial recognition is actually very low.
It depends on the purpose. For identity verification purposes, when you already have independent reason to suspect that someone is specifically Person X, then a "very low" false positive rate is likely sufficient.
For filtering, however, "very low" isn't enough. Suppose your facial recognition system has a 0.001% false positive rate (one per 100k), but you have a list of 1000 banned faces and your venue sees 10,000 visitors per night. You're making ten million comparisons, and that "very low" false positive rate will still result in 100 false matches.
That could still be okay, if a match just involves (here) pulling the patron aside for an ID verification. Asking 100 people for ID is much more benign than turning 100 people away at the turnstile. MSG here did appear to follow the match with a secondary verification (per the article), but I shudder to think of all the venues that will hear "very low false positive rate" and not really think through the consequences.
- lja 4y agoI completely agree with you on this point. AI practitioners have an ethical responsibility to communicate these shortcomings to clients. I know my firm regularly talks to clients how humans should intervene in the AI systems we build. It's a necessary conversation to ensure clients know we aren't building them something flawless. I loved your .001% example, I'm going to steal that when I talk folks. We often describe how systems fail at scale and talk about how being wrong 1/1,000,000 times can wildly backfire at large numbers. All that being said, I just don't want people around this forum thinking facial recognition is some fringe, low accuracy modeling exercise like they used to be. The models are actually incredibly impressive these days.