3 ms·
Im comparing with google's detection systems, and I got a question. Google search detection system that identify a real user from a bot has always failed when
by belorn 14y ago
Im comparing with google's detection systems, and I got a question.
Google search detection system that identify a real user from a bot has always failed when the user travels through the Tor system. Thus, it looks to me that any machine learning system, even those produced by someone with immense amount of data, will always have a high false-alarm rate. This is also obvious if one look at gmail when it wrongly mark legit mails as spam, and at IDS/virus market. How will Sift Science will deal with the issues of false-alarms, and how should website owner act regarding the score. Should they automatically follow the score given, or just flag suspected users. What is the suggested best practice? If its a webstore, should they block, delay, or just observe the transaction?
- brandonb 14y agoGood question! Trading off false positives and false negatives is a big part of why we expose a score, rather than just a "yes"/"no". Each site has a different balance. Most of our customers review each user we flag, and have a human make a final go/no-go decision about whether to accept the transaction. I'd recommend starting with that configuration. Once that's working, then I think it makes sense to automatically block users who have exceptionally high thresholds. We can help identify a threshold with a low rate of false positives!