4 ms·

And exactly zero people are surprised that miniscule, random tweaks to images are imperceptible to humans but obviously trash the hash.

LocalH 5y ago
But machine learning! Neural nets! Artificial intelligence! All words that have meaning that becomes diluted in public perception, and lead to things sort of becoming a "black box", where we don't really know how the models actually do what they do.
- amelius 5y ago
  Most machine learning models get it right only in 80% to 90% of cases. So if you have millions of users each with thousands of pictures, you can see how often you run into problems. Even with 99% accuracy, the amount of errors is enormous.
  - LogonType10 5y ago
    And each of those errors leads to a SWAT team breaching your front door at 4 AM and pointing rifles at your family.
    - charcircuit 5y ago
      That's not how it works at all.
- syshum 5y ago
  When the internet was first rolled out to the masses everyone took a basic thing and put "on the internet" after it to make the dotCom bubble Seems history it repeating itself with "Artificial intelligence" with all things done by a computer...
uoaei 5y ago
Lots of people would be surprised. Because they aren't educated about how these things work. I'd wager that project managers working on these teams also don't have the understanding (let alone intuition) to judge whether these risks are present, and so will continue fighting for it. The wager is based on the presumption that someone who did understand these risks would pivot or otherwise not allow this initiative to continue. PMs fight so hard because from their position their job is at risk if the project takes a nosedive. But they don't know what they're advocating for a lot of the time. I know quite a few folks like this in FAANG and adjacent spaces.
- smcl 5y ago
  Hell even the author of the linked article doesn’t seem to understand what hashing is. Underneath a collection of original and modified images they’ve put “These images have been hashed, so that they look different to detection algorithms but nearly identical to us”
genewitch 5y ago
Go back on this very site to August posts and read the comments about how infallible apple's special sauce of anti-privacy is. "It's not a hash it's a perceptive hash so changing a few things won't fool it" even though there was rumors that you could false positive it all day with flesh colored cake frosting with raspberries on it. Or did I miss the sarcasm tag?

LocalH 5y ago

But machine learning! Neural nets! Artificial intelligence! All words that have meaning that becomes diluted in public perception, and lead to things sort of becoming a "black box", where we don't really know how the models actually do what they do.

amelius 5y ago
Most machine learning models get it right only in 80% to 90% of cases. So if you have millions of users each with thousands of pictures, you can see how often you run into problems. Even with 99% accuracy, the amount of errors is enormous.
- LogonType10 5y ago
  And each of those errors leads to a SWAT team breaching your front door at 4 AM and pointing rifles at your family.
  - charcircuit 5y ago
    That's not how it works at all.
syshum 5y ago
When the internet was first rolled out to the masses everyone took a basic thing and put "on the internet" after it to make the dotCom bubble Seems history it repeating itself with "Artificial intelligence" with all things done by a computer...

uoaei 5y ago

Lots of people would be surprised. Because they aren't educated about how these things work. I'd wager that project managers working on these teams also don't have the understanding (let alone intuition) to judge whether these risks are present, and so will continue fighting for it. The wager is based on the presumption that someone who did understand these risks would pivot or otherwise not allow this initiative to continue. PMs fight so hard because from their position their job is at risk if the project takes a nosedive. But they don't know what they're advocating for a lot of the time. I know quite a few folks like this in FAANG and adjacent spaces.

smcl 5y ago
Hell even the author of the linked article doesn’t seem to understand what hashing is. Underneath a collection of original and modified images they’ve put “These images have been hashed, so that they look different to detection algorithms but nearly identical to us”

genewitch 5y ago

Go back on this very site to August posts and read the comments about how infallible apple's special sauce of anti-privacy is. "It's not a hash it's a perceptive hash so changing a few things won't fool it" even though there was rumors that you could false positive it all day with flesh colored cake frosting with raspberries on it. Or did I miss the sarcasm tag?