2 ms·
> The people who collected it failed to record enough information about the data's provenance. This feels a bit a debate that I (general SDE) keep having with
by Terr_ 2y ago
> The people who collected it failed to record enough information about the data's provenance.
This feels a bit a debate that I (general SDE) keep having with Product folks who propose some sort of magic system that collates and displays "Applicants" across a bunch of unauthenticated form-submits and third-party customer databases, "because we already have the data".
Yeah, but most if it is fundamentally untrustworthy and/or must be aggressively siloed to prevent cross-customer data poisoning. We could try to an in-house identity-graph system, but we'd at least need to record something about levels of confidence for different steps or relationships or assumptions.
For example, it would be very bad for privacy if a visitor could put my public e-mail address into a form/wizard, and then the next step "helpfully" autofills or asks to confirm data like the associated (real) name or (real) home address.
Alternately, someone could submit data with a correct phone number or e-mail address, but named "Turdy McPooperson" at "123 Ignore This Application Drive." Now the real user comes by, gets pissed when the system "greets" them with an insult, and anything they do get thrown in the trash by users who see it displayed under a combined profile named Turdy McPooperson.