3 ms·
“Not that difficult”? Can you elaborate? Because I think it’s nearly insurmountable. Is the sentence “Meagan Smith graduated magma cum laude from Northwestern
by brookst 4y ago
“Not that difficult”?
Can you elaborate? Because I think it’s nearly insurmountable.
Is the sentence “Meagan Smith graduated magma cum laude from Northwestern’s business program in 2004” PII? How about if another part of the corpus says “M. Smith had a promising career in business after graduating with honors from a prestigious school, but an unplanned pregnancy caused her to quit her job in 2006”?
Does it matter if it’s from fiction? What if the fiction it comes from uses real people? Or if there might be both real and fictional Meagan Smiths?
And how so you process that kind of thing at the scale of billions of documents?
This is a very hard problem, especially at scale.
- raverbashing 4y agoWhere are you scraping this data from? This is the main question > “M. Smith had a promising career in business after graduating with honors from a prestigious school, but an unplanned pregnancy caused her to quit her job in 2006” The main issue is how that statement ended up there in the first place. Even then how many "M. Smith" have studied in prestigious schools? By itself that phrase wouldn't be PII Now if you have a db entry with "M Smith" and entries for biographical data that's definitely PII