5 ms·
Here in the UK, date of birth and post code is enough to identify something like 95% of people. Anonymised data sets are not really possible once you have more
by LatteLazy 6y ago
Here in the UK, date of birth and post code is enough to identify something like 95% of people. Anonymised data sets are not really possible once you have more than a few varriables. Most people don't know this.
- MattGaiser 6y agoIsn’t a postal code about 50-100 houses? It really narrows things down. That particular variable really reduces things.
- laurent123456 6y agoOn average it's about 15 houses, so postcode + date of birth is indeed around 95% accurate.
- deleted 6y ago[deleted]
- White_Wolf 6y ago50-100 houses is not that much. You can find someone in those 100 houses with 1 DOB and post code. Maybe in very crowded areas you'll need one more var. Worst case scenario you'll end up with 2-3 people.
- godelski 6y agoThat's a bit insane. I looked up US numbers to check and got around 8k/zip code[0] [0] https://www.zip-codes.com/zip-code-statistics.asp https://www.zip-codes.com/zip-code-statistics.asp
- patrickmcnamara 6y agoIn Ireland, we use Eircode with one house per postcode. This is very handy because you don't need to type in your full address on a lot of websites, just the Eircode. The first three digits of an Eircode are more like a traditional postcode in that they indicate your area/town but the next four are randomised for each address.
- hanniabu 6y agoMan, that sounds so convenient. I kind of wish everywhere had that minus the privacy factors
- 082349872349872 6y agoThat must be what ZIP+4 is for.
- LatteLazy 6y agoThere are 2 reasons postcode matters. First, postcode is something you give out pretty willingly. If you put your postcode and dob into an insurance quote website, they would no longer be insuring based on a pool of people like you. They'd literally just see how many claims you had. And also what ethnicity and sexuality and 50 other personal, irrelevant criteria they want. The second is that postcode is only a narrow or broad measure depending on what you're using it for. If you want to do a study on asthma rates vs road traffic, postcode is just right, anything more general and you're comparing side streets and motorways. So it makes sense for that data to be available. But wait, as the data user, I only need one more data set (say voter registration, already available) and I can literally look up you're medical history before deciding whether to hire you. This is the issue here: data HAS to be specific to be useful. But ifs its specific its dangerous. AND data is much more specific than you realise because a few innocent sounding data points are unique to you when combined.
- nly 6y agoWhen you consider the birthday paradox, and consider demographics, it probably doesn't. If you assume that DOB's are evenly and randomly distributed over the last 100 years (1 of ~36500 values) then the probability of none of 100 people sharing a DOB is only ~87%. If you tuned for demographics the true stats would be much worse. That said, you probably have anti-clustering aspects - parents obviously can't share birth dates with their children, and siblings can't either (unless twins). But! couples tend to be of a similar age...so, tricky.
- Polylactic_acid 6y agoMy local area published "Anonymised" datasets of public transport usage but they gave everyone a unique ID. It was found that if you knew 2 trips the person took you could uniquely identify the person in the dataset and see all of their trips.
- mulmen 6y agoHow does that work? If a friend of mine and I both took the bus to a movie and returned to our start how do you differentiate between us? Seems like this would come up a lot with commuters.
- Polylactic_acid 6y agoOf course that case will fail but for almost all cases if you know something like that you took x bus to work and then a week later you took one to the mall its now possible to find all of their trips. For someone you know somewhat well its not hard to find 2 trips they took and then be able to find all of their trips.
- mulmen 6y agoOk, so two trips but not any two trips. It requires a lot more knowledge of the person. For someone you know well why would you even need to look at the data?
- Polylactic_acid 6y agoIts almost any two trips. Its the exception that two people take the same trip together. I can think of a handful of people I could eventually find 2 trips for who wouldn't want me to have their entire travelling history.
- harrisi 6y agoOne could trivially establish multiple trips that anyone with even slightly public social media has taken.
- SquareWheel 6y agoIn this case, proper anonymization would require unlinking those two variables then. It isn't impossible to anonymize data. It's just hard to do it right.