6 ms·
I'm saddened to see someone gloating at having helped to prevent the release of a dataset that I see as beneficial. Netflix offered an unprecedented corpus for
by nkurz 17y ago
I'm saddened to see someone gloating at having helped to prevent the release of a dataset that I see as beneficial. Netflix offered an unprecedented corpus for research, and now someone is proud about helping the lawyers to lock it up. I think I just have a fundamentally different sense of privacy than the author. I think this comes out most clearly in their FAQ:
Furthermore, even if the algorithm finds the "wrong"
record, with high probability this record is very similar
to the right record, so it still tells us a lot about the
person we are looking for.
So the "violation of privacy" occurs even we don't actually reveal information about the individual, even if we only provide a framework for making predictions? So if I publish a study (with backing data) that says that 38 year old males are likely to commit adultery, I've "violated the privacy" of all 38 year old males?
Could someone who shares the author's worldview try to explain it? I've tried, but I just don't see it.
- randomwalker 17y ago'Gloating' is so diametrically opposed to the view expressed in the article that I have no idea how to respond. As for that part of the FAQ, it is intended as an explanation of some of the theorems proved in the paper and is a response to some of the theoretical objections we face from the data privacy community. It is not an issue that arises in practice.
- pbh 17y agoI think the parent is referring to an element of we-told-you-so in this letter. I think around the "instead, you brushed off our claims" part of the letter. It sounds a bit confrontational, though perhaps it's too late to rewrite.
- grandalf 17y agoIt sure makes the writers sound like asses.
- dasil003 17y agoThis is the part that did you in: Instead, you brushed off our claims, calling them “absolutely without merit,” among other things. Now even if you are all emotionless, 100% objective researchers with no interest other than the greater good, this very sentence will make it impossible for humans to read your letter without implying a certain level of snark. If you want to project pure motives for the letter then it would have been best to leave their reaction to your original research out of it, or, probably more appropriately, don't publish an open letter at all—contact them directly.
- madair 17y agoAh yes, Appeal to Motive, that'll do it, now I'm not going to accept anything they said because of my interpretation of their motives. http://en.wikipedia.org/wiki/Appeal_to_motive http://en.wikipedia.org/wiki/Appeal_to_motive
- dasil003 17y agoOpen letters are about politics, not logic. What an individual critical thinker such as yourself believes has no bearing.
- madair 17y agoOpen letters are about communicating a message, they are also by definition political, and it's really helpful to our social systems when they are based on logic. Analysis of motives is of course valuable. But it's not an argument against the matter at hand. It may not have been clear that I was being facetious.
- foldr 17y ago>now I'm not going to accept anything they said I don't think anyone is refusing to accept anything he says. They're just disapproving of his motives, which is fine.
- nkurz 17y agoIronically (and I think this is a legitimate use of the term) I hadn't realized when writing my comment that 'randomwalker' and 'Arvind Narayanan' were one and the same. But I apologize for my misinterpretation. I've read it again, though, and still have to fight the same reaction. Perhaps I'm just prejudiced against the 'open letter' format, as I often see it used in that way. Still, if you can overlook my misreading, I would love your response. I understand that the example from the FAQ is not central to your argument, but I do think it's important in understanding your worldview. If I provide a tool that can be used, erroneously or not, to create or enable prejudice, at what point have I crossed the line into 'violation of privacy'?
- randomwalker 17y agoI responded to most of the points in a new top-level comment. As for whether there is a violation of privacy even if the conclusions are erroneous, no, I don't think that it is. Some of my colleagues argue that it is, but I don't agree with that point of view. In other words, in order to convince you that there is a privacy problem I have to convince you of the math in the paper. Merely the fact that we came up with an algorithm that may or may not be correct is not sufficient. That FAQ question is a big red herring. Some of the objections to our paper during peer-review were along the lines of "if Netflix had esentially duplicated every record in the database, how could you be sure you found the right record? What does right record even mean?" No really, it was that silly. So it was meant to be a way to justify the fact that de-anonymization can happen even if you didn't find "the right record."
- earl 17y agoWell, I can say this: congrats on getting one of the best industrial data sets locked up. I hope you're proud of the work you did. As for the possibility of netflix running a contest like this in an online fashion, well, maybe, but the benefits of having access to the data are enormous, plus you've now moved to a model where only the privileged few are allowed access via NDA, or Netflix has to provide computing resources to all researchers, etc. I don't see it happening.
- pyre 17y agoIf Netflix had attached credit card info and social security numbers to the info would you be singing the same tune? You're basically saying that you don't like the outcome due to your perceived utility of the data. Thanks I don't see you talking about: - Do you view this as a breach of privacy? - What do you consider private? - Do you view this as a breach of privacy, but just don't care? - Do you feel that the utility of the data out-weighs the privacy concerns? - What about the people that view this as an invasion of privacy and have their Netflix user data in that set? Should they be thrown under the bus in the pursuit of progress because *you* feel that the data has more utility than the privacy concerns do? I see a lot of people arguing that this is 'stifling innovation,' but innovation is not an end unto itself. Banning using human test subjects against their will in the pursuit of scientific knowledge 'stifles innovation' too, but I think you would be hard-pressed to find many people to see that as a bad thing. "Stifling innovation" in the pursuit of privacy concerns should be a noble cause. It benefits the public. This is hardly the argument against intellectual property rights and I really find it annoying that people seem to be lumping it into the same ballpark with these boilerplate "stifling innovation" comments.
- Jun8 17y agoI see it as a breach of privacy people might have prevented had they known about the dangers of their reviews getting linked to their accounts. Many companies have their large credit card databases stolen or hacked into through sheer incompetence. Netflix is not in the same boat with these.
- whyenot 17y agoInstead, you brushed off our claims, calling them “absolutely without merit,” among other things. It has taken negative publicity and an FTC investigation to stop things from getting worse. Some may make the argument that even if the privacy of some of your customers is violated, the benefit to mankind outweighs it, but the “greater good” argument is a very dangerous one. And so here we are. In other words, "we showed them!" -- seem an awful lot like gloating to me. It also doesn't appear that you ever seriously considered the "greater good" argument, beyond asserting that it's "dangerous." This leaves me with the suspicion that you chose to take the easy way out instead of weighting the actual costs and benefits of what you were doing.
- orangecat 17y agoThis leaves me with the suspicion that you chose to take the easy way out instead of weighting the actual costs and benefits of what you were doing. You're shooting the messenger here. If a dataset can be de-anonymized, it's better to know that and be able to make informed decisions.
- raganwald 17y ago> Could someone who shares the author's worldview try to explain it? Well, I can give you my worldview. Did you see the article "70% of HR managers turn down job candidate based on online reputation?" Here's the HN discussion: http://news.ycombinator.com/item?id=1192996 http://news.ycombinator.com/item?id=1192996 So. I rent a bunch of movies with strongly opinionated themes. I dunno, maybe every Michael Moore movie plus travel documentaries about Cuba. I also rent the entire Star Wars sextilogy and The Godfather Trilogy, which I review on IMDB.com. Some enterprising hacker ties my reviews on IMDB to my anonymized rental record. How many 47 year-old males are there in my neighborhood who watched those exact movies? The hacker publishes his "findings," of course. Now I go looking for a job and someone in HR decides that my political views are too risky, so I don't even get an interview. The author's views are that Netflix can provide the benefits you desire without compromising the privacy I desire. I think the debate should be around whether the authors are correct. If the authors are correct, then the problem isn't the authors preventing the release, the problem is Netflix failing to learn from their prior mistake. If the authors are incorrect, we should simply point that out.
- Jun8 17y agoThe important point is that just renting out the movies isn't enough to reveal your identity, you also have to review them (anonymously) on IMDB or some such site. So the solution is simple: If you rent a movie that you would object to being listed in, e.g. your public Facebook profile just don't review it. Is this so hard?
- lt 17y agoThat's incorrect. His public Star Wars reviews linked him to the Michael Moore's rentals he wished to remain private.
- Jun8 17y agoYou're right. How about no public reviews on IMDB then? Or create another different users? I rent many movies from Netflix that people would find "objectionable", this is one reason I don't create any public reviews.
- imurray 17y agoI'm saddened to see someone gloating at having helped to prevent the release of a dataset that I see as beneficial. I'd encourage people that usually skim just the comments to read the post, which was not gloating at locking up the dataset. The thrust of the post is about what a shame it is that the contest was canceled and how to make sure future contests can work. [Note one: I have nothing to do with either side. Note two: I guess there is a gloating interpretation, with the paraphrase "you ignored us, but the FTC said we were right, nah nah nah" — but this isn't a useful or constructive way to continue the conversation.]
- lvvlvv 17y ago"you ignored us, but the FTC said we were right, nah nah nah" That how I read their open letter. And my interpretation of "you should have worked with us" is as "you should have hired us as consultants"
- gwern 17y ago> So if I publish a study (with backing data) that says that 38 year old males are likely to commit adultery, I've "violated the privacy" of all 38 year old males? Yes. The difference between 'John Elks of 7 Arborview is a rapist' and 'there is a 0.5 correlation between living in Pleasantville and being a rapist' or '38 year old males commit 10% more rapes than average' etc. is solely one of degree and not kind. Suppose I have a set of datapoints like that. And let's say each datapoint applies to only half the population. How many datapoints before I have broken your privacy and linked you to the furry porn you like to rent? Well, I'm guessing you're an American male. The US population is ~300 million, and roughly half of that is male, so 150 million. The first datapoint pins you down to within 75 million. The second, down to 33 million. The third, down to 16 million, the fourth, 8 million, the fifth 4 million, the sixth 2 million, the seventh 1 million, the eighth 500,000 (starting to feel nervous yet?), the ninth 250,000, the tenth 125,000, the eleventh 75,000, the twelfth 30k, etc. until the 25th or 26th specifies just 1 - you. Now, tell me: Where in this slippery slope did it suddenly flip from not being a privacy violation of some degree, to being a privacy violation? Was it at the 5th bit of information? Are you damaged at the 12th bit of information? Or did it take until the 24th or 25th bit of information before it magically flips from being good science to bad privacy violation? Is it fine just so long as it might also be your neighbor down the street, even though most people would shun you based on far less than a 50-50 chance of things like being a child rapist? (An employer on the bench might regard a 10% chance of you being objectionable as being too much; that only requires, what, 18 bits of information?) Predictions embody a great deal of information. That's how Bayesian statistics and statistics in general work, after all.
- tedunangst 17y agoI'm very curious about what bits of information you think exist that so precisely bisect the population.
- conover 17y agoThe Electronic Frontier Foundation does it to browsers pretty easily. http://panopticlick.eff.org/ http://panopticlick.eff.org/ And according to another article by them, all you need is zip code, gender and birthday to identify someone with a high degree of certainty. http://www.eff.org/deeplinks/2009/09/what-information-personally-identifiable http://www.eff.org/deeplinks/2009/09/what-information-person...
- madair 17y agoNetflix has a lot of subscribers, but it doesn't have that many, and in particular, in your neighborhood, does it have that many who are 38 year old males who like action movies and Michael Moore? It's a question partly of scale. It's big, but not that big that we can't get dangerous results with demographics & statistical analysis. It comes back to the contemporary problem of statistics: We, programmers included as evidenced by many discussions of the sort, have a hard time getting it. We are only at the cusp of understanding what statistics can do with large data sets. Now, we can either work with researchers and organizations to deal with the very real concerns, or we can simply refuse to believe that giraffes don't exist because we never saw an animal with such a long neck before. It's the basic problem of progress.
- deleted 17y ago[deleted]