3 ms·
Looks like a very nice introductory article. One warning is that implementing DP algorithms naively can lead to privacy violations. For example, the python code
by bo1024 9y ago
Looks like a very nice introductory article. One warning is that implementing DP algorithms naively can lead to privacy violations. For example, the python code in the article:
def laplace_mechanism(data, f, eps):
return f(data) + laplace(0, 1.0/eps)
This won't actually be private because floating-point numbers are different than real numbers. Real DP projects deal with this more carefully.
- maksimum 9y agoI've seen this limitation brought up before, but I don't have an intuitive understanding of when it would apply. Is the essential issue spacing between floats? The scenario I'm thinking in is each user's entry is a real number from U[1e15,1e15+1], and we want to output sum. The sensitivity is still 1. So the Laplace Mechanism outputs something like sum(DB)+laplace(0,1/eps), which will be exactly sum(DB) because laplace(0,1/eps) is smaller than the gap between floats >=1e15. For this to be an issue, the actual sum(DB) needs to be implemented in full precision right? Otherwise it seems like the sensitivity isn't necessarily 1.
- frankmcsherry 9y agohttp://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.366.5957 http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.366....
- rectang 9y ago> Real DP projects deal with this more carefully. It points to an ethical problem with how Differential Privacy is expected to be used. You have to get everything 100% right or the secrets in your dataset will eventually be compromised. As someone publishing works incorporating differential privacy techniques, do you have enough confidence in your implementation to risk those secrets? What level of consent is required from those who are impacted if your implementation fails?
- bo1024 9y agoNot sure if those questions are rhetorical -- I agree with them, and I'm on the theory side and don't write these implementations myself, and I share your concerns. But they also apply to crypto in general.