3 ms·
Applying DP to a simple computation like an average or median isn't that hard, what's more tricky is to ensure reasonable privacy guarantees when allowing unli
by ThePhysicist 6y ago
Applying DP to a simple computation like an average or median isn't that hard, what's more tricky is to ensure reasonable privacy guarantees when allowing unlimited interactive queries or large-scale sample generation from high-dimensional data:
You can apply DP to individual datapoints or attributes, but the amount of noise that you need to add to reach reasonable privacy guarantees is then quite high. Hence it makes more sense to add noise to the result of a computation, as the sensitivity of many practically relevant computations to individual datapoint values will often be small, hence the required amount of noise to mask the contribution of each individual datapoint will also be low. The problem is just that often a single datapoint can contribute to the result of many (sometimes nearly infinitely many) computations, and every DP computation result you return to a user (or adversary) will reduce you privacy budget. There are some approaches to remedy this problem, like adding "sticky noise" or remembering queries to ensure no averaging of noise is possible, but all of them have their drawbacks. Therefore we still see quite limited use of DP in interactive data analysis or machine learning, because it is quite hard to strictly ensure reasonable privacy guarantees in those cases.
Would be interesting to know if LeapYear has come up with something better, but they don't seem to have any source code or datasets available for public scrutiny.