Fundamentally, the large-scale collection of (often user generated) data to train models puts a more and more power into the hands of those doing the collection

Fundamentally, the large-scale collection of (often user generated) data to train models puts a more and more power into the hands of those doing the collection. Since giving away this data is mostly neither possible or desirable legally, nor in the interest of the dataset owner, there is a tradeoff between wanting to learn from data, and preserving privacy of the people generating/described by the data. That is not to say that science is not trying, like for example this paper: https://dl.acm.org/citation.cfm?id=2813687 https://dl.acm.org/citation.cfm?id=2813687