4 ms·
As with many ML-phrases, the use of 'unlearning' frames data modelling as a false dichotomy between 'learnable' and 'forgettable' data. Whereas humans are able
by dleeftink 3y ago
As with many ML-phrases, the use of 'unlearning' frames data modelling as a false dichotomy between 'learnable' and 'forgettable' data. Whereas humans are able to forget over time, it would be quite disturbing to block some memories from access entirely, how traumatic they might be (and quite apparent among people suffering memory loss).
While from a privacy perspective, not all 'data points' (i.e. memories) need be shared with the populace at large, to the individual they do constitute affective buildings blocks to deal with previous experiences. Similarly, the threshold for sharing (private) experiences depends on the communicative context one's in and how comfortable one feels sharing them.
Might similar mechanisms provide large models the ability to retain an internal recollection of 'traumatic' or 'problematic' data and become more attuned to the context its communicating in instead? Leaving blank spots or blocking out experience completely sets the stage for 'disturbing' a model's memory after the fact. While I don't want to draw a comparison between current NN architectures and organic ones, it is worth questioning our framing of currently emerging methods, as the incipient terminology can imbue how later practioners implement and think about these mechanisms.
- __loam 3y agoIt's just statistics guys. You either put the data in the training set or you don't.
- kxcrossing 3y agoWell, isn't this challenge about altering a model after-the-fact? I.e. we are stuck with this data in the training set and must figure out a way to clean up the model
- __loam 3y agoYeah you have to retrain it lol. Sorry about your $100 million model, shouldn't have used all that data indiscriminately.