3 ms·
Hmm. Do you also need a way to "forget" things? Like - hmm. I could see taking a snapshot after the grammar/language stuff is in, and then every N weeks retrai
by RangerScience 4y ago
Hmm. Do you also need a way to "forget" things?
Like - hmm. I could see taking a snapshot after the grammar/language stuff is in, and then every N weeks retraining on the current web, adding in something about recentness, but that doesn't seem like "continuous" training.
I'd imagine "continuous" training would be, well, going on continuously, all the time, but that would mean that, to include "recentness", something would have to change with the weights that were from that "old" stuff, which sounds an awful lot like the human process of "forgetting".
- EGreg 4y agoWell, according to Europe's Right to Forget, these AIs have to forget some stuff about you if you ask them to :)
- edgyquant 4y agoYou have to delete the data sure, but what about the “memories” the model has via its weights?
- BlueTemplar 4y agoI have been asking myself this very question... it's easy to erase a paper adress book, not so much if your business has a non-human, like a parrot, who remembered that ! Note that this law is a problem for digital storage too : it's not easy to erase data (especially one stored in cold transistor storage) without physically destroying the storage medium. (I guess the law might get around this by having you "pinky promise" that you will not retrieve the "erased" data later... or else face much more dire legal consequences ??) I guess this will just need to be tested in courts ?