3 ms·
> Only post-retrieval filtering would be an option. And illegal, if the original information remains. I assume that there must be a process for altering the t
by bencollier49 5y ago
> Only post-retrieval filtering would be an option.
And illegal, if the original information remains.
I assume that there must be a process for altering the training data set and rerunning the entire thing.
- gmueckl 5y agoThe problem is that the information is in an opaque encoding that nobody can reverse engineer today. So it's impossible to prove that a certain subset of data has been removed from the model. Say, you have a model that repeats certain PII when prompted in a way that I figure out. I show you the prompt, you retrain the model to give a different, non-offensive answer. But now I go and alter the prompt and the same PII reappears. What now?
- computerex 5y agoYes, but the compute costs required for training are probably in the range of hundreds of thousands of usd to potentially millions of usd. Not to mention potentially months of training time.
- 6gvONxR4sf7o 5y agoGood thing “compliance is really expensive” isn’t a valid legal defense.