3 ms·
OpenAI at least can track the hashes of all content it's ever output, and filter that content out of future training data. Of course they won't be able to do th
by chatmasta 4y ago
OpenAI at least can track the hashes of all content it's ever output, and filter that content out of future training data. Of course they won't be able to do this for the output of other LLMs, but maybe we'll see something like a federated bloom index or something.
Agreed there is no perfect solution though, and it will definitely be a problem finding high quality training data in the future.