2 ms·
>Moreover, the developers of these tools are aware of the potential pitfalls of producing exact replicas of art in their training datasets. OpenAI admitted that
by whywhywhywhy 4y ago
>Moreover, the developers of these tools are aware of the potential pitfalls of producing exact replicas of art in their training datasets. OpenAI admitted that this was a problem in some of the earlier iterations of the program, and they now filter out specific instances of this happening.
This is the most telling thing. They have a system, which might not even be part of the "AI" it might simply be they are comparing outputs for close matches to the OG dataset and then hiding them from the end user.
I mean we've seen OpenAI's solution to their un-diverse data set so we know what standards they work to.
- kxq 4y agothey addressed duplicates during pre-training (by removing duplicate examples in the dataset), as documented here https://openai.com/blog/dall-e-2-pre-training-mitigations/ https://openai.com/blog/dall-e-2-pre-training-mitigations/