3 ms·
How could that possibly work?
by p-e-w 4y ago
How could that possibly work?
- stewartmcgown 4y agoWell, they have all of the outputs of ChatGPT stored on their own servers. I suppose it wouldn't be out of the question to filter any future datasets they scrape against the outputs they have.
- bckr 4y agoKeep track of all embeddings ever emitted. While scraping, check all data against those embeddings. So, not like a watermark, which would be impossible.
- gojomo 4y agoA watermark is absolutely possible - see for example some of the work Scott Aaronson has mentioned doing for OpenAI. But: very fragile, especially if people are specifically trying to hide their GPT use, or have access to the watermarking algorithm or online oracle. And: other methods – like remembering all output ever, or fuzzy summary representations of all output ever – seem to me similarly fragile, & introduce other problems & impracticalities. A guess: OpenAI internally initially shared the common concern that "consuming its own junk outputs" could be a problem. But their own experiments so far, private & public, may have convinced them it's not as much of a problem in practice as it seems in theory. The model outputs have a mix of good and bad text – just like the pre-LLM internet. And, the same filterings/weightings that have worked on pre-LLM content keep working. And, counter to some early intuitions, often one LLM's quality output is in fact very-useful input for other later LLMs.
- pprotas 4y agoComputerphile has a video that explains it very well: https://youtu.be/XZJc1p6RE78 https://youtu.be/XZJc1p6RE78 (You can skip to the section “Verifying“)