3 ms·
> Albeit unethical and embarrassing. I really don’t understand this angle. In fact, I am fairly positive that the training set for GPT-4 contains many thousand
by kweingar 4y ago
> Albeit unethical and embarrassing.
I really don’t understand this angle. In fact, I am fairly positive that the training set for GPT-4 contains many thousands of conversations with AI agents not developed by OpenAI.
Do AI companies need to manually sift through the corpus and scrub webpages that contain competitor LLM output?
(“Yes” is an acceptable answer to this, but then it applies to OpenAI’s currently existing models just as much as to Bard)
- j_maffe 4y agoHow did you come about being "fairly positive" that GPT-4 is trained on other AI conversations?
- TremendousJudge 4y agoMany AI conversations have been floating around internet forums since the original GPT was released. As OpenAI hasn't shared anything about its training set, to err on the side of caution I would assume that they didn't filter these conversations out. If they aren't even marked as such, it may not even be possible to do. I think it would be very hard to prove that no AI conversations are included in the training set, even if it wasn't secret.