2 ms·
OpenAI cannot give a definitive answer here, because it is genuinely unknowable if Buckmaster's data is in the training set. OpenAI explicitly uses user feedba
by tristanj 24d ago
OpenAI cannot give a definitive answer here, because it is genuinely unknowable if Buckmaster's data is in the training set.
OpenAI explicitly uses user feedback (the thumbs up or thumbs down ratings), as RLHF to train models. However, this feedback is anonymized and stripped of user identifiers. If Buckmaster ever used this feature, then that conversation would be anonymized, saved, and used for training, but not tied back to him.
They cannot issue a blanket denial (which people so desperately desire), and instead repeat that "it's very unlikely" (which pisses people off), because they cannot in good faith claim to have zero data at all.
- esnyder9 23d agoit would absolutely be knowable if Buckmaster's data is in the training set if he or Alpoge were to provide logs to OAI. the real tricky question would be: "to what extent does a year of work, put into Codex, towards an eventual proved forced blowup for the Euler equations go into training data and become an influence on agents told to attack NS?", and given that the first signal that OAI got to assign all firepower to NS rather than broadly spray all Millennium Prize + other high profile questions was a proven unforced blowup of the Euler equations after only 50 hours, I would say this extent seems likely to be decently high