3 ms·If I understand it right OpenAI trained a chatbot critic and then trained it against the critic.by sharemywin 4y agoIf I understand it right OpenAI trained a chatbot critic and then trained it against the critic.