2 ms·
Probably just trained on lots of GPT-4 output.
by zwily 3y ago
Probably just trained on lots of GPT-4 output.
- moffkalast 3y agoApparently trained on lots of refusals too, speaks to the high competence of whoever was setting up the dataset. It's one string regex to filter them out and get more performance for fucks sake.
- pityJuke 3y agoOh, right, I remember hearing that was a technique to train LLMs. Interesting that it impacts it in such a way.