3 ms·
Is it hallucinating (whether that be through sheer chance, or trained to think it is GPT), or is it pointing at the wrong place? https://imgur.com/a/YOF6szw htt
by pityJuke 3y ago
Is it hallucinating (whether that be through sheer chance, or trained to think it is GPT), or is it pointing at the wrong place? https://imgur.com/a/YOF6szw https://imgur.com/a/YOF6szw or https://imgur.com/a/fkgkfRO https://imgur.com/a/fkgkfRO
- zwily 3y agoProbably just trained on lots of GPT-4 output.
- moffkalast 3y agoApparently trained on lots of refusals too, speaks to the high competence of whoever was setting up the dataset. It's one string regex to filter them out and get more performance for fucks sake.
- pityJuke 3y agoOh, right, I remember hearing that was a technique to train LLMs. Interesting that it impacts it in such a way.