3 ms·
That is categorically false, the model does hallucinate but it absolutely expresses uncertainty about things.
by soulofmischief 4y ago
That is categorically false, the model does hallucinate but it absolutely expresses uncertainty about things.
- withinboredom 4y agoIt does for certain things, but when I was guiding it to create a very complex regex, it would totally "forget" or "ignore" random constraints and give the wrong regex repeatedly. It was pretty fun, even if I never got a correct regex. I had to hand craft it. So much for AI making things faster.
- soulofmischief 4y agoGitHub Copilot has increased my development speed by at least 10%. That's an insane margin for $10 a month.
- actionfromafar 4y agoSpeed yes, but how did it change your direction?
- soulofmischief 4y agoIt sent me on a crash course for success. ;)
- hooby 4y agoIs there a relation between the model expressing certainty or uncertainty and the likelihood of the statement being a hallucination?
- soulofmischief 4y agoYes, and if you poke around the OpenAI playground you will see they've trained models to be more transparent about uncertainty, opting for a non-answer instead of a hallucination much more often.