3 ms·
> well trained by humans Yes and no, the goal wasn’t focused on just being a source of truth. They wanted it to be able to write fairy tales, poetry, and song
by Retric 4y ago
> well trained by humans
Yes and no, the goal wasn’t focused on just being a source of truth. They wanted it to be able to write fairy tales, poetry, and song lyrics so creative answers where rewarded even if they weren’t factually accurate.
There was an attempt to reduce harmful and deceitful responses, but the team acknowledge the tendency for “plausible-sounding but incorrect or nonsensical answers” calling them hallucinations. Which becomes common when prompts are outside of it’s training set.
So yes there is definitely a link between the internal “Correctness” score and “Truth” but they are measuring very different things.