3 ms·
It's not designed to generate plausible sounding text, it's designed to produce text that is statistically likely to be sound. It's a markov chain, but there mi
by eptcyka 4y ago
It's not designed to generate plausible sounding text, it's designed to produce text that is statistically likely to be sound. It's a markov chain, but there might be multiple roots and some backpropped probabilities for which leafs should be picked. The statistical significance doesn't have to track with logic.
- stingraycharles 4y agoSo what you’re saying is that they not just trained it on text, but also verified the answers and trained it in such a way that it would get a negative feedback if the model gave the wrong answer?
- pwinnski 4y agoIt got negative feedback if the model gave wrong-sounding answers, which is not the same as wrong answers. I have seen no indication that they had anybody verify the factual content of answers in the training process, and many indications that they did not.