5 ms·
Yep, the idea of truth or falsity is not part of the design, and if it was part of the design, it would be a different and vastly (like, many orders of magnitud
by CommieBobDole 4y ago
Yep, the idea of truth or falsity is not part of the design, and if it was part of the design, it would be a different and vastly (like, many orders of magnitude) more complicated thing.
If, based on the training data, the most statistically likely series of words for a given prompt is the correct answer, it will give correct answers. Otherwise it will give incorrect answers. What it can never do is know the difference between the two.
- astrange 4y ago> If, based on the training data, the most statistically likely series of words for a given prompt is the correct answer, it will give correct answers. ChatGPT does not work this way. It wasn't trained to produce "statistically likely" output, it was trained for highly rated by humans output.
- mrtranscendence 4y agoNot exactly. ChatGPT was absolutely trained to produce statistically likely output, it just had an extra training step added for human ratings. If they relied entirely on human ratings there would not have been sufficient data to train the model.
- astrange 4y agoThe last step is what matters. "Statistically likely" is very underdetermined anyway, answering everything with "e" is statistically likely. (That's why original GPT3 is known for constantly ending up in infinite loops.)