3 ms·
Not exactly. ChatGPT was absolutely trained to produce statistically likely output, it just had an extra training step added for human ratings. If they relied e
by mrtranscendence 4y ago
Not exactly. ChatGPT was absolutely trained to produce statistically likely output, it just had an extra training step added for human ratings. If they relied entirely on human ratings there would not have been sufficient data to train the model.
- astrange 4y agoThe last step is what matters. "Statistically likely" is very underdetermined anyway, answering everything with "e" is statistically likely. (That's why original GPT3 is known for constantly ending up in infinite loops.)