4 ms·
None of the GPT models rely on annotated or classified data. It's unsupervised.
by bpodgursky 4y ago
None of the GPT models rely on annotated or classified data. It's unsupervised.
- IanCal 4y agoThe final training steps of gpt 3.5 did, and we assume the same for 4. The RLHF step.
- whimsicalism 4y agoI would say semi-supervised, RLHF is not quite supervised learning. None of this data is from Reddit, Twitter, etc.