2 ms·
GPT-3 training data was 'actively engaged', it just wasn't supervised (labelled by hand).
by visarga 6y ago
GPT-3 training data was 'actively engaged', it just wasn't supervised (labelled by hand).
- wrinkl3 6y agoI have no clue what "actively engaged" data actually means, since the author doesn't provide any links to the studies asserting its superiority. GPT-3 was trained on 45TB of text, little of which was written with AI training in mind.