4 ms·
How the flying f*ck did they collect all the data for GPT-3?
by anewpersonality 4y ago
How the flying f*ck did they collect all the data for GPT-3?
- deleted 4y ago[deleted]
- tgv 4y agoThat work started back in the late 80s, early 90s, and people have been building and organizing corpora at an increasing scale. Cleaning a corpus is a hell of a lot of work. I guess they've been using older work to bootstrap that.
- IshKebab 4y agoScrape the web. Same way Google do it.
- kreetx 4y agoLooks like mostly scraped off the web https://en.wikipedia.org/wiki/GPT-3#Training_and_capabilities https://en.wikipedia.org/wiki/GPT-3#Training_and_capabilitie....