3 ms·
Really? Because the GPT-3 paper talks about "...two internet-based books corpora (Books1 and Books2)..." (see pages 8 and 9) - https://arxiv.org/pdf/2005.14165.
by belter 3y ago
Really? Because the GPT-3 paper talks about "...two internet-based books corpora
(Books1 and Books2)..." (see pages 8 and 9) - https://arxiv.org/pdf/2005.14165.pdf https://arxiv.org/pdf/2005.14165.pdf
Unclear what that corpora might be, or if its the same books2 you are referring to.
- simonw 3y agoMy guess is that this poster meant books3, not books2. books1 and books2 are OpenAI corpuses that have never (to my knowledge) had their content revealed. books3 is public, developed outside of OpenAI and we know exactly what's in it.
- devindotcom 3y agosorry, books3 is indeed what I meant.