I don’t see any source for that from their paper. It just says a duplicate version of Pile with a citation linking to the original Pile paper itself. [15] Leo

I don’t see any source for that from their paper. It just says a duplicate version of Pile with a citation linking to the original Pile paper itself. [15] Leo Gao, Stella Biderman, Sid Black, Laurence Golding, Travis Hoppe, Charles Foster, Jason Phang, Horace He, An-ish Thite, Noa Nabeshima, et al. The pile: An 800gb dataset of diverse text for language modeling. arXiv preprint arXiv:2101.00027, 2020.