9 ms·
What’s in the Pile training data they used? How much source code does it include?
by skybrian 4y ago
What’s in the Pile training data they used? How much source code does it include?
- sanxiyn 4y agohttps://arxiv.org/abs/2101.00027 https://arxiv.org/abs/2101.00027 is the paper and it includes 95.16 GiB from GitHub.