3 ms·
> One last thing. The Pile would’ve been far less relevant without the wonderful assistance of The Eye, a group of people who archive all kinds of things. They’
by archivist0 3y ago
> One last thing. The Pile would’ve been far less relevant without the wonderful assistance of The Eye, a group of people who archive all kinds of things. They’ve hosted the datasets for years now. And although it seems strange to say that dataset hosting could make or break The Pile, back then there was nobody else willing to host us. https://the-eye.eu/ https://the-eye.eu/
I'm afraid to say... the-eye no longer hosts the pile as of today due to legal threats above the likes of DMCA.
Though I believe it's still available via its original torrent and on at.
> https://academictorrents.com/details/0d366035664fdf51cfbe9f733953ba325776e667 https://academictorrents.com/details/0d366035664fdf51cfbe9f7...
- sfriedr 3y agoOf this is true, it would be something close of an insane situation: One of the largest datasets, that the largest companies are using to train their models (probably; many of the best LLMs have technical reports that raise more questions rather than answer them) being forced to live an obscure existance on torrents. From a scientific point of view this is very problematic because few safeguards exist that guarantee that the dataset is not tampered with (as is the case if you'd upload it to Zenodo, which providea some guarantee of immutability). How about trying to upload the Pile to Zenodo? Only half-joking :D
- koheripbal 3y agoI'm more interested in The Pile V2 which seems to have gone underground...