10 ms·
It would be neat of there could be defined curated chunks of standardize text data sets for LLMs training distributed over bittorrent. Maybe there already is a
by alchemist1e9 4y ago
It would be neat of there could be defined curated chunks of standardize text data sets for LLMs training distributed over bittorrent.
Maybe there already is and I just haven’t looked hard enough.
- kangalioo 4y ago> The Pile is a 825 GiB diverse, open source language modelling data set that consists of 22 smaller, high-quality datasets combined together. https://pile.eleuther.ai/ https://pile.eleuther.ai/