3 ms·
We need the same with text to train Large Language Models
by janmo 3y ago
We need the same with text to train Large Language Models
- simonw 3y agoThat's pretty much what Red Pajama is: https://simonwillison.net/2023/Apr/17/redpajama-data/ https://simonwillison.net/2023/Apr/17/redpajama-data/
- circuit10 3y agohttps://pile.eleuther.ai/ https://pile.eleuther.ai/
- angrais 3y agoIt contains captions. That's the alt text. LAION is used for train LLMs.