4 ms·
Hard time? What value does adult videos description, views and comments add to small (7,32B) models?
by Oras 11mo ago
Hard time? What value does adult videos description, views and comments add to small (7,32B) models?
- andy99 11mo agoIt says it’s common crawl, I interpret it to mean this is a generic web scrape dataset, presumably they filter stuff out they don’t want before pretraining. You’d have to do do some ablation testing to know what value it adds
- ccgreg 11mo agoCommon Crawl is a particular dataset. commoncrawl.org
- khimaros 11mo agowhat if that's where they learned how to utilize the double entendre? hard times indeed.