3 ms·
One of the big values of reddit is that it serves as an easy index for non-garbage websites on the internet. This is exactly how it was used in the T5 paper: th
by dontreact 3y ago
One of the big values of reddit is that it serves as an easy index for non-garbage websites on the internet. This is exactly how it was used in the T5 paper: they threw away all the websites from their crawl that were not linked to from Reddit.
- dontreact 3y agoAnd by garbage I mean literally data/illegible/etc. that would ruin the pretraining of the model.