3 ms·
I don't think anyone has yet trained on all videos on the Internet. Plenty of petabytes left there to pretrain on, and likely just as useful once the text/audi
by benlivengood 1y ago
I don't think anyone has yet trained on all videos on the Internet. Plenty of petabytes left there to pretrain on, and likely just as useful once the text/audio/image pretraining is done.
- simianwords 1y agoIt might have been trained on a select high quality of videos, say more than 10k views and only trained on its transcripts.
- scrivna 1y agoSeems like reading a transcript of the commentary from a football game, it’s obviously missing a lot of information.