3 ms·
That's not a full dump of subtitles, but rather of list of which subtitles they have, with download links. Here are the first lines of the `subtitles_all.txt` f
by red_trumpet 3y ago
That's not a full dump of subtitles, but rather of list of which subtitles they have, with download links. Here are the first lines of the `subtitles_all.txt` file:
IDSubtitle MovieName MovieYear LanguageName ISO639 SubAddDate ImdbID SubFormat SubSumCD MovieReleaseName MovieFPS SeriesSeason SeriesEpisode SeriesIMDBParent MovieKind URL
1 Alien3 1992 English en 2004-10-31 23:54:23 103644 sub 2 Alien.3 11.000 0 0 0 movie http://www.opensubtitles.org/subtitles/1/alien3-en
2 Identity 2003 Slovenian sl 2004-10-31 23:54:23 309698 sub 1 Identity.DVDRiP.XViD 0.000 0 0 0 movie http://www.opensubtitles.org/subtitles/2/identity-sl
3 Ghost in the Shell 2: Innocence 2004 English en 2004-10-31 23:54:23 347246 srt 1 Innocence.2004.DVDRip.XviD 23.980 0 0 0 movie http://www.opensubtitles.org/subtitles/3/ghost-in-the-shell-2-innocence-en
- fundatus 3y agoYeah, I was wondering if that could be the full dump. I know how far compression algorithms have come, but 318MB for all the subtitles of the world? Would be interesting to know though how large a full dump would be.
- jck 3y agoMy guess is not by much. Text doesn't require a lot of storage. After looking at a few random files my estimate is that the size of the full compressed dump would be about 30x (~10 GB)
- adt 3y agoEleutherAI cleaned an OpenSubtitles dataset that was 12.98GiB (13.9GB). https://arxiv.org/abs/2101.00027 https://arxiv.org/abs/2101.00027 https://lifearchitect.ai/whats-in-my-ai/ https://lifearchitect.ai/whats-in-my-ai/