4 ms·
The source links appear to no longer work. Do you know where we can download Japanese subtitles? I would love to attempt to segment a bunch of Japanese subtitl
by echelon 7y ago
The source links appear to no longer work. Do you know where we can download Japanese subtitles?
I would love to attempt to segment a bunch of Japanese subtitles into words and then do frequency analysis. My interest is in increasing my listening ability, so I want to put the most frequently spoken words into SRS/Anki, and perhaps even break it down by anime.
Alternatively, has anyone already done this?
- olsgaarddk 7y agoThat was my initial goal, but I had a lot of trouble with vanilla MeCab not understanding a lot of the text. But this was before neologd, so i think it would work better now. I don’t have the source code on me, but I scraped it from a website that publishes subtitles. The scraping was easy, the cleaning not, and I believe this spreadsheet is generated from my first attempt at cleaning. A lot of sources in Japanese nlp and linguistics have a bad habit of changing url often, so it bitrots easily. Sorry.