4 ms·

The docs say it's usually 1-4 hours depending on the book and the hardware: https://smoores.gitlab.io/storyteller/docs/syncing-books https://smoores.gitlab.io/s

The docs say it's usually 1-4 hours depending on the book and the hardware: https://smoores.gitlab.io/storyteller/docs/syncing-books https://smoores.gitlab.io/storyteller/docs/syncing-books The docs also have a detailed section about the algorithm that goes into how it auto-handles differences between the audio and the text.

cyberax 3y ago
One obvious optimization is to sample the audio file at regular intervals and transcribe only a part of the text. Then just interpolate the locations. This can speed it up by a couple of orders of magnitude.
- smoores 3y ago
  This is true, but it really limits the ability to highlight the current sentence visually while it's being read, which is great for language learning and for reducing cognitive load. I actually spent a lot of time trying to get the timing as precise as I could to make this feel as natural as possible, and I think the effect is really nice!
  - cyberax 3y ago
    Ah, makes sense. Maybe have it as an option? And I haven't realized that you can actually see sentences highlighted as they are being read. I'd love that for Chinese (I'm learning it, so it'd help me a lot). I'll try and see if it "just works", and contribute a patch if it doesn't.
    - smoores 3y ago
      There's an open ticket for languages other than English! https://gitlab.com/smoores/storyteller/-/issues/10 https://gitlab.com/smoores/storyteller/-/issues/10. If you want to take a look, please do! I don't have any contributing guidelines yet, unfortunately, but they'll probably come soon. I think Whisper does have Cantonese and Mandarin support, so it should be possible to add support for those languages, though we'll have to look into nltk support for sentence tokenization as well!
    - yorwba 3y ago
      A few years ago, I made that as a YouTube channel based on LibriVox audiobooks, maybe you'll enjoy it: Simplified Mandarin: https://youtube.com/playlist?list=PLVlVz7EDz7fprPeVpqQCvlkMIUE0eDtUS https://youtube.com/playlist?list=PLVlVz7EDz7fprPeVpqQCvlkMI... Traditional Mandarin: https://youtube.com/playlist?list=PLVlVz7EDz7fpQZr29P5hqVveL6aCGFJLW https://youtube.com/playlist?list=PLVlVz7EDz7fpQZr29P5hqVveL... ... also 33 other languages https://youtube.com/@literature_for_eyes_and_ears/playlists https://youtube.com/@literature_for_eyes_and_ears/playlists I left it to languish once I discovered the demand wasn't that great and I was spending more time making the videos than people ultimately spent watching them.

cyberax 3y ago

One obvious optimization is to sample the audio file at regular intervals and transcribe only a part of the text. Then just interpolate the locations. This can speed it up by a couple of orders of magnitude.

smoores 3y ago
This is true, but it really limits the ability to highlight the current sentence visually while it's being read, which is great for language learning and for reducing cognitive load. I actually spent a lot of time trying to get the timing as precise as I could to make this feel as natural as possible, and I think the effect is really nice!
- cyberax 3y ago
  Ah, makes sense. Maybe have it as an option? And I haven't realized that you can actually see sentences highlighted as they are being read. I'd love that for Chinese (I'm learning it, so it'd help me a lot). I'll try and see if it "just works", and contribute a patch if it doesn't.
  - smoores 3y ago
    There's an open ticket for languages other than English! https://gitlab.com/smoores/storyteller/-/issues/10 https://gitlab.com/smoores/storyteller/-/issues/10. If you want to take a look, please do! I don't have any contributing guidelines yet, unfortunately, but they'll probably come soon. I think Whisper does have Cantonese and Mandarin support, so it should be possible to add support for those languages, though we'll have to look into nltk support for sentence tokenization as well!
  - yorwba 3y ago
    A few years ago, I made that as a YouTube channel based on LibriVox audiobooks, maybe you'll enjoy it: Simplified Mandarin: https://youtube.com/playlist?list=PLVlVz7EDz7fprPeVpqQCvlkMIUE0eDtUS https://youtube.com/playlist?list=PLVlVz7EDz7fprPeVpqQCvlkMI... Traditional Mandarin: https://youtube.com/playlist?list=PLVlVz7EDz7fpQZr29P5hqVveL6aCGFJLW https://youtube.com/playlist?list=PLVlVz7EDz7fpQZr29P5hqVveL... ... also 33 other languages https://youtube.com/@literature_for_eyes_and_ears/playlists https://youtube.com/@literature_for_eyes_and_ears/playlists I left it to languish once I discovered the demand wasn't that great and I was spending more time making the videos than people ultimately spent watching them.