3 ms·
Really nice! I'm also currently playing around a lot with automatically generated videos and I can see this having a lot of potential! Some questions that come
by zukerpie 3y ago
Really nice! I'm also currently playing around a lot with automatically generated videos and I can see this having a lot of potential! Some questions that come to my mind:
1. Do you plan including AWS Polly in the speech generation? There is also a free tier, the API is nice so it might be also a good choice for people using AWS SDK already in their projects.
2. How do you approach aligning the words with animations? Is it possible to align it for a specific word? I was wondering how one might approach this. Did you already describe it somewhere?
- hosolmaz 3y ago> Do you plan including AWS Polly in the speech generation? I wasn't, but it's not that hard to integrate a new TTS service. You can copy e.g. AzureService and adapt it to work with AWS: https://voiceover.manim.community/en/stable/services.html https://voiceover.manim.community/en/stable/services.html > How do you approach aligning the words with animations? Is it possible to align it for a specific word? Indeed, the feature is called "bookmarks". You can see a demo here: https://voiceover.manim.community/en/stable/quickstart.html#bookmarks https://voiceover.manim.community/en/stable/quickstart.html#... > Did you already describe it somewhere? I did not do a detailed write-up yet, but you can search the repo for "word_boundaries" and "TimeInterpolator". Services like Azure return timestamps for the beginning of each word, and for those that don't return, I integrated Whisper to generate them from the audio. Then, it's a matter of mapping the string indices to audio time via some sort of interpolation (I used linear).
- zukerpie 3y agoThanks for the answers!