3 ms·
Maybe you'll have more success with this idea than I have (way too many other things in the way sadly): something that may be fairly nontrivial but very cool to
by exikyut 8y ago
Maybe you'll have more success with this idea than I have (way too many other things in the way sadly): something that may be fairly nontrivial but very cool to solve would be breaking words down into syllables, identifying the syllable boundaries in the speech (... xD), and then synchronizing the display on each syllable as it's presented.
How are you synchronizing to each word?
I wonder if Google would consider expanding their TTS a bit to provide syllable data and other rich breakdown information.
I like the waveform, btw.
- atrilumen 8y agoThanks :) I'm using Polly for the moment, and it provides word and viseme boundaries. Enough to animate face poses. I'm not taking full advantage of the visemes here: it's only affecting the saturation of the waveform color. Too subtle to notice, with the way things kind of flicker with this one. I have other ideas I want to play with, but don't really have time, and I may just have to drop that line of thinking, because I plan to move to one of the wavenet implementations, which don't provide speech marks data.