3 ms·
I was wondering, wouldn't it be possible to classify the voice of every celebrity based on moods so one could make the voices less monotonic? So one could then
by mattigames 6y ago
I was wondering, wouldn't it be possible to classify the voice of every celebrity based on moods so one could make the voices less monotonic? So one could then add text metadata for the text-to-speech conversion, e.g. "[Angry] I have a dream, [Calm] but it has a patent so you can't copy it! (laughter) [Calm-fade-to-angry] In reality insomnia took it from me!"
- echelon 6y agoAbsolutely. These are called "style tokens" and they're an active area of TTS research. The problem is that currently your training data has to be annotated with these tokens, and that adds a lot to the difficulty of creating data sets. I imagine that over time this will get much easier to do.
- mywittyname 6y agoAre there good emotion detectors for speech-to-text? Much like they have for facial recognition?
- echelon 6y agoI'm not aware of any, and I haven't had much time to look as I'm not to the point of doing style tokens yet. I'm certain this would be useful for annotating data and for all sorts of other applications. Sentiment analysis, etc.