4 ms·
Would it be possible to use Reinforcement Learning + Speech Recognition to turn this thing into a real voice synthesizer?
by smlacy 8y ago
Would it be possible to use Reinforcement Learning + Speech Recognition to turn this thing into a real voice synthesizer?
- jterwill 8y agoI wonder if this sort of model would lend itself well to program induction similar to this paper: https://web.mit.edu/cocosci/Papers/Science-2015-Lake-1332-8.pdf https://web.mit.edu/cocosci/Papers/Science-2015-Lake-1332-8.... Having a mouth seems like it would enforce a strong inductive bias.
- hannasanarion 8y agoNo need. This thing is already a voice synthesizer. This is how modern synthesizers work, more or less: by generating a sine wave and then modifying it in the same way as the vocal tract does.
- smlacy 8y agoI meant "text to speech engine" then I guess.
- hannasanarion 8y agoYeah, I know what you meant. You use a tool like the CMU pronunciation dictionary[1] to turn words into phonemes, and then you use a model similar to the pink trombone to turn the phoneme string into sound, including the transitions between different phones (which, it turns out, actually matter more than the phones themselves for making it understandable). This is how TTS works. 1 http://www.speech.cs.cmu.edu/cgi-bin/cmudict http://www.speech.cs.cmu.edu/cgi-bin/cmudict
- smlacy 8y agoGreat man-splaining of how synthesis works. Pink Trombone has no phoneme mapping, you'd have to code all that by hand, and that's exactly what my original question was.
- dreamcompiler 8y agoNot a sine wave. The vocal tract is subtractive; the larynx has to generate a waveform with lots of harmonics some of which the vocal tract can then remove.