3 ms·
I'm a machine learning newbie, and I'd really like to speak with someone in the field to figure out what I'm wanting to learn. The problem I have is that I hav
by echelon 8y ago
I'm a machine learning newbie, and I'd really like to speak with someone in the field to figure out what I'm wanting to learn.
The problem I have is that I have a large labeled data set of spoken words and phonemes from a single speaker. I'd like to train a model and generate new phonemes (of various pitches, speeds, and intonations) with which to build a concatenative speech engine.
What algorithms and models would I be looking to use? What are the primary techniques? Is this something I could quickly begin to see results in, or would it take months or years of tweaking?
To clarify what I'm doing, I own/built trumped.com, and I'm trying to improve the speech synthesis quality by generating better fitting units of speech.
- probably_wrong 8y agoThe simplest way would be downloading something like MaryTTS [1], read the documentation, and train your own voice model. It won't be perfect, but shouldn't be too hard. The best results would probably be achieved by implementing DeepMind's WaveNet paper [2], but it might be too much for what you need. I'm not really sure what to suggest in between those two. Some kind of convolutional NN, I guess? [1] mary.dfki.de [2] arxiv.org/abs/1609.03499
- PeterisP 8y agoIf you've got a model that can generate new phonemes (of various pitches, speeds, and intonations), then you have a parametric speech synthesis engine and can use it directly as-is instead of strapping a concatenative engine on top. For the techniques, Wavenet and Tacotron (e.g. https://google.github.io/tacotron/publications/tacotron2/ https://google.github.io/tacotron/publications/tacotron2/) seem to be the state of art, but they are reportedly hard to replicate.