3 ms·
How tunable is the voice? I'm interested in applying TTS to a chat system, and one important feature for that is that there should be as many as possible disti
by dale_glass 3y ago
How tunable is the voice?
I'm interested in applying TTS to a chat system, and one important feature for that is that there should be as many as possible distinct voices, so that each person would have their own.
Would this, or something else be able to do that?
- jpcl 3y agoWe support voice cloning so you can mimic the sound of any real voice (or try to create random ones). The prosody/emotions are more difficult to control right now but we are looking into this. To check how this works in practice you can check the Google Collab link, at the end we are cloning the voice from a Churchill's speech over radio.
- dale_glass 3y agoSounds excellent! What are the requirements to run this regarding hardware? How much VRAM? Does it work on AMD or Intel Arc?
- jpcl 3y agoBoth models are using around 3GB right now (converted into FP16 for speed). But I checked that the (slower) FP32 version uses 2.3GB so we are probably doing something suboptimal here. We support CUDA right now although it should not be too hard to port it to whisper/llama.cpp or Apple's MLX. It's a pretty straightforward transformer architecture.
- genpfault 3y ago> applying TTS to a chat system John Madden![1] [1]: https://knowyourmeme.com/memes/moonbase-alpha-text-to-speech https://knowyourmeme.com/memes/moonbase-alpha-text-to-speech