3 ms·
Alternatively, text that is input to these services should be passed through a normalization process, i.e. use LLAMA to convert kanji to hiragana or a romanizat
by popalchemist 2y ago
Alternatively, text that is input to these services should be passed through a normalization process, i.e. use LLAMA to convert kanji to hiragana or a romanization. The TTS output is then much better.
- laurieg 2y agoUnfortunately, a simple normalization of kanji --> hiragana throws away pronunciation information.
- popalchemist 2y agoYou could just as easily use the LLM to convert the kanji into phonemes.
- xyzhg 2y agoYou can't lose word boundaries and phonemes don't tell you which part of the word is emphasized.
- popalchemist 2y agoModern TTS engines use tokenizers to convert words to phonemes. See: https://github.com/FunAudioLLM/CosyVoice/issues/202 https://github.com/FunAudioLLM/CosyVoice/issues/202