3 ms·

Looks interesting! Is the latency low enough for it to feel natural? How's the Coqui speech quality?

• lelag 2y ago
  It supports XTTSv2 which is currently the open-weight state of the art. So, pretty damn good (https://huggingface.co/coqui/XTTS-v2/blob/main/samples/en_sample.wav https://huggingface.co/coqui/XTTS-v2/blob/main/samples/en_sa...). Too bad that the project is in limbo after Coqui (the company) folded. The license limits the use of the weights to non-commercial usage unless you buy a commercial license, and there's nobody left to sell you one now.
  • qup 2y ago
    is there anyone to sue you? (how does that work?)
    • nmstoker 2y ago
      I don't know the details in this case, but it seems plausible that someone still owns the IP and thus might be in a position to initiate legal proceedings.
      • qup 2y ago
        That same person could update the license, no?
  • deleted 2y ago
    [deleted]
  • NikkiA 2y ago
    Honestly, I don't think that sounds as human as piper does, but that's probably a function of the voice model files more than anything, fe, en_US 'amy' sounds artificial, but hfc_female sounds more realistic on the Piper samples. https://rhasspy.github.io/piper-samples/ https://rhasspy.github.io/piper-samples/
• jsemrau 2y ago
  When I gave "Matt", my loyal local assistant[1], a voice xTTSv2 performed better for long form text. While in longform emotions seemed well balanced in the text, in short replies the emotion patterns frequently felt off and therefore unnatural. What I liked about xTTsv2 though is that voice cloning is fairly easy by just providing a .wav file with the intended voice pattern. [1]https://open.substack.com/pub/jdsemrau/p/teaching-your-agent-to-speak https://open.substack.com/pub/jdsemrau/p/teaching-your-agent...
  • pclmulqdq 2y ago
    xTTS is notoriously bad at generating short samples. It will also hallucinate if you give it something short enough.