4 ms·

Are there any decent TTS models that can be ran locally that plugs into existing software like SAPI without too much lag?

dvt 3y ago
Bark and Tortoise work fairly well. Bark does super fast inference[1] on my M1. [1] https://github.com/SaladTechnologies/bark https://github.com/SaladTechnologies/bark
- turnsout 3y ago
  @dvt Is this just a containerized version of Bark? Wondering if this repo has M1-specific improvements.
  - dvt 3y ago
    > Is this just a containerized version of Bark I think so.
    - turnsout 3y ago
      I'm finding M1 generation quite slow (CPU-only) on the stock Bark—any tips on speeding it up?
      - dvt 3y ago
        Sorry, haven't messed around too much with optimizations. I thought it was quite fast compared to Tortoise for example (where generation speed was at a 3:1 ratio).
modeless 3y ago
XTTS has a streaming mode with ~300ms latency and sounds good, though it has hallucination issues. StyleTTS2 sounds good and doesn't hallucinate as much. It doesn't support streaming but it's fast so it can still respond quickly. But neither of them sound as good as Eleven Labs or OpenAI or this one.
Nouser76 3y ago
I've used coqui.ai's TTS models[0] and library[1] to great success. I was able to get cloned voice to be rendered in about 80% of the audio clip length, and I believe you can also stream the response. Do note the model license for XTTS, it is one they wrote themselves that has some restrictions. [0] https://huggingface.co/coqui/XTTS-v2 https://huggingface.co/coqui/XTTS-v2 [1] https://github.com/coqui-ai/TTS https://github.com/coqui-ai/TTS