3 ms·

The inability to train custom voices makes this useless for anything except generic TTS. Why do AI devs keep shooting their own projects in the foot? This tren

The inability to train custom voices makes this useless for anything except generic TTS. Why do AI devs keep shooting their own projects in the foot? This trend is upsetting me so much.

red75prime 3y ago
Probably because if they are seen as enablers of scams, they'll be shot by someone else.
- MitPitt 3y ago
  nobody is suing elevenlabs
  - red75prime 3y ago
    You don't need court order to be banned from GitHub. "L.3. GitHub May Terminate GitHub has the right to suspend or terminate your access to all or any part of the Website at any time, with or without cause, with or without notice, effective immediately. GitHub reserves the right to refuse service to anyone for any reason at any time."
echelon 3y ago
What are you talking about? It's MIT licensed.
- MitPitt 3y ago
  there is no training code and devs don't plan on ever releasing it
  - huggingmouth 3y ago
    It's only a matter of time.
  - woodson 3y ago
    It’s mostly there in https://github.com/lucidrains/audiolm-pytorch#hierarchical-transformers https://github.com/lucidrains/audiolm-pytorch#hierarchical-t.... They just used FAIRs EnCodec (https://github.com/facebookresearch/encodec https://github.com/facebookresearch/encodec) instead of soundstream.
  - dragonwriter 3y ago
    The voices aren’t the model; while the model takes cobventional training for which code is not provided, voices are, or at least can be, built by what could be described as “accumulated in-context learning”. Every time you run text with a voice (which can be null) through the inference process, the result is an audio waveform and an updated history prompt.
huggingmouth 3y ago
This is a fair point that should not have been downvoted. I was looking for yhe training code to train a voice for Arabic text after they removed the language from their list. Hopefully someone standard defuse this model so that we can train the models that others aren't willing to train.

The inability to train custom voices makes this useless for anything except generic TTS. Why do AI devs keep shooting their own projects in the foot? This trend is upsetting me so much.

red75prime 3y ago

Probably because if they are seen as enablers of scams, they'll be shot by someone else.

MitPitt 3y ago
nobody is suing elevenlabs
- red75prime 3y ago
  You don't need court order to be banned from GitHub. "L.3. GitHub May Terminate GitHub has the right to suspend or terminate your access to all or any part of the Website at any time, with or without cause, with or without notice, effective immediately. GitHub reserves the right to refuse service to anyone for any reason at any time."

echelon 3y ago

What are you talking about? It's MIT licensed.

MitPitt 3y ago
there is no training code and devs don't plan on ever releasing it
- huggingmouth 3y ago
  It's only a matter of time.
- woodson 3y ago
  It’s mostly there in https://github.com/lucidrains/audiolm-pytorch#hierarchical-transformers https://github.com/lucidrains/audiolm-pytorch#hierarchical-t.... They just used FAIRs EnCodec (https://github.com/facebookresearch/encodec https://github.com/facebookresearch/encodec) instead of soundstream.
- dragonwriter 3y ago
  The voices aren’t the model; while the model takes cobventional training for which code is not provided, voices are, or at least can be, built by what could be described as “accumulated in-context learning”. Every time you run text with a voice (which can be null) through the inference process, the result is an audio waveform and an updated history prompt.

huggingmouth 3y ago

This is a fair point that should not have been downvoted. I was looking for yhe training code to train a voice for Arabic text after they removed the language from their list. Hopefully someone standard defuse this model so that we can train the models that others aren't willing to train.