3 ms·

It will be more useful if it can narrate text along with those background effects.

• simonw 4y ago
  You can already achieve that by combining models - use a dedicated speech synthesis model for the narration, then layer that over background effects from AudioGen. Given that, I don't think AudioGen particularly needs to add full narration. That seems like a very different problem to me, likely requiring a completely different architecture.
  • godmode2019 4y ago
    What is the current state of the art speech synthesis model?
    • ricopags 4y ago
      It was Nvidia's Tacotron2[0] but now I believe it's NaturalSpeech[1] [0]https://paperswithcode.com/method/tacotron-2 https://paperswithcode.com/method/tacotron-2 [1]https://speechresearch.github.io/naturalspeech/ https://speechresearch.github.io/naturalspeech/
      • godmode2019 4y ago
        Thank you