3 ms·

Author here: We were blown away too. This project started with a question in our minds about whether it was even possible for the stable diffusion model archite

by seth_ 4y ago

Author here: We were blown away too. This project started with a question in our minds about whether it was even possible for the stable diffusion model architecture to output something with the level of fidelity needed for the resulting audio to sound reasonable.

Dracophoenix 4y ago
Any chance of spoken voice-work being possible? It would be interesting to see if a model could "speak" like James Earl Jones or Steve Blum.
- utopcell 4y ago
  This already exists [1]. [1] https://www.respeecher.com/ https://www.respeecher.com/
  - dannyw 4y ago
    Are there any open source models with good quality? I had a look around several months ago, and it seems like everything is locked behind SaaS APIs.
- echelon 4y ago
  James Earl Jones: https://fakeyou.com/tts/result/TR:9ek4x6eb80kq49e94grnhctk4gmcg https://fakeyou.com/tts/result/TR:9ek4x6eb80kq49e94grnhctk4g... Steve Blum: https://fakeyou.com/tts/result/TR:xmjjq9ty0hnsyjrjnw806k6rnpzwf https://fakeyou.com/tts/result/TR:xmjjq9ty0hnsyjrjnw806k6rnp... Furiously working on voice-to-voice (web, real time, and singing!) Should be out the door tomorrow!
  - pardon_me 4y ago
    Excellent work! Singing would be amazing - karaoke can finally sound good :p Have you released a tool for volumetric capture? I'm applying this to LED lighting fixture setup for tv/film/live shows and 3D positioning is the last step to fully automated configuration. My goal is real-time sync between 3D model and real world.
  - moffkalast 4y ago
    Be careful not to choke on your aspirations :P
- RugnirViking 4y ago
  have a look at UberDuck, they do something like this