3 ms·
Possibly weird question, but have there been any attempts at modeling this sort audio model specifically where tokens aren't defined by its audio, but instead b
by chaps 4y ago
Possibly weird question, but have there been any attempts at modeling this sort audio model specifically where tokens aren't defined by its audio, but instead by the movement of the tongue/mouth/lips/vocal chords, etc?
- danuker 4y agoI would assume the Transformer model would do that implicitly. The point of machine learning is to avoid expensive hand-crafted features. That said, you can find research of almost anything. See page 36 here (46th in the PDF): https://publications.rwth-aachen.de/record/59935/files/Kob_Malte.pdf https://publications.rwth-aachen.de/record/59935/files/Kob_M...
- chaps 4y agoGood point. Wondering now if there'd be a way to walk backwards from the modeled audio to a full physics simulation of the spoken words. Thanks for the link!
- KRAKRISMOTT 4y agoThe keywords you are looking for: articulatory synthesis
- chaps 4y agoThanks!
- saint_yossarian 4y agoNot what you meant, but there's https://dood.al/pinktrombone/ https://dood.al/pinktrombone/