3 ms·
I feel like you. Relatively simple formant models gets "close enough" that it feels like you should be able to do well with very little. One of the things I've
by vidarh 3y ago
I feel like you. Relatively simple formant models gets "close enough" that it feels like you should be able to do well with very little.
One of the things I've long wanted to do but not found time for, is to take a few different variants of formant synths, and try to train a simple TTS model to control one instead of producing "raw" output. It's amazing what TTS models can do with "raw" output, but we know our brains aren't producing raw, unconstrained digital audio, and so I think there's a lot of potential to understanding more and simplifying if you train models constrained to produce outputs we know ought to be sufficient, and push their size as far down as we can.
- vidarh 3y agoToo late to edit, but to any one who needs "convincing" of the flexibility of a formant synthesizer, you should 1) play with Pink Trombone[1], a Javascript formant synthesizer with a UI that lets you graphically manipulate a vocal tract, and 2) have a look at this programmable version of it[2] [1] https://dood.al/pinktrombone/ https://dood.al/pinktrombone/ [2] https://github.com/zakaton/Pink-Trombone https://github.com/zakaton/Pink-Trombone
- follower 3y agoYeah, Pink Trombone is awesome[0]. :D Thanks for the link to the programmable version--I don't think I'd been aware of that previously... [0] And, from personal experience, also rather difficult to "safely" search for if you don't quite remember its name exactly. :D
- nuc1e0n 3y agoThat reminds me of Google's blob opera: https://artsandculture.google.com/experiment/AAHWrq360NcGbw https://artsandculture.google.com/experiment/AAHWrq360NcGbw
- drcongo 3y agoThanks for those links, that's superb. Sounds surprisingly like the "Oh long Johnson" cat - https://www.youtube.com/watch?v=kkwiQmGWK4c https://www.youtube.com/watch?v=kkwiQmGWK4c
- codedokode 3y agoWhat a fun toy! But I mostly get sounds of a drunk man who tries to say something but cannot.
- vidarh 3y agoCheck out the videos in the second link - it gives some better examples of what you can do with it.
- tapper 3y agoFunny that the Pink Trombone website does not work with screen readers.
- vidarh 3y agoIt's entirely visual in that it is a graphic of a vocal tract where you can move the tongue and shape the mouth, so in that form trying to make it do anything with screen readers would mean basically doing what the second link does, and create an API for it and hook the backend up to an entirely different UI. The videos on the other link does show that the guy who has done that API has done stuff to the UI to allow interfacing to it in non-graphical ways, but sadly I don't see any online demos of those alternative user interfaces anywhere, which is a great shame. Sadly it doesn't look like the videos are very accessible either, as they're mostly demos with no commentary about what is going on on the screen, without which they're mostly just random sounds.