4 ms·
Can audio of someone speaking be reliably turned into something like IPA by a computer though? (Very interested if that exists) My impression is that they're wo
by extraduder_ire 2y ago
Can audio of someone speaking be reliably turned into something like IPA by a computer though? (Very interested if that exists) My impression is that they're working with fewer elements and a lot more fuzziness about what they are.
I doubt we'll ever get a good writeup of exactly how this actually happens, but I'd really like to.
- lolinder 2y agoYou're correct, I'm using the IPA as a proxy for the audio data they actually use, but it's a decent proxy. I'd have linked spectrograms if I could find them, but in general sibilants come out very heavily in the audio data, so the complete absence of sibilance in "Trump" alone would make it extremely unlikely that the words would get mixed up. The fact that the words are substantially different in length would also come out in the audio data, as would all of the other features that I mentioned. If you were to create spectrograms for each word they would be completely distinct from each other to even a human eye across multiple dimensions. There's no good reason to claim that phonetics are the reason why their advanced statistical model connected the two words.
- benmmurphy 2y agoI guess it depends how much of this is running on the device, and how much is running off the device. If its all running on the device then it might be possible for someone to inspect what exactly is going on. If important parts are running off the device then those parts will be a black box.