3 ms·
The guy who solved voice recognition at Google years ago told me that after looking at enough spectrograms with human speech he could tell exactly what was bein
by dekhn 4y ago
The guy who solved voice recognition at Google years ago told me that after looking at enough spectrograms with human speech he could tell exactly what was being said. "Oh, that shape- it's an 'ooo' noise."
Armed with that knowledge I started looking at more spectrograms of birds (I record birds around my house and pass through bird.net's model. Amusingly, I kind of learned eveyrthing in this article just by looking at lots of spectrograms- they are far, far easier for me to parse than any other musical representation.
I just found 'demucs' and am really enjoying doing source separation and then looking at the resulting spectrograms, then back at the original full musical spectrogram- it helps me parse out the instruments a lot better when they overlap.
There is also a product called 'Celemony DNA' which can do some editing in spectrogram space to remove individual notes.
- gregsadetsky 4y agoEveryone should absolutely at least once pronounce every letter from the alphabet and look at a spectrogram, it’s fascinating. Try a rolled “r”, vowels, consonants, “p”, “f” (“eeeffff”) etc. Also try whistling if you can. —— Online spectrogram options: Sort of works on mobile, go to landscape and tap the mic button: https://spectrogram.sciencemusic.org/ https://spectrogram.sciencemusic.org/ Doesn’t work on mobile anymore? But should be good desktop option: https://musiclab.chromeexperiments.com/Spectrogram/ https://musiclab.chromeexperiments.com/Spectrogram/
- tomc1985 4y agoSpectrograms are used in speech therapy to help with pronunciation. I remember using one such program to correct my own speech, at elementary school in the 90s. It was even a game: I moved a cursor through a maze and it would only move in the correct direction when my sound I made was correct. The game had a spectrogram for additional visual feedback -- my speech therapist could point to an area on it and tell me that I was placing my tongue incorrectly or whatever. Its a really cool example of the power of biofeedback.
- abrookewood 4y agoAny idea if it is used to help deaf people talk? Seems like it would be useful.
- teleforce 4y agoVietnamese and Cantonese are tonal languages that has 6 levels phonetic tones [1]. The linear time-frequency spectogram is very useful for this type of human language analysis and not only for bird. Would be interesting to apply non-linear time-frequency analysis for this domain as well. [1]https://en.wikipedia.org/wiki/Tone_(linguistics) https://en.wikipedia.org/wiki/Tone_(linguistics)