2 ms·
While it's doing a great job emulating the timbre of the notes, what's interesting to me is what it's not doing. Play those top two passages to anyone who's sp
by ajross 5y ago
While it's doing a great job emulating the timbre of the notes, what's interesting to me is what it's not doing. Play those top two passages to anyone who's spent time around sax players, and they'll instantly tell you which one was the "fake".
Real instruments have mechanical behavior this isn't going to see absent some kind of modeling. Different notes on a sax (to take this example) are actuated by different fingers and different valves and have different (often multiple) embouchures, and both interact with the transitions between pairs of notes (and with the dynamics with which they're played). All that complexity is absolutely hearable in the transitions between notes, and the ML layers aren't going to have the ability to pick it up absent a much larger training set.
Basically: 16 seconds of audio is enough to get you the frequency spectrum of the notes, which you can do with 3-4 lines of synthesis code in an imperative regime. It's very much the "easy part" of instrument synthesis.
- davio 5y agoI played sax through college and the second passage sounds legit to me. Couple of interesting things: - You can hear the keys and pads hitting and clicking - Vibrato on the last note is very realistic - Can hear the air and "spit" - The timing seems human, especially as it slows down a little on the lower notes which take more air and usually involve more awkward fingering with the pinky fingers. Definitely sounds like a non-professional, probably how an average high school player would play the passage. It sounds like what a player would hear versus a studio recording. Reminds me of being in a really reflective & tiny practice room.
- LegitShady 5y agoir you read down the article the 16 seconds is just the input to a ml model. the actual training set is fifty something minutes.