5 ms·
What is AI about it? There have already been a few audio to midi plugins.. How is this different? Can it detect more than bass, and snare?
by rootedbox 14y ago
What is AI about it? There have already been a few audio to midi plugins.. How is this different? Can it detect more than bass, and snare?
- seertaak 14y agoIt's different in that almost all audio to midi plugins only consist of onset and tempo detection. Whereas Beatmatic also features classification of the sounds, so it lays them onto tracks for you. And yes, Beatmatic can detect any two (and in principle, 3+) "distinct" sounds. We use unsupervised learning techniques (clustering), so your vocal sounds don't need to sound like those used to optimize the software. As for whether it's AI, the term is a bit subjective. I think it's not unfair to use it as there's a fair amount of statistical techniques and tricks to make it work, and the result is an app doing things you normally wouldn't expect a computer to do.
- rootedbox 14y agoActually a lot of audio to midi are doing pitch on top of onset, and tempo.. some are also polyphonic; some are available as real time VSTs (are you on any of the music dsp mailing lists? you really should be.. the prob you are doing has been handled)... The 2 minute hack to do what you guys are doing but being able to detect way more that 3 distinct sounds would be to use ableton with the following audio chain.. channel1(audio) -> looper -> vst audio to midi vst -> channel 2 (midi) set your looper to trigger the on / off recording on channel 2.
- sp332 14y agoIt's AI because it pulls semantic meaning out of a raw, fuzzy, human-sourced audio feed. It figures out what rhythm you wanted, and which notes correspond to which instruments. But it also knows that you want a regular, repeating pattern that rounds to the nearest 8th note. And I think I saw him push a button to add a high-hat automatically, which is cool.