3 ms·
One problem I wasn't able to solve very satisfyingly is music -> midi. Even with solo instruments, the output data is a hot jumbled mess with all kinds of error
by gnulinux 3y ago
One problem I wasn't able to solve very satisfyingly is music -> midi. Even with solo instruments, the output data is a hot jumbled mess with all kinds of errors from pitch to rhythm to dynamics. Once anything more than one timbre is involved, or e.g. an orchestra, it seems completely impossible to solve it with current tools since the model needs to be smart enough to tell apart fundamental frequencies with multiple timbres.
- jononor 3y agoPolyphonic / multi-track music transcription is a very challenging tasks and still an open area of research. Plenty of progress made the last 5 years, but still not at a very practical level. Source separation and single/lead instrument transcription has gotten pretty good though. So if the music fits with the 5-stem split of say Spleeter it can do an OK job