8 ms·
The hurdle for this is that to do it well, you need polyphonic pitch detection, which you could say is a little tricky. However, I worked on the prototype for
by zach 15y ago
The hurdle for this is that to do it well, you need polyphonic pitch detection, which you could say is a little tricky.
However, I worked on the prototype for a music app that does polyphonic pitch detection for a greater effect than page turning. It listens and follows along note by note as you play your (real) guitar and, as you hit the notes properly, actually uses the master tracks of rock songs to give you a very cool sensation of playing the real song. It's called Rock Prodigy: Guitar and is free with per-song IAPs if you want to try it out.
- waqf 15y agoFollowing an existing score should be a lot easier than de novo polyphonic transcription. For example, you could almost just track the beat while ignoring all the pitches.
- zach 15y agoWith a rhythm-game type app, you can dictate what the user is supposed to be playing. With a sheet music app, not so much. People will want to play the first few measures over and over, try something again after messing it up, stop and take it from the top and so on. If you turn the page too soon or scroll the music the user is playing off the screen, the customer reviews are going to look like Armageddon has come. The only way I see that works understandably and well enough is to recognize when the last measure of the last staff is completed. Even that may be incompatible with some music, but it should work well enough in general.
- high5ths 15y agoIt's impossible to do that with a lot of non-standard notational music. And even with standard music, "the beat" is annoying to track and changes FAR more than you'd expect. Good musicians are constantly altering the beat in subtle and unsubtle ways.
- dangrover 15y agoExactly. Rhythm quantization is one of those things that no app ever gets right.
- phlee 15y agoI've been working on converting midi/virtual midi input (from a performer) to notation in real time for an iPad notation app. It really is hard - I spent a tremendous amount of time on it, an still plan on improving it indefinitely after the feature ships.