3 ms·
If you know the tuning and scale length of the guitar, you can map the note played (audio) to string and fret position without trying to work that out from vide
by kingkongjaffa 3y ago
If you know the tuning and scale length of the guitar, you can map the note played (audio) to string and fret position without trying to work that out from video?
I imagine audio waveform is a magnitude easier than video recognition.
Video would be a pain because you would probably need to synchronise hand fretting position with picking/strumming timing to know which video frame actually 'struck' each string or chord, right?
Imagine finger style guitar or flamenco, the picking patterns are at least as complex as the fretted hand position.
- kingkongjaffa 3y agoUsing audio only you can probably generate sheet music and tab based on a known instrument. One thing to think about is that the same note can be played on multiple different strings, so you would want to figure out the probability of which string and fret was played, and you could enhance this by analysing an entire passage to figure out which strings fret pairs map to sequence of notes the best based on how a human would play that passage.
- udit99 3y agoThe problem is that the same note can be played in multiple string/fret combinations so all it tells me is that the note was played, not "note was played via this string/fret combination"
- kingkongjaffa 3y agoThat’s not entirely true. See https://www.quora.com/Why-does-the-same-note-played-on-a-different-string-on-a-guitar-make-a-slightly-different-noise-if-they-re-both-producing-the-same-frequency https://www.quora.com/Why-does-the-same-note-played-on-a-dif...