Only kinda crazy. As a ukulelist, when I sit in with (say) a guitarist, I do a sequence-to-sequence translation of the chords I see my friend playing to chords

Only kinda crazy. As a ukulelist, when I sit in with (say) a guitarist, I do a sequence-to-sequence translation of the chords I see my friend playing to chords I can play. If you know your instrument well, you know the sound that goes with certain visual configurations. So you can think of it as sequence-to-sequence translation with a very non-traditional input.