Counterpoint is a special case of multiple voices and is handled by interleaving. Let A_i be what instrument A does at time t and B_i what instrument B does at

Counterpoint is a special case of multiple voices and is handled by interleaving. Let A_i be what instrument A does at time t and B_i what instrument B does at the same time. Then with five tokens look back: f(A_1 B_1 A_2 B_2 A_3) = B_3 and f(B_1 A_2 B_2 A_3 B_3) = A_4 and so on. There are variations to this theme. For example, you could generate the previous token at each time step instead of the next one but, essentially, it is the same idea.