Just to complete your post, one problem I always have with music generation using "first-order" Markov Chains is that they get really confused by children's mus

Just to complete your post, one problem I always have with music generation using "first-order" Markov Chains is that they get really confused by children's music. For example, here's the start of "twinkle twinkle, little star": CCGG AAG- FFEE DDC- So the tranistion matrix contails rules like: P(C -> C) = 50% P(A -> A) = 50% P(F -> F) = 50% P(E -> E) = 50% Which makes huge loops of the same note quite common. This makes for some really uncanny music.