GPT-2 for text is impressive because it does a surprisingly good job with larger scale patterns. If you give it a play it generates things with actor marks, it'

GPT-2 for text is impressive because it does a surprisingly good job with larger scale patterns. If you give it a play it generates things with actor marks, it's sentences are a reasonable length etc. I had been hoping this would be similar to learning the structure of tunes, but it seems that requires something we haven't figured out yet. I do disagree, though, that phrase repetition is as simple as you say. A good 16-count phrase has patterns within it, and a good AABB tune has relationships between the A and B parts.