> Music has two key difficulties: the long, linear context makes it hard for most models to generate coherent works and reason about long-term higher level stru

> Music has two key difficulties: the long, linear context makes it hard for most models to generate coherent works and reason about long-term higher level structure It seems like the DeepMind PerceiverAR that you linked generates entire piano pieces all at once, instead of generating token by token like OpenAI GPT or Jukebox. So that should take care of long-term coherence right? Since all parts of the song are processed and generated at once