GANs have been tried many times already for music generation, without much success. GPT-2 works very well for text generation so it seemed promising here too.

GANs have been tried many times already for music generation, without much success. GPT-2 works very well for text generation so it seemed promising here too. Music falls somewhere in between text (as a sequence of chords or PCM samples) and image (as a piano roll or a spectrogram), so maybe some hybrid of image and text generators is needed.