>> Why doesn't the architecture use a model to generate sheet music / MIDI, then layer another model on top to create instrumentals? there are various models t

>> Why doesn't the architecture use a model to generate sheet music / MIDI, then layer another model on top to create instrumentals? there are various models that do this [0]... just doesn't have the same power to generate waveform music that jukebox does. Jukebox effectively is a 2 step model a) a 3 layer VQ-VAE compresses the music (so think of this as the MIDI equivalent) and b) a transfomer then learns/generates sequences. The compression is the expensive part of the model. [0] https://towardsdatascience.com/how-to-generate-music-using-a-lstm-neural-network-in-keras-68786834d4c5 https://towardsdatascience.com/how-to-generate-music-using-a...