So Jukebox can actually be broken down into 2 components / 3 steps: A) compression (take 44khz audio and compress into tokens using 3 VQVAE layers) B) generati

So Jukebox can actually be broken down into 2 components / 3 steps: A) compression (take 44khz audio and compress into tokens using 3 VQVAE layers) B) generation (take the compressed tokens and use that on a transformer to generate sequences of those tokens) C) de-compresss (reverse the VQVAE) -> this is BY FAR the longest/most computationally expensive step Diffusion currently wont really help with (B) or even (A)... but there is a lot of new experiments going on with (3)... where the decompression using stable-diffusion is providing very interesting results using far less compute... check out JuicyJukebox notebooks (link to come... cant access github colab from my work computer).