Likely yes, it already has been done for DALL-E. Have a look at Training Transformers Together for what is involved: https://arxiv.org/abs/2207.03481 https://ar

Likely yes, it already has been done for DALL-E. Have a look at Training Transformers Together for what is involved: https://arxiv.org/abs/2207.03481 https://arxiv.org/abs/2207.03481.