This is a cool demonstration of shared latent spaces. Whether you're generating audio and images, or audio and text, or robot controls and video, or... whatever

This is a cool demonstration of shared latent spaces. Whether you're generating audio and images, or audio and text, or robot controls and video, or... whatever. The concept of having a shared latent space for different modalities really has legs.