I’m working on research for a journal article on this right now. Basically, get a bunch of videos you want compressed, use an auto encoder and just store the ve

I’m working on research for a journal article on this right now. Basically, get a bunch of videos you want compressed, use an auto encoder and just store the very small latent space variables instead of the video. Keep the decoder sitting around that was trained on those videos, and badaboom you can take a 512x512 movie and store it in 16x16x3 or another similarly sized latent space. However, this only works for fairly consistent video. Right now it works best for constantly monitoring video systems of physical phenomena. I.e. if you have multiple cameras pointed at the ocean to watch waves, you’re going to end up training a latent space that describes the wave physics. These small latent spaces are also the key to removing the black box. You can grab the latent spaces and connect the fields to physical quantities. For example, the wave reconstruction latent space has examples of velocity or wave height (variables needed to mathematically construct a wave field). Cool stuff!