It's a bit light on details beyond trained-on-video, and interpolating between keyframes in latent space. The stable diffusion community is getting impressive

It's a bit light on details beyond trained-on-video, and interpolating between keyframes in latent space. The stable diffusion community is getting impressive results generating keyframes in a batch and using existing interpolation mechanisms on the decoded frames. https://www.reddit.com/r/StableDiffusion/comments/12o8qm3/finally_installed_the_newer_controlnet_models_a/ https://www.reddit.com/r/StableDiffusion/comments/12o8qm3/fi... That example is using control-nets to induce the animation they want but it would be quite easy to train a model on a sequence of video frames in the same layout.