TL;DR: You can't reconstruct a generic video stream from a dozen detected facial data points. Not sure if I understood your post correctly, but you're slightly

TL;DR: You can't reconstruct a generic video stream from a dozen detected facial data points. Not sure if I understood your post correctly, but you're slightly misled here. Watch the video. This is not a new general purpose video codec, it is basically Deep Fake - taking a still image (key frame) and superimposing detected facial expression/movement on this key frame (leaving out some technical details). This is an improvement over (not-anymore-)state-of-the-art h264 since transmission of only a few coordinates mapping your facial expression is significantly less data to transmit then a delta of arbitrary video and periodic keyframes (again generously leaving out important technical details of modern video codecs). Trying to reconstruct a moving car/background/etc. from these facial expression key points will lead nowhere.