4 ms·
Also recently released is "CoDeF: Content Deformation Fields for Temporally Consistent Video Processing" https://qiuyu96.github.io/CoDeF/ https://qiuyu96.github
by lhl 3y ago
Also recently released is "CoDeF: Content Deformation Fields for Temporally Consistent Video Processing" https://qiuyu96.github.io/CoDeF/ https://qiuyu96.github.io/CoDeF/
"We present the content deformation field (CoDeF) as a new type of video representation, which consists of a canonical content field aggregating the static contents in the entire video and a temporal deformation field recording the transformations from the canonical image (i.e., rendered from the canonical content field) to each individual frame along the time axis. Given a target video, these two fields are jointly optimized to reconstruct it through a carefully tailored rendering pipeline. We advisedly introduce some regularizations into the optimization process, urging the canonical content field to inherit semantics (e.g., the object shape) from the video."
The results also look very stable/impressive.