4 ms·
I'd be very curious to see this applied to not just a single frame of video, but rather to the video as a whole. My assumption is that it would create a weird j
by jjcm 8y ago
I'd be very curious to see this applied to not just a single frame of video, but rather to the video as a whole. My assumption is that it would create a weird jitter to the parts of the image that have been recreated by the neural net.
I think what would be almost even more interesting is an algorithm like this that is specifically trained to video, and takes into account previous and next frames when recreating lost data.
- ghgr 8y agoThere's been work (in a related field) to "stabilize" the jitter in consecutive frames. As you say, by taking into account the neighboring frames. Relevant excerpt from [1]: “If you just apply the algorithm frame by frame, you don’t get a coherent video — you get flickering in the sequence,” says University of Freiburg postdoc Alexey Dosovitskiy. “What we do is introduce additional constraints, which make the video consistent.” [1] https://blogs.nvidia.com/blog/2016/05/25/deep-learning-paints-videos/ https://blogs.nvidia.com/blog/2016/05/25/deep-learning-paint...