3 ms·
The cause of this is image-stacking. The phone takes ~20 frames, over 0.2 seconds. In that time, lots of people and things in the frame move. Optical flow i
by londons_explore 5y ago
The cause of this is image-stacking.
The phone takes ~20 frames, over 0.2 seconds. In that time, lots of people and things in the frame move.
Optical flow is used to track all moving parts of the image, and then 'undo' any movement, aligning all parts of the image.
Then the frames are combined, usually by, for each pixel, taking something like the median or throwing out outliers and using the average.
When the optical flow fails to track an object in more than half the frames, the 'outliers' that are thrown out can in fact be the image content you wanted.
It happens with leaves a lot because they can flutter fast from one frame to the next, so tracking each individual leaf is hard. A few bad tracking results on more than half the frames, and all you end up seeing is leaves where there should be a face..
- dylan604 5y agoOflow "glitches" are some of the most fun things in image processing, and definitely my favorite render glitches. When it works, it's amazing. When it doesn't, it's also just as amazing, but in a different manner.