Vaguely relatable, there is/was stuff like Photosynth [1] which (as far as I recall, from researching this stuff as a CS undergrad) was making use of Bundle Ad

Vaguely relatable, there is/was stuff like Photosynth [1] which (as far as I recall, from researching this stuff as a CS undergrad) was making use of Bundle Adjustment [2] and detecting landmarks in images using Scale Invariant Feature Transform (SIFT) [3], to estimate camera poses of photos relative to each other in a 3D scene -- even from completely different cameras. By projecting the discarded frames onto your keeper frame, you've potentially got multiple samples of the same pixels and their neigbours... (Although I guess the "every image is a plane" 3D transform is a bit simple and doesn't account for lens distortion) [1] https://en.wikipedia.org/wiki/Photosynth https://en.wikipedia.org/wiki/Photosynth [2] https://en.wikipedia.org/wiki/Bundle_adjustment https://en.wikipedia.org/wiki/Bundle_adjustment [3] https://en.wikipedia.org/wiki/Scale-invariant_feature_transform https://en.wikipedia.org/wiki/Scale-invariant_feature_transf...