3 ms·

We were doing a lot of reading to better understand video producers an their usage of the Ken Burns effect. We are ultimately still research scientists with no

We were doing a lot of reading to better understand video producers an their usage of the Ken Burns effect. We are ultimately still research scientists with no hands-on video-production experience but we made sure to do our homework. :)

semi-extrinsic 7y ago
Some thoughts based on looking at the video a few times more (disclaimer - I'm not a video professional) * There needs to be some variation in the zooming if you use this in a slideshow. I'd even say bias it towards zooming out more often, since that gradually reveals more of the image. * You might have enough information to work with here to develop a similar "focus pull effect from single image" algo. That would be really cool. * Maybe also you could try to develop a "sunset fade" for images where you detect blue sky. Graduallu adding a gradient yellow-orange fade for the sky, gradually warmer and darker foreground and non-sky background.
- sniklaus 7y ago
  Thank you for sharing your thoughts! * There definitely should be more variety in terms of camera paths. Our framework either supports fully automatic results (as shown) or ones with a manual camera path. For an automatically generated slideshow, one should probably add more variety. * There is some great work in this area, commonly focusing on portrait images. But yes, once the scene geometry has been estimated sufficiently well, one can definitely add some nice out-of-focus effects. * That would be an interesting research direction. I am not an expert in relighting, but I can imagine that this requires a lot of work to make sure that the scene composition looks believable.
  - tomaskafka 7y ago
    As for 2, Focos app has recently added the fake depth blur, and it is both absolutely impressive (oh my! It gets most of the image so right) and discernible (we are so sensitive about the visual that one wrongly estimated region - often a 'hole' like the ground between the legs - is enough to ruin the magic). http://focos.me/ http://focos.me/

semi-extrinsic 7y ago

Some thoughts based on looking at the video a few times more (disclaimer - I'm not a video professional) * There needs to be some variation in the zooming if you use this in a slideshow. I'd even say bias it towards zooming out more often, since that gradually reveals more of the image. * You might have enough information to work with here to develop a similar "focus pull effect from single image" algo. That would be really cool. * Maybe also you could try to develop a "sunset fade" for images where you detect blue sky. Graduallu adding a gradient yellow-orange fade for the sky, gradually warmer and darker foreground and non-sky background.

sniklaus 7y ago
Thank you for sharing your thoughts! * There definitely should be more variety in terms of camera paths. Our framework either supports fully automatic results (as shown) or ones with a manual camera path. For an automatically generated slideshow, one should probably add more variety. * There is some great work in this area, commonly focusing on portrait images. But yes, once the scene geometry has been estimated sufficiently well, one can definitely add some nice out-of-focus effects. * That would be an interesting research direction. I am not an expert in relighting, but I can imagine that this requires a lot of work to make sure that the scene composition looks believable.
- tomaskafka 7y ago
  As for 2, Focos app has recently added the fake depth blur, and it is both absolutely impressive (oh my! It gets most of the image so right) and discernible (we are so sensitive about the visual that one wrongly estimated region - often a 'hole' like the ground between the legs - is enough to ruin the magic). http://focos.me/ http://focos.me/