4 ms·

The examples in the video were automatically generated without user feedback. It is actually also possible to manually specify the camera path in order to achie

The examples in the video were automatically generated without user feedback. It is actually also possible to manually specify the camera path in order to achieve the effect that you are expecting, for more information feel free to have a look at the video on the project website.

amayne 7y ago
Understood. This is an area of image research I have an interest and some experience in (image segmentation, background inpainting, etc., through machine learning.) I think your results are wonderful. I was just pointing out that from my background (a television producer - most recently Shark Week, etc.) that the Ken Burns effect and parallax effects are considered two different concepts (that can be combined, but mean different things.)
- sniklaus 7y ago
  I did not mean to shoot you down or anything, I in fact greatly appreciate your feedback! I unfortunately do not have a television / movie producer background but wish to learn more to better understand and support the workflow of professionals in this area. On a different note, I have recently not had time to watch television and hence just looked Shark Week up. It looks popular, congrats!
  - coldtea 7y ago
    The grantparent is right when it comes to terms: - Ken Burns effect -> zoom and pan around the image. The Ken Burns effect is a type of panning and zooming effect used in video production from still imagery. The name derives from extensive use of the technique by American documentarian Ken Burns. (Wikipedia) - 2.5D parallax effect -> what we see in the link https://blog.pond5.com/16853-create-2-5d-parallax-effect-images-photoshop-cc/ https://blog.pond5.com/16853-create-2-5d-parallax-effect-ima... https://www.youtube.com/watch?v=WcSdhtxId2o https://www.youtube.com/watch?v=WcSdhtxId2o Note that these two can (and frequently are) be combined, and Ken Burns himself does so occasionally.
    - sniklaus 7y ago
      I would like to add that our method estimates the scene in full 3D space. Have a look at the additional results, there are a few results that exemplify this when the geometry is a little more complex: http://sniklaus.com/papers/kenburns-results http://sniklaus.com/papers/kenburns-results
      - coldtea 7y ago
        I'd like add that, naming aside, your algorithm results looks amazing, and you could even have a business (or a successful app) here. I know a few online services that do manual (cutting in photoshop, setting on a 3D plane, etc) still photo to 2.5D parallax, e.g.: https://sundstedt.se/blog/services/2-5d-parallax-3d-effect-animated-photo-video-service/ https://sundstedt.se/blog/services/2-5d-parallax-3d-effect-a... there are Fiverr gigs doing it, and tons of filmmakers (me included when I dabble with that), do it ourselves too (which takes time in Photoshop, Premiere, etc) from time to time (for news, documentaries, and such). In fact I am about to pay a good 100-200 to have 4-5 photos done this way for a project...
        sniklaus 7y ago
        Since I have done the work while interning at Adobe, I am afraid that I will not be able to commercialize it myself due to patenting. I agree with you that it has great potential, there are still quite a few failure cases though and it is a little hit and miss.
  - amayne 7y ago
    My special was “Andrew Mayne: Ghost Diver” where I built a suit to fool great white senses. Not shown in the special was the work we did trying to understand how sharks process visual data differently than humans. One interesting note is that they don’t seem to do image segmentation like we do (people in a shark cage are just a noisy box-thing and not discreet objects.) Again, your project is great. I’ve been trying to find a simple workflow to do something like this (currently it’s remove.bg and OpenCV - with a lot of tinkering.)
    - tomcam 7y ago
      > Not shown in the special was the work we did trying to understand how sharks process visual data differently than humans. I would absolutely love to read that paper if it existed. Also, congratulations on the special!
    - sniklaus 7y ago
      I just watched the trailer to that special, really interesting insights into the vision of sharks. And kudos on the nifty special effects to illustrate it!
- frogpelt 7y ago
  I think OP meant for the 3D to be a qualifier of the Ken Burns effect. Meaning he added parallax to the Ken Burns effect to produce a "3D Ken Burns Effect". I don't have any experience in any of it but I'm just offering another explanation of the discussion. Here's the page and video explaining it: http://sniklaus.com/papers/kenburns http://sniklaus.com/papers/kenburns
- deleted 7y ago
  [deleted]
dahart 7y ago
It might be a nice side result to use your tech to identify foreground elements automatically to generate the camera motion, without using the 2.5D layering. Then you’d have a more traditional Ken Burns effect. It might not work at picking a specific face out of a crowd, but it would work for a lot of scenarios. I find Apple’s automatic Ken Burns effect to be way too noisy and almost useless because it zooms in/out from random places in the pictures. When I manually edit a Ken Burns effect myself, there’s a lot less movement, and the movement is so much more meaningful and relevant to the video.
- sniklaus 7y ago
  Thank you for your feedback! I highly value the opinion of working professionals like you and am taking notes. :)
whiddershins 7y ago
Yes. This is amazing technology and looks fantastic. No it is not what is generally referred to as a ‘Ken Burns’ effect, which I think is a distraction in the title. Because this is awesome! Also how can I use this for a project I am literally doing production on right now?? Edit: People usually just call this parallax.

amayne 7y ago

Understood. This is an area of image research I have an interest and some experience in (image segmentation, background inpainting, etc., through machine learning.) I think your results are wonderful. I was just pointing out that from my background (a television producer - most recently Shark Week, etc.) that the Ken Burns effect and parallax effects are considered two different concepts (that can be combined, but mean different things.)

sniklaus 7y ago
I did not mean to shoot you down or anything, I in fact greatly appreciate your feedback! I unfortunately do not have a television / movie producer background but wish to learn more to better understand and support the workflow of professionals in this area. On a different note, I have recently not had time to watch television and hence just looked Shark Week up. It looks popular, congrats!
- coldtea 7y ago
  The grantparent is right when it comes to terms: - Ken Burns effect -> zoom and pan around the image. The Ken Burns effect is a type of panning and zooming effect used in video production from still imagery. The name derives from extensive use of the technique by American documentarian Ken Burns. (Wikipedia) - 2.5D parallax effect -> what we see in the link https://blog.pond5.com/16853-create-2-5d-parallax-effect-images-photoshop-cc/ https://blog.pond5.com/16853-create-2-5d-parallax-effect-ima... https://www.youtube.com/watch?v=WcSdhtxId2o https://www.youtube.com/watch?v=WcSdhtxId2o Note that these two can (and frequently are) be combined, and Ken Burns himself does so occasionally.
  - sniklaus 7y ago
    I would like to add that our method estimates the scene in full 3D space. Have a look at the additional results, there are a few results that exemplify this when the geometry is a little more complex: http://sniklaus.com/papers/kenburns-results http://sniklaus.com/papers/kenburns-results
    - coldtea 7y ago
      I'd like add that, naming aside, your algorithm results looks amazing, and you could even have a business (or a successful app) here. I know a few online services that do manual (cutting in photoshop, setting on a 3D plane, etc) still photo to 2.5D parallax, e.g.: https://sundstedt.se/blog/services/2-5d-parallax-3d-effect-animated-photo-video-service/ https://sundstedt.se/blog/services/2-5d-parallax-3d-effect-a... there are Fiverr gigs doing it, and tons of filmmakers (me included when I dabble with that), do it ourselves too (which takes time in Photoshop, Premiere, etc) from time to time (for news, documentaries, and such). In fact I am about to pay a good 100-200 to have 4-5 photos done this way for a project...
      - sniklaus 7y ago
        Since I have done the work while interning at Adobe, I am afraid that I will not be able to commercialize it myself due to patenting. I agree with you that it has great potential, there are still quite a few failure cases though and it is a little hit and miss.
- amayne 7y ago
  My special was “Andrew Mayne: Ghost Diver” where I built a suit to fool great white senses. Not shown in the special was the work we did trying to understand how sharks process visual data differently than humans. One interesting note is that they don’t seem to do image segmentation like we do (people in a shark cage are just a noisy box-thing and not discreet objects.) Again, your project is great. I’ve been trying to find a simple workflow to do something like this (currently it’s remove.bg and OpenCV - with a lot of tinkering.)
  - tomcam 7y ago
    > Not shown in the special was the work we did trying to understand how sharks process visual data differently than humans. I would absolutely love to read that paper if it existed. Also, congratulations on the special!
  - sniklaus 7y ago
    I just watched the trailer to that special, really interesting insights into the vision of sharks. And kudos on the nifty special effects to illustrate it!
frogpelt 7y ago
I think OP meant for the 3D to be a qualifier of the Ken Burns effect. Meaning he added parallax to the Ken Burns effect to produce a "3D Ken Burns Effect". I don't have any experience in any of it but I'm just offering another explanation of the discussion. Here's the page and video explaining it: http://sniklaus.com/papers/kenburns http://sniklaus.com/papers/kenburns
deleted 7y ago
[deleted]

dahart 7y ago

It might be a nice side result to use your tech to identify foreground elements automatically to generate the camera motion, without using the 2.5D layering. Then you’d have a more traditional Ken Burns effect. It might not work at picking a specific face out of a crowd, but it would work for a lot of scenarios. I find Apple’s automatic Ken Burns effect to be way too noisy and almost useless because it zooms in/out from random places in the pictures. When I manually edit a Ken Burns effect myself, there’s a lot less movement, and the movement is so much more meaningful and relevant to the video.

sniklaus 7y ago
Thank you for your feedback! I highly value the opinion of working professionals like you and am taking notes. :)

whiddershins 7y ago

Yes. This is amazing technology and looks fantastic. No it is not what is generally referred to as a ‘Ken Burns’ effect, which I think is a distraction in the title. Because this is awesome! Also how can I use this for a project I am literally doing production on right now?? Edit: People usually just call this parallax.