6 ms·
Understood. This is an area of image research I have an interest and some experience in (image segmentation, background inpainting, etc., through machine learni
by amayne 7y ago
Understood. This is an area of image research I have an interest and some experience in (image segmentation, background inpainting, etc., through machine learning.)
I think your results are wonderful. I was just pointing out that from my background (a television producer - most recently Shark Week, etc.) that the Ken Burns effect and parallax effects are considered two different concepts (that can be combined, but mean different things.)
- sniklaus 7y agoI did not mean to shoot you down or anything, I in fact greatly appreciate your feedback! I unfortunately do not have a television / movie producer background but wish to learn more to better understand and support the workflow of professionals in this area. On a different note, I have recently not had time to watch television and hence just looked Shark Week up. It looks popular, congrats!
- coldtea 7y agoThe grantparent is right when it comes to terms: - Ken Burns effect -> zoom and pan around the image. The Ken Burns effect is a type of panning and zooming effect used in video production from still imagery. The name derives from extensive use of the technique by American documentarian Ken Burns. (Wikipedia) - 2.5D parallax effect -> what we see in the link https://blog.pond5.com/16853-create-2-5d-parallax-effect-images-photoshop-cc/ https://blog.pond5.com/16853-create-2-5d-parallax-effect-ima... https://www.youtube.com/watch?v=WcSdhtxId2o https://www.youtube.com/watch?v=WcSdhtxId2o Note that these two can (and frequently are) be combined, and Ken Burns himself does so occasionally.
- sniklaus 7y agoI would like to add that our method estimates the scene in full 3D space. Have a look at the additional results, there are a few results that exemplify this when the geometry is a little more complex: http://sniklaus.com/papers/kenburns-results http://sniklaus.com/papers/kenburns-results
- coldtea 7y agoI'd like add that, naming aside, your algorithm results looks amazing, and you could even have a business (or a successful app) here. I know a few online services that do manual (cutting in photoshop, setting on a 3D plane, etc) still photo to 2.5D parallax, e.g.: https://sundstedt.se/blog/services/2-5d-parallax-3d-effect-animated-photo-video-service/ https://sundstedt.se/blog/services/2-5d-parallax-3d-effect-a... there are Fiverr gigs doing it, and tons of filmmakers (me included when I dabble with that), do it ourselves too (which takes time in Photoshop, Premiere, etc) from time to time (for news, documentaries, and such). In fact I am about to pay a good 100-200 to have 4-5 photos done this way for a project...
- sniklaus 7y agoSince I have done the work while interning at Adobe, I am afraid that I will not be able to commercialize it myself due to patenting. I agree with you that it has great potential, there are still quite a few failure cases though and it is a little hit and miss.
- amayne 7y agoMy special was “Andrew Mayne: Ghost Diver” where I built a suit to fool great white senses. Not shown in the special was the work we did trying to understand how sharks process visual data differently than humans. One interesting note is that they don’t seem to do image segmentation like we do (people in a shark cage are just a noisy box-thing and not discreet objects.) Again, your project is great. I’ve been trying to find a simple workflow to do something like this (currently it’s remove.bg and OpenCV - with a lot of tinkering.)
- tomcam 7y ago> Not shown in the special was the work we did trying to understand how sharks process visual data differently than humans. I would absolutely love to read that paper if it existed. Also, congratulations on the special!
- sniklaus 7y agoI just watched the trailer to that special, really interesting insights into the vision of sharks. And kudos on the nifty special effects to illustrate it!
- frogpelt 7y agoI think OP meant for the 3D to be a qualifier of the Ken Burns effect. Meaning he added parallax to the Ken Burns effect to produce a "3D Ken Burns Effect". I don't have any experience in any of it but I'm just offering another explanation of the discussion. Here's the page and video explaining it: http://sniklaus.com/papers/kenburns http://sniklaus.com/papers/kenburns
- deleted 7y ago[deleted]