7 ms·
As a photography enthusiast, this makes me cringe. I'll acknowledge that the samples they show came out fine, but I suspect that in the real world this won't wo
by CWuestefeld 10y ago
As a photography enthusiast, this makes me cringe. I'll acknowledge that the samples they show came out fine, but I suspect that in the real world this won't work well as a generalized solution.
There are a lot of things that if you get wrong, you'll ruin the image. This is true from an artistic perspective, but even with a lower bar, it's very easy to crop an image to make the content distracting or disturbing.
There are rules of thumb, for example, about how to crop images with people. It's not just that you want to preserve the faces. You need to be careful about where on their bodies you crop: if you do it right at a joint, it will tend to look like the person is an amputee. So you've got to crop a leg at mid-thigh rather than at the knee, for example.
There's also an idea of "look space". If you crop so that the direction of the subject's gaze is toward the outside of the image (rather than toward the middle), the subject will tend to look crowded and the overall composition unbalanced.
And there are overall compositional rules, like rule-of-thirds, leading lines, etc. Cropping an image is likely to damage these, thus harming the aesthetics of the picture.
I won't make the claim that this stuff is impossible to automate (the very fact that I can list these rules of thumb suggests that much of it can handled without creativity as such), but doing so in a way that preserves the desirable qualities of a good image will require a LOT more sophistication than what's being brought to bear here.
- geeklk 10y agoIf you're interested in preserving composition using automatic methods, you may want to check out the field of image retargeting. Instead of cropping, it attempts to warp 'non-important' parts of the image to reach the desired aspect ratio. An implementation of it in photoshop is called 'content aware resize', but I haven't seen an evaluation of it against the state of the art research.
- dontreact 10y agoI wonder if you could build a training set to teach a neural net to detect these things, then autocrop. Some similar previous work that suggests to me this may be possible. https://research.googleblog.com/2015/10/improving-youtube-video-thumbnails-with.html https://research.googleblog.com/2015/10/improving-youtube-vi...