3 ms·

For their image resizing tasks, I wonder if they've tried anything more complex than simply cropping around points of interest, something like seam carving [0].

by woodman 11y ago

For their image resizing tasks, I wonder if they've tried anything more complex than simply cropping around points of interest, something like seam carving [0]. I imagine that it would be pretty cheap to run a bunch of different algorithms on an image and then A|B test it on Amazon mechanical turk. [0] https://en.wikipedia.org/wiki/Seam_carving https://en.wikipedia.org/wiki/Seam_carving, https://www.youtube.com/watch?v=6NcIJXTlugc https://www.youtube.com/watch?v=6NcIJXTlugc, https://www.youtube.com/watch?v=AJtE8afwJEg https://www.youtube.com/watch?v=AJtE8afwJEg

maciejgryka 11y ago
Seam carving is cool! And there are even better methods out there - for anyone interested, this is a great starting point: http://people.csail.mit.edu/mrub/papers/retBenchmark.pdf http://people.csail.mit.edu/mrub/papers/retBenchmark.pdf All of these methods have advantages, but it's pretty hard to out-weight the simplicity of cropping, especially if you're sensitive to bad results.
emerongi 11y ago
Interesting. From the Wikipedia article: "A 2010 review of eight image retargeting methods found that seam carving produced output that was ranked among the worst of the tested algorithms. It was, however, a part of one of the highest-ranking algorithms: the multi-operator extension mentioned above (combined with cropping and scaling)." Here is the paper: http://people.csail.mit.edu/mrub/papers/retBenchmark.pdf http://people.csail.mit.edu/mrub/papers/retBenchmark.pdf Don't have time to read the paper, but I wonder if it didn't perform well because of the algorithm that calculated the energy levels? Edit: The paper seems to suggest that an algorithm for retargeting of streaming video [1] was rated highest by human viewers. [1] https://s3-us-west-1.amazonaws.com/disneyresearch/wp-content/uploads/20140725213843/A-System-for-Retargeting-of-Streaming-Video.pdf https://s3-us-west-1.amazonaws.com/disneyresearch/wp-content...
- microcolonel 11y ago
  I'm somewhat surprised that the best known methods aren't neural nets.
  - bcook 11y ago
    In 2010?
tekromancr 11y ago
That looks amazing, and relatively easy to implement. However it seems that Mitsubishi owns a patent on it, so maybe we will start seeing it used in __ years when they expire.
- sbarre 11y ago
  Seam carving has been in Photoshop, and other applications, for years now (as is clearly mentioned in the linked Wikipedia article).
- true_religion 11y ago
  Seam carving is available via Imagemagick.

by woodman 11y ago

maciejgryka 11y ago

Seam carving is cool! And there are even better methods out there - for anyone interested, this is a great starting point: http://people.csail.mit.edu/mrub/papers/retBenchmark.pdf http://people.csail.mit.edu/mrub/papers/retBenchmark.pdf All of these methods have advantages, but it's pretty hard to out-weight the simplicity of cropping, especially if you're sensitive to bad results.

emerongi 11y ago

Interesting. From the Wikipedia article: "A 2010 review of eight image retargeting methods found that seam carving produced output that was ranked among the worst of the tested algorithms. It was, however, a part of one of the highest-ranking algorithms: the multi-operator extension mentioned above (combined with cropping and scaling)." Here is the paper: http://people.csail.mit.edu/mrub/papers/retBenchmark.pdf http://people.csail.mit.edu/mrub/papers/retBenchmark.pdf Don't have time to read the paper, but I wonder if it didn't perform well because of the algorithm that calculated the energy levels? Edit: The paper seems to suggest that an algorithm for retargeting of streaming video [1] was rated highest by human viewers. [1] https://s3-us-west-1.amazonaws.com/disneyresearch/wp-content/uploads/20140725213843/A-System-for-Retargeting-of-Streaming-Video.pdf https://s3-us-west-1.amazonaws.com/disneyresearch/wp-content...

microcolonel 11y ago
I'm somewhat surprised that the best known methods aren't neural nets.
- bcook 11y ago
  In 2010?

tekromancr 11y ago

That looks amazing, and relatively easy to implement. However it seems that Mitsubishi owns a patent on it, so maybe we will start seeing it used in __ years when they expire.

sbarre 11y ago
Seam carving has been in Photoshop, and other applications, for years now (as is clearly mentioned in the linked Wikipedia article).
true_religion 11y ago
Seam carving is available via Imagemagick.