3 ms·

The applications for this in the advertising industry are exciting and a tad bit scary. I can imagine a feedback system that takes the output of this algorithm

by nicklo 11y ago

The applications for this in the advertising industry are exciting and a tad bit scary. I can imagine a feedback system that takes the output of this algorithm and modifies the image slightly according to the error gradient to optimize the MEM-score of the brand/item being advertised in the photo. Then it could feed the new image back in and repeat like the Deep-Dreaming algorithm. side-note: I'm so happy that CSAIL is finally embracing deep learning. I'm an undergrad at mit and this semester was the first that deep learning was a major part of both the computer vision class and the nlp class.

rl3 11y ago
Although your idea is absolutely terrifying, I could see it having some pretty entertaining failure modes. For example: a sportswear company uses an image destined for their Instagram feed as input. It's a photo of a famous athlete touting their product. After they process the image, the output has a higher MEM-score—but only because the athlete is now dressed in the attire of their competitors.
arethuza 11y ago
In another thread, someone mentioned a mobile app that paused ad videos if you weren't looking at the device. Maybe the approach you mention could be applied in a similar way - to morph images in ads until you do look at them.
- danso 11y ago
  This problem has been mostly solved. You don't need a deep learning algorithm to detect a face. There's an entire company that has sprouted from online education by providing solutions for the proctoring of exams (the webcam is turned on, and facial movement that suspiciously turns towards offscreen areas is flagged). I'm not even sure the phone's camera would have to be on to do the mobile app detection you describe.
  - arethuza 11y ago
    That's what I meant - the application that detect whether you are looking at an ad is already out there. What I meant was that rather than simply pausing the video it could change the image iteratively until you do look at the image.

by nicklo 11y ago

rl3 11y ago

Although your idea is absolutely terrifying, I could see it having some pretty entertaining failure modes. For example: a sportswear company uses an image destined for their Instagram feed as input. It's a photo of a famous athlete touting their product. After they process the image, the output has a higher MEM-score—but only because the athlete is now dressed in the attire of their competitors.

arethuza 11y ago

In another thread, someone mentioned a mobile app that paused ad videos if you weren't looking at the device. Maybe the approach you mention could be applied in a similar way - to morph images in ads until you do look at them.

danso 11y ago
This problem has been mostly solved. You don't need a deep learning algorithm to detect a face. There's an entire company that has sprouted from online education by providing solutions for the proctoring of exams (the webcam is turned on, and facial movement that suspiciously turns towards offscreen areas is flagged). I'm not even sure the phone's camera would have to be on to do the mobile app detection you describe.
- arethuza 11y ago
  That's what I meant - the application that detect whether you are looking at an ad is already out there. What I meant was that rather than simply pausing the video it could change the image iteratively until you do look at the image.