6 ms·
Tried to remove an elephant in an hard instance (what to do with the woman on top?), and a bicycle in an easy instance (lone bicycle), both found from Google Im
by devit 8y ago
Tried to remove an elephant in an hard instance (what to do with the woman on top?), and a bicycle in an easy instance (lone bicycle), both found from Google Image Search .
http://deepangel.media.mit.edu/showcase/Works%20terribly http://deepangel.media.mit.edu/showcase/Works%20terribly
http://deepangel.media.mit.edu/showcase/Another%20greyish%20blob http://deepangel.media.mit.edu/showcase/Another%20greyish%20...
Terrible results in both. It looks like it just works on their examples and doesn't do any better than object detection + paint a solid rectangle on others (arguably, it does worse than that).
- genofon 8y agounfortunately in my experience that's the case for most of opensource AI projects out there, while the showcase results are hand-picked or the algorithms was trained and tuned to solve that specific image.
- marcosdumay 8y agoIt makes me suspect that the overfiting concerns on deep learning are correct.
- backpropaganda 8y agoI doubt this AI gets perfect performance even in the training set. Deep generative models are known to underfit more rather than overfit, i.e. they can't even do a good job of the full training set let alone the test set. The cherry-picked examples you see are just statistical outliers corresponding to VERY easy examples.
- jl2718 8y agoStatistically-random excellent performance in complex tasks is very unlikely. More likely is that examples are in-sample from a small training set or very similar. Big NNs can memorize anything.
- backpropaganda 8y agoThey can memorize any supervised learning task, but so far, we haven't been able to see any deep generative model successfully memorize something more complex than MNIST.
- thomasahle 8y agoThis happened with my image as well. AI just put a big gray rectangle on top of the persons and called it a day. https://s3.amazonaws.com/deepangelai/results/person/thomasahle_2018-09-02T19:15:55/box/_100.jpg https://s3.amazonaws.com/deepangelai/results/person/thomasah...
- browsercoin 8y agodamn this is embarrassing considering how much PR and marketing MIT puts out. That image is almost comical, it's as if somebody just got tired and holds a loose definition of "removing an object from a picture".
- cameronhowe 8y agoI think a 3 year old would do a better job than this AI. Not sure why they bothered with such a fancy website for this to be honest.