2 ms·
The difficulty with cartoon lions is interesting. I wonder if training an image classifier on cartoon drawings of things would help it better recognize those o
by elihu 6y ago
The difficulty with cartoon lions is interesting. I wonder if training an image classifier on cartoon drawings of things would help it better recognize those objects in real-life images, as the cartoon version is (theoretically) distilled down into those aspects that (to a human, at least) are the characteristically recognizable aspects of that thing, without distracting detail? Simplified cartoon drawings of things are often used to teach children, after all.
Also, that Roomba really does look like a CD player.
- gwern 6y agoYou can make the CNN focus more on shape rather than photographic texture using style transfer, hence, Stylized-Imagenet: https://arxiv.org/abs/1811.12231 https://arxiv.org/abs/1811.12231 I've wondered if you could do the same thing with anime images as well, and if a joint classifier (using, say, https://www.gwern.net/Danbooru2020 https://www.gwern.net/Danbooru2020 ?) would be much better for it. Of course, the big trend now is CLIP/ALIGN https://openai.com/blog/clip/ https://openai.com/blog/clip/ https://arxiv.org/abs/2102.05918#google https://arxiv.org/abs/2102.05918#google which are trained on web images on such a scale that they do quite fine on anime images. Look on Twitter or Reddit for 'Big Sleep' examples using the ThisAnimeDoesNotExist.ai anime model: CLIP can generate anime images reasonably well, along with everything else it can do so well. (The 'blessings of scale', I call it: https://www.gwern.net/newsletter/2020/05#blessings-of-scale https://www.gwern.net/newsletter/2020/05#blessings-of-scale Just train on as much data as possible, and a lot of these weaknesses fix themselves.)