3 ms·
You can make the CNN focus more on shape rather than photographic texture using style transfer, hence, Stylized-Imagenet: https://arxiv.org/abs/1811.12231 https
by gwern 6y ago
You can make the CNN focus more on shape rather than photographic texture using style transfer, hence, Stylized-Imagenet: https://arxiv.org/abs/1811.12231 https://arxiv.org/abs/1811.12231 I've wondered if you could do the same thing with anime images as well, and if a joint classifier (using, say, https://www.gwern.net/Danbooru2020 https://www.gwern.net/Danbooru2020 ?) would be much better for it.
Of course, the big trend now is CLIP/ALIGN https://openai.com/blog/clip/ https://openai.com/blog/clip/ https://arxiv.org/abs/2102.05918#google https://arxiv.org/abs/2102.05918#google which are trained on web images on such a scale that they do quite fine on anime images. Look on Twitter or Reddit for 'Big Sleep' examples using the ThisAnimeDoesNotExist.ai anime model: CLIP can generate anime images reasonably well, along with everything else it can do so well. (The 'blessings of scale', I call it: https://www.gwern.net/newsletter/2020/05#blessings-of-scale https://www.gwern.net/newsletter/2020/05#blessings-of-scale Just train on as much data as possible, and a lot of these weaknesses fix themselves.)