4 ms·
How does the system react to stylised images, e.g. a photo with a cartoon effect or even a hand-drawn stick figure?
by 3rd3 12y ago
How does the system react to stylised images, e.g. a photo with a cartoon effect or even a hand-drawn stick figure?
- karpathy 12y agoAs is usually the case with Machine Learning, its reactions are whatever the training data says they should be, or mostly undefined otherwise. For example, if there is some picture in the training data of a cartoon and it says "cartoon of donald duck", then you can expect to see something of that type in the predictions. If there are no cartoon images in the training data whatsoever and you show it one, you will get a funny result and have a good laugh. At best, you'll have an "I can kind of see it if I squint my eyes a bit" result. At worst, it will say it's a cat.
- oh_sigh 12y agoProbably not well, but it's hard to say. One way of getting around this would be to train the NN on not just the input training set, but also on certain permutations of each image in the training set. So don't just train it on set(image -> labels), but also set(cartoonize(image) -> labels), set(smooth_filter(image) -> labels). This may make the NN more resilient.