Exam is interpolation. Research is extrapolation. Neural networks are interpolators, they are notoriously bad at extrapolation. For simple example, look at pe

Exam is interpolation. Research is extrapolation. Neural networks are interpolators, they are notoriously bad at extrapolation. For simple example, look at pendigits data set [1]. The test part of pendigits is taken from different "writers" than train part and neural networks aren't that good at it. [1] https://archive.ics.uci.edu/dataset/81/pen+based+recognition+of+handwritten+digits https://archive.ics.uci.edu/dataset/81/pen+based+recognition... Humans do extrapolation all the time.