NNs are clever, but what they do is essentially reverse programming. Rather than you write a function that translates a -> b, you give it a -> b mappings and th

NNs are clever, but what they do is essentially reverse programming. Rather than you write a function that translates a -> b, you give it a -> b mappings and the training writes the function. What GP was saying is something that most programmers should already know: that writing the function is usually the easy bit, and the hard bit is defining and then modelling the problem; NNs can't do that.