Why are you responding to only parts of comments and ignoring the context around it? It just makes it look like strawmen arguments. > Can learn arbitrary funct

Why are you responding to only parts of comments and ignoring the context around it? It just makes it look like strawmen arguments. > Can learn arbitrary functions says nothing about efficiency or any practical considerations. This is absolutely true. A turing machine can perform any computation, but they are not really practical for anything outside of an academic exercise. > A vanilla neural network can't learn a sine function or anything periodic, for inputs outside the range of the training data. This is also true. A vanilla neural network isn't that useful outside of very basic tasks with a lot of training data. It's only when you start changing their shapes and using specialized techniques to fit the problem that they become practical. Even a simple task like classifying MNIST digits is done far more efficiently using a basic CNN than a vanilla NN.