Granted, the need for large training set's and processing power can also be a huge limitations. I think that is exactly what bothers me about it. It's that eve

Granted, the need for large training set's and processing power can also be a huge limitations. I think that is exactly what bothers me about it. It's that everything you say would be 100% correct IF we had far, far, far more computing resources at our disposal. But since we don't, humans solving a problem actually does not take longer or cost more than training a neural net. Not if you want the neural net to be as good as the solution humans come up with. Only if you are satisfied with a very quick and dirty approximation can NNs be faster and cheaper than humans.