I agree, I've seen someone go as far as calling DNN's "just a big backpropagated multilayer perceptron, with absurd ammounts of neurons and layers, enabled only

I agree, I've seen someone go as far as calling DNN's "just a big backpropagated multilayer perceptron, with absurd ammounts of neurons and layers, enabled only by the processing power of GPUs". It's way too simplified, but I did see the point behind the argument.