I believe that in this system, "deep neural network" just means a regular feed-forward network that has a larger number of hidden layers. There is a relationshi

I believe that in this system, "deep neural network" just means a regular feed-forward network that has a larger number of hidden layers. There is a relationship to DBNs though, because they initialize the weights of the neural net by doing unsupervised pre-training with a set of DBNs.