I would add "Practical recommendations for gradient-based training of deep architectures" to the list for those who already have a feel for training multi-layer

I would add "Practical recommendations for gradient-based training of deep architectures" to the list for those who already have a feel for training multi-layer neural nets. It provides a good overview for those that want to learn more about gradient descent, hyperparameter tuning, and other practical considerations involved with training deep architectures. http://arxiv.org/abs/1206.5533 http://arxiv.org/abs/1206.5533