Uhm.. no. What is special today about deep learning is the hierarchy of features. Yes, we are talking primarily about CNN's and RNN's trained with SGD TODAY. Ye

Uhm.. no. What is special today about deep learning is the hierarchy of features. Yes, we are talking primarily about CNN's and RNN's trained with SGD TODAY. Yes,the entire catalog of ML techniques are still very interesting. Yes, in the future many of these techniques will be viable in a deep setting. But, no, you don't just get state of the art results by using linear regression or HOG and SIFT SVM's on a big data set. Hierarchy of features is important.