4 ms·
Your prediction that DNNs will replace much of the pipeline is very interesting to me, but I hypothesize that you're at least partially wrong. I predict that DN
by kylebgorman 12y ago
Your prediction that DNNs will replace much of the pipeline is very interesting to me, but I hypothesize that you're at least partially wrong. I predict that DNNs will impact early stages of the pipeline which operate on continuously valued inputs, but I am skeptical that that DNNs will ultimately be the best solution for late discrete processing (e.g., decoding, language modeling). That DNNs ever perform well in discrete classification tasks just tells me we haven't spent enough time feature-engineering.
- modeless 12y agoIt's the ability of DNNs to replace feature engineering that makes them interesting. They have completely obsoleted feature engineering in object recognition in just a few short years. Have you seen the latest DNN results in translation and image captioning? I think DNNs are quickly going to surpass the state of the art in language modeling.