3 ms·
While I do not have anything invested in Deep Learning, I do have a similar reaction because I am familiar with the research from 10-20 years ago, particularly
by jandrewrogers 11y ago
While I do not have anything invested in Deep Learning, I do have a similar reaction because I am familiar with the research from 10-20 years ago, particularly around neural Turing machines. From that perspective, most modern Deep Learning is essentially that older research with the primary novelty being better marketing and much faster computers. I can understand why someone like Schmidhuber would be irritated by the apparent assignment of credit to people who are essentially repackaging old computer science, given how much Schmidhuber has done in the field.
DeepMind is a bit of an exception to this. At least one of the founders was involved in quite a bit of original research way back then.
This phenomenon is common in theoretical computer science. Timing and marketing matter a lot when it comes to getting credit for important inventions. I've seen it many times.
- sitkack 11y agoI go on the cite rant now and then again. It isn't so much for the attribution itself, but that it breaks the knowledge graph. By not citing past or similar work, these researchers prevent others from learning, exploring and ingesting knowledge from a field. A few of the ideas at play here are: * Wanting to appear more cutting edge than is actually the case * Limiting or strengthening patent applicability * Preventing loss of focus via competitors research I think researchers should actually get penalized for having a deficient bib.