4-7 of these aren't so much "myths" are "ideas that one or two recent papers has cast some doubt upon." Not to say that these won't turn out to be more thorough

4-7 of these aren't so much "myths" are "ideas that one or two recent papers has cast some doubt upon." Not to say that these won't turn out to be more thoroughly debunked in the future, but it hasn't happened yet. Browsing through papers from a few years ago some of these myths in 2011 might have been: 1. You need to pre-train large networks so that they converge 2. You need GPUs to train deep networks efficiently #1 did indeed turn out to be false; pre-training has pretty convincingly been debunked. But if anything #2 turned out very right; there's no serious training happening today on CPUs. A bit of conjecture here but I suspect word embeddings are going to turn to be the next big thing that turns out not to be all that useful.