4 ms·

If it is shallow than maybe it should not be called deep? :)

• jxub 9y ago
  Still, this observation might be not deep enough for the hn folks ;p
• giardini 9y ago
  In any case Hinton's use of the word "deep" was an excellent one from a marketing perspective: " In 2006, a publication by Geoff Hinton, Osindero and Teh[26][27] showed how a many-layered feedforward neural network could be effectively pre-trained one layer at a time, treating each layer in turn as an unsupervised restricted Boltzmann machine, then fine-tuning it using supervised backpropagation.[28] The paper referred to learning for deep belief nets." Perhaps this usage ("deep belief networks") was too effective, as so many marketing terms prove to be. Hinton is likely well-aware of the importance of terminology that captures the imagination of the public (and the marketplace for research).