To be fair I was at a one of his talks a few years ago and he was arguing exactly for the type of training he is mentioning in the tweet. The lecture in which

To be fair I was at a one of his talks a few years ago and he was arguing exactly for the type of training he is mentioning in the tweet. The lecture in which he mentioned it is this one: https://memento.epfl.ch/event/campus-lecture-yann-lecun/ https://memento.epfl.ch/event/campus-lecture-yann-lecun/ Comparing with Schmidthuber is a bit strange too, he claims everybody is doing it.