3 ms·
There was once a neural network that used dreaming phases for regularisation. It would run in reverse on random data and whatever activated was down–weighted.
by direwolf20 9mo ago
There was once a neural network that used dreaming phases for regularisation. It would run in reverse on random data and whatever activated was down–weighted.
- ericdfoley 9mo agoThat's the wake sleep algorithm for undirected graphical models. Hinton had a course on Coursera around 2015 that covered a lot of pre NN deep learning. Sadly I don't think it's up anymore.
- petethomas 9mo agoThere is this with a 2012 date: https://www.youtube.com/playlist?list=PLoRl3Ht4JOcdU872GhiYWf6jwrk_SNhz9 https://www.youtube.com/playlist?list=PLoRl3Ht4JOcdU872GhiYW...