3 ms·
Relate it to free energy minimization, that's very hot right now. Read Smolensky's 1986 article in PDP on the harmonium, it was the first restricted boltzmann m
by dr_dshiv 6y ago
Relate it to free energy minimization, that's very hot right now. Read Smolensky's 1986 article in PDP on the harmonium, it was the first restricted boltzmann machine.
- canjobear 6y agoDon't most neural networks already do free energy minimization? Just about any information theoretic objective can be interpreted that way...
- dr_dshiv 6y agoYes, that's arguably the dominant paradigm. It's interesting because of the relationship to thermodynamics -- again, check out Smolensky's paper in PDP, he was a postdoc (along with Geoff Hinton) at UCSD's cognitive science dept, run by Don Norman. https://apps.dtic.mil/sti/pdfs/ADA620727.pdf https://apps.dtic.mil/sti/pdfs/ADA620727.pdf
- eli_gottlieb 6y ago>Relate it to free energy minimization, that's very hot right now. It is? I didn't see that buzzword very much at NeurIPS this year.