3 ms·
Don't most neural networks already do free energy minimization? Just about any information theoretic objective can be interpreted that way...
by canjobear 6y ago
Don't most neural networks already do free energy minimization? Just about any information theoretic objective can be interpreted that way...
- dr_dshiv 6y agoYes, that's arguably the dominant paradigm. It's interesting because of the relationship to thermodynamics -- again, check out Smolensky's paper in PDP, he was a postdoc (along with Geoff Hinton) at UCSD's cognitive science dept, run by Don Norman. https://apps.dtic.mil/sti/pdfs/ADA620727.pdf https://apps.dtic.mil/sti/pdfs/ADA620727.pdf