4 ms·
Spin glasses are a proposed model of learning in Neural Nets[0] along with state changes and sand pile collapses. So this paper is worth reading if you study l
by deepnet 2y ago
Spin glasses are a proposed model of learning in Neural Nets[0] along with state changes and sand pile collapses.
So this paper is worth reading if you study learning in neural nets
[0] Spin-glass models of neural networks Amit et al 1985
https://journals.aps.org/pra/abstract/10.1103/PhysRevA.32.1007 https://journals.aps.org/pra/abstract/10.1103/PhysRevA.32.10...
This was why Hopfield was awarded a physics Nobel - spin glasses as emergent learning.
Along with Expected Energy of Brownian motion in gases for Hinton’s Boltzmann Machines ( and of course backprop being Newtonian downhill on the manifold of correctness ).
Langland’s worthy crossovers and the utility of the generalisation.