4 ms·
What was Minsky's result?
by l33t2328 5y ago
What was Minsky's result?
- erikerikson 5y agoThis [0] is probably a reasonable overview though I didn't read it thoroughly, it was on the right track. Basically that Hopfield networks couldn't learn XOR. The significance is that it moved us away from biologically plausible networks and precipitated back propagation which was the dominant learning paradigm in neural networks and mostly remains so. [0] https://alan.do/minskys-and-or-theorem-a-single-perceptron-s-limitations-490c63a02e9f https://alan.do/minskys-and-or-theorem-a-single-perceptron-s...
- erikerikson 5y agoThe problem with XOR is that you need a line with dimension N, where N is the number of distinct inputs to the XOR, to separate true from false in the truth space. What I demonstrated was up to 6 dimensional XOR functions being learned in Hopfield networks using Hebbian learning with an additional learning term. I ran a "wave of learning" over the network modifying that terms. In a sense it is a layer free network because no explicit later exists but in another sense the modulation provided a transient layers since the learning term caused different parts of the network to learn at different times out of sync with one another.
- ad404b8a372f2b9 5y agoCould you share a link to your work? I'd love to read more about it.
- erikerikson 5y agoIt's rather dated but my dissertation is saved for posterity [0] and includes references and old Octave code. [0] https://drive.google.com/file/d/1R4mS_4vzf5mycQez76O_mmpQDpT3DiZz/view?usp=drivesdk https://drive.google.com/file/d/1R4mS_4vzf5mycQez76O_mmpQDpT...
- ad404b8a372f2b9 5y agoThank you!