2 ms·
An update on Minsky's proof. It was correctly formulated but based on a too limited model. Adding location into the model allows learning XOR. I demonstrated
by erikerikson 3y ago
An update on Minsky's proof. It was correctly formulated but based on a too limited model. Adding location into the model allows learning XOR.
I demonstrated this with Hebbian learning on a Hopfield network finding learning of up to 6 dimensional XORs. This was a replication of work by Elman and reported in Rethinking Innateness[0].
A more provocative claim: layers and back propagation, despite providing us with fantastic advancements, are unnecessary.
[0] https://mitpress.mit.edu/9780262050524/rethinking-innateness/ https://mitpress.mit.edu/9780262050524/rethinking-innateness...