Yes it's not my summary. I originally learned about the family tree example from a lecture by Geoffrey Hinton. Found some lecture slides here which reference th

Yes it's not my summary. I originally learned about the family tree example from a lecture by Geoffrey Hinton. Found some lecture slides here which reference the example but can't find the original lecture right now. https://www.cs.toronto.edu/~hinton/coursera/lecture4/lec4.pdf https://www.cs.toronto.edu/~hinton/coursera/lecture4/lec4.pd... > No one claims linear models perform reasoning. Why are you proposing that this 3 layer (read, 3 matrix multiplies) is doing reasoning? A 3 layer neural network is a non-linear function. It is not a linear model. There are activation functions between the layers which make it non-linear.