In my view, intelligence is an information processing problem. Neural Networks are situated in an environment to some degree. You have inputs, outputs, and then

In my view, intelligence is an information processing problem. Neural Networks are situated in an environment to some degree. You have inputs, outputs, and then some measure of error with respect to the outputs and some objective function. The objective function can be seen as a way of encoding information about the world in which the NN is producing outputs, and provides the basis for the feedback loop that is used to train the NN ( forward-propagation and backward-propagation ) and produce a representation of the world. I think these theories are great, but unless a theory makes a mathematical argument about information processing, I think they can be highly misleading and confusing. Natural language has been tripping up philosophers for a long time, and I think the lesson has been learned that we must make mathematical arguments if we ever truly wish to get to the bottom of something.