You make a large mistake here. I feel that the only way your argument holds is by assuming its conclusion. Which would be: what is going on in [some/most] of ou

You make a large mistake here. I feel that the only way your argument holds is by assuming its conclusion. Which would be: what is going on in [some/most] of our brain is something more than or very different from 'just' statistical inference and optimization. Right now, we don't know whether this is true or not but more people are beginning to think not. For example let us consider that based on time of day and knock you can guess who is most likely at your door. How why, can you know this? Have you learned or figured out anything there? Or say, I tell you that a person is of gender X, race Y and lives in city Z. You will automatically generate an idea of what this person is like. And it will be different from what I would generate and these data points would likely mean nothing of significance to a 3 year old. Why? Because we have learned a model from our past experience/data. Machine Learning also uses generative models to infer situations. And in fact, we humans perform a very weak form of machine learning. It goes by the name of stereotyping or profiling. When you are trying to figure out something. The process is not some clean logical step by step deduction. It is more like a search with dead ends (local optimums), back tracking and restarts. Trying and throwing away different ideas. Or when trying to learn a new sport, dance or flip. You do not consider the physics of the situations to try and figure amount the correct amount of impulses to apply. You try again and again to learn or statistically generate a satisfactory approximate local optimum of the correct physics model for the situation at hand. As for systems which generate code. We can look at it most literally in terms of those which evolve rules in some way or loosely by considering that all machine learning does is use lots of data to prevent the programmer from hand coding a giant restricted system. Regardless of your stance, these systems differ from mere rewriting in that they are not deterministic. They interact and respond to different situations in varying ways. The more sophisticated methods can develop new algorithms - a set of rules - that were not programmed and make no sense to the developer to develop behaviours to cope with their situations. It is true that we provide a base, but that does not mean some limited form of learning is not occurring. What Machine learning cannot do that we can is introspect, abstract and generalize across domains. I am the reverse of you. Before I picked up machine learning I thought the brain was something special. But now I cant help but feel that we are just clever marionettes and that whats going on is simply mundane mathematics by clever co-opting of physics by nature. I find this fact to be amazingly beautiful.