I don't think that's what they meant. I interpreted it to mean: neural networks are not trained in a continuous online manner. That said, there are neural netw

I don't think that's what they meant. I interpreted it to mean: neural networks are not trained in a continuous online manner. That said, there are neural network architectures which have state, such as recurrent neural networks, time-delay neural networks, and long short-term memory. However, the state is used for covering problem domains with a temporal nature, rather than for reflective learning. It's typically reset between different inputs.