Neural networks are trained with information from the Universe. So, in my opinion, it should not be shocking at all that neural networks store some projection/m

Neural networks are trained with information from the Universe. So, in my opinion, it should not be shocking at all that neural networks store some projection/model/echo of the universe (e.g. physical laws, maths, etc.).