> We just took this idea to its logical extreme: What if we _define_ a deep net as a continuously evolving system? What about symmetries of the underlying cont

> We just took this idea to its logical extreme: What if we _define_ a deep net as a continuously evolving system? What about symmetries of the underlying continuous system? I'm under the impression that having deep nets as ODEs should make it possible to enforce a certain geometry on the information flow (like incompressible fluid, Hamiltonian, etc..) which would correspond to some invariant of the whole network. Does this idea make sense?