This insight translates readily into machine learning in the form of "inductive bias". It is rare that I come across a model whose architecture actually bakes i

This insight translates readily into machine learning in the form of "inductive bias". It is rare that I come across a model whose architecture actually bakes in the functional form (i.e. topologies and constraints) of the system being modeled. Forcing models to relearn what should be baked-in domain experience is the most common way to waste energy and training time and bloat your models' parameter count.