There is some amount of theory to account for this effect, but I'm not familiar enough with any of it to restate particulars. In general, the two approaches I k

There is some amount of theory to account for this effect, but I'm not familiar enough with any of it to restate particulars. In general, the two approaches I know of are to strongly favor simpler models, or to increase expected error as you develop new hypotheses. A related effect is the tendency of finite random samples to express spurious structure, which is guarded against by simply assuming the general structure of the effect.