Absolutely true, but this is more a criticism of experiment design than statistical methodology. Also it is bias in uncontrolled variables that is most concern

Absolutely true, but this is more a criticism of experiment design than statistical methodology. Also it is bias in uncontrolled variables that is most concerning. (More than uncontrolled noise although that will reduce the power to detect real differences).