For the non-Bayesians, here's a paper that explains in detail one of the strongest criticisms of null hypothesis testing, by bayesian John Kruschke: http://www

For the non-Bayesians, here's a paper that explains in detail one of the strongest criticisms of null hypothesis testing, by bayesian John Kruschke: http://www.indiana.edu/~kruschke/articles/Kruschke2011PoPS.pdf http://www.indiana.edu/~kruschke/articles/Kruschke2011PoPS.p... To summarize, an experimenter's internal mental state (intentions) can affect the t statistic. That is: not changing the experiment at all, but just thinking something different -- gives a different level of significance. In Kruschke's words: voo-doo.