The flaw is more fundamental than that. By testing the confidence each time, you run the risk of vastly overestimating the true significance of your tests. A p

The flaw is more fundamental than that. By testing the confidence each time, you run the risk of vastly overestimating the true significance of your tests. A previous discussion of this exact problem: http://news.ycombinator.com/item?id=2368825 http://news.ycombinator.com/item?id=2368825