Another neat approach to dealing with multiple comparisons is Bayesian hierarchical models. Instead of correcting significance thresholds after the fact, all co

Another neat approach to dealing with multiple comparisons is Bayesian hierarchical models. Instead of correcting significance thresholds after the fact, all comparisons are represented as parameters in the model from the start. You would still need to 'preregister' segments as you suggest. See Gelman's paper, http://www.stat.columbia.edu/~gelman/research/unpublished/multiple2.pdf http://www.stat.columbia.edu/~gelman/research/unpublished/mu...