[I'm one of the co-founders of Optimizely] Hi Eliezer, thanks very much for your thoughts--these are great. You're absolutely right that classical p-values ar

[I'm one of the co-founders of Optimizely] Hi Eliezer, thanks very much for your thoughts--these are great. You're absolutely right that classical p-values are not without their shortcomings, which can be significant when misused! A Bayesian approach would address some of these shortcomings, but would also introduce other hurdles, like generalizing the selection of a prior distribution and, more importantly, (IMHO,) distilling likelihood ratios in a way that can be quickly grasped by someone with no formal stats/math background. In simpler terms, classical statistics is not perfect, but in most cases it provides a lot of useful information in an easy-to-grasp way. That said, we've started looking more seriously at incorporating Bayesian techniques into our interface and would love to get your thoughts on great ways to communicate these concepts to our customers. I've reached out to you directly off-thread and would love chat further!