4 ms·
Bayesian approaches are probably out of grasp for most small companies. They have a long way to go before being as approachable and easy as frequentist approach
by mendicantB 13y ago
Bayesian approaches are probably out of grasp for most small companies. They have a long way to go before being as approachable and easy as frequentist approaches. Schools and the statistics field as a whole need drastic reformation in introductory course offerings that are taken by everyone.
Until then, it's A/B, p value <.05, ignore bias and sample size for companies who aren't large enough to have a statistician or data scientist.
- yummyfajitas 13y agoNo they aren't. Here is a Bayesian method that is just as easy as any Frequentist one. At my last job, a completely non-technical user who didn't even understand statistical significance used it just fine [1]. http://www.bayesianwitch.com/blog/2014/bayesian_ab_test.html http://www.bayesianwitch.com/blog/2014/bayesian_ab_test.html The only cost of the Bayesian method is that the bayesian python script is thousands of times slower than the frequentist one. I didn't do benchmarks, but in terms of order of magnitude, the frequentist method might take 1 microsecond while the Bayesian method might take 1 second. [1] He used a less advanced version of the method which used a normal approximation - not that he needed to know the difference.