4 ms·
This is very well explained, even if you don't understand statistics. Apparently not many vendors of A/B testing software do.
by godDLL 10y ago
This is very well explained, even if you don't understand statistics. Apparently not many vendors of A/B testing software do.
- iaw 10y agoI suspect the people building it do, the people selling it probably do not.
- CalRobert 10y agoHaving worked between customers and engineering at a place that did this, I can confirm that "our tests are Bayesian!!" was a refrain everyone was taught to repeat, but few if any were taught what it meant. This video is helpful: https://www.youtube.com/watch?v=Dy_LRK2Pkig https://www.youtube.com/watch?v=Dy_LRK2Pkig I still don't know a great way to describe it in the 6 or 7 seconds you have before the potential customer's attention starts to flag.
- iaw 10y ago> I still don't know a great way to describe it in the 6 or 7 seconds you have before the potential customer's attention starts to flag. I don't think there is a 6-7 second way to describe it. I mean, imagine someone that knows nothing of frequentist statistics, could you explain the meaning/significance of a confidence interval to them? It's a pretty high bar to clear, I've found for CI's it's typically 1-5 minutes depending on background.