2 ms·
I think statistical significance is the more important thing in a/b testing, but they only included links to external sources. It's hard to tell the difference
by oscardelben 16y ago
I think statistical significance is the more important thing in a/b testing, but they only included links to external sources. It's hard to tell the difference between coincidence and real difference between two versions when changing simple things like button colors and I still feel ignorant about the subject.
- paraschopra 16y agoDo you think external sources weren't enough? Main statistical tools used for A/B testing are G-Test, Chi-Square test and Z-test (after assuming sum of binomial variables as normal distribution).
- oscardelben 16y agoWhat I was trying to say is that in a "definitive guide" about ab testing I would expect to find some of it. You've done a great job linking all the external resources, and I probably couldn't have done it better, but I'd personally have appreciated more about statistical significance so that I could have understood the links you have included better.
- paraschopra 16y agoSure, point well taken. My only fear was that discussing statistical significance may have made the article a bit intimidating but yes, if I were to call it "ultimate guide", I should have discussed it.