4 ms·
I got the impression from the article that their experiment had very little planning from the statement about it being to prove it was good and then celebrate.
by kaliblack 14y ago
I got the impression from the article that their experiment had very little planning from the statement about it being to prove it was good and then celebrate. This probably means it was a straight X% of traffic A/B test and the results were only analysed deeply when it wasn't a positive result. This is speculation only based on the tone of the article.
- danso 14y agoThis is the tongue-in-cheek slide that McKinley used: http://image.slidesharecdn.com/continuous-experimentation-121202174027-phpapp02/95/slide-29-1024.jpg?1354491839 http://image.slidesharecdn.com/continuous-experimentation-12... I didn't rewatch the entire presentation but McKinley does discuss the user makeup in the experimental groups...yes they do account for different kinds of users, and the most drastic difference between user behavior are between sellers and non-sellers. Someone from Etsy would have to talk about how much slicing-and-dicing of the demographic that they do...but even if infinite scroll was good for some users (new users without pagination-related habits) and not for others, it's probably not a good idea to have two kinds of search experience in the hopes that the "oldies" eventually figure it out...based solely on how hard it is to implement infinite-scroll in the technical sense.
- mcfunley 14y agoIt's pretty common for us to look at new vs. returning users and Etsy sellers vs. others (sellers are obviously really engaged users, and behave differently). Occasionally one group will stand out, but not in this case.