>>>>Employees teach new recruits to use tools for comparing the performance of one version of a feature with another and how to determine what sort of differenc

>>>>Employees teach new recruits to use tools for comparing the performance of one version of a feature with another and how to determine what sort of difference in response is meaningful.>>>>> I hate when people use statistical significance to determine what is meaningful. People wrongfully think you need 95% confidence in the data to make a decision and move forward with a feature change, etc. For me when I am changing things on my site based on data mining, I will make a decision with a 60% confidence (which can come within 5-10 samples in most cases). Hacking websites is engineering not science! Overall it makes sense to trade a low confidence value for speed of development.