> My takeaway from this is that it isn't worthwhile to do very small tests, but it is possible to get reliable results when doing fewer, bigger changes. Yup, t

> My takeaway from this is that it isn't worthwhile to do very small tests, but it is possible to get reliable results when doing fewer, bigger changes. Yup, that is right. If you have less traffic, testing for drastic, bigger changes will definitely give you statistically significant differences (either positive or negative). In fact, even the bigger sites can choose to include just a fraction of their traffic (say 2%) and then test for dramatically different designs/callouts/etc.