4 ms·
This is philosophically interesting, but little of this really is about _running_ a good experiment. Perhaps it's about choosing which ones to run? Kohavi's b
by mwexler 7y ago
This is philosophically interesting, but little of this really is about _running_ a good experiment. Perhaps it's about choosing which ones to run?
Kohavi's book will probably provide much more value than this kind of abstract post. See https://experimentguide.com/ https://experimentguide.com/ for more details.
- tantalor 7y agoThis bit is crucial for running a good experiment: > Good experiments use tight exposure groups Not all your users will have the conditions necessary for the experimental treatment. You should only look at changes in behavior where the treatment condition was true. Otherwise your experimental effect is diluted. But your comparison between experiment and control groups must be neutral on the condition, that is, users in the control group would have seen the treatment if they were in the experiment group (counterfactual).