Depending on the implementation of "assign visitors into buckets randomly", this should include a test to ensure the populations are correctly randomized. "Uns

Depending on the implementation of "assign visitors into buckets randomly", this should include a test to ensure the populations are correctly randomized. "Unsophisticated" users of these heuristics are prone to make terrible decisions if the treatment populations are not properly randomized (this can be due to systemic bias caused by e.g. caching, or treatment effects like survival bias).