A/B testing shouldn't be just for customers. We could have gates that have a random bypass. Have a 10% chance that the gate must be bypassed for this iteration

A/B testing shouldn't be just for customers. We could have gates that have a random bypass. Have a 10% chance that the gate must be bypassed for this iteration. Did any of the bad things that happened cost more that the gate? No? Gate goes away.