Most A/B testing uses statistical tests which are readily understood by mathematically inclined high schoolers, and some of the most effective stats-based decis

Most A/B testing uses statistical tests which are readily understood by mathematically inclined high schoolers, and some of the most effective stats-based decisionmaking processes in the world are designed by arbitrarily smart people and executed by average high school graduates. For example, "Here's a two-dimensional graph where the Y axis is a measured feature of the part that just rolled off the assembly line and the X axis is the trial number. Every five minutes, pull a part off the line and put a tick mark at the appropriate place. See this red line on the graph? Two rules: a) If you ever make three ticks above it, in succession, SHUT DOWN THE LINE. b) If you ever make eight ticks above it in a shift, SHUT DOWN THE LINE. We will never under any circumstances consequence an employee for hitting the Big Red Button as a result of these two rules, but we will be most upset if the Big Red Button is not pushed when these two rules indicate it should be pushed." A particular company teaches this to, quite literally, even the people who sweep the floors in its factories.