3 ms·
It's worth thinking about incentives from the standpoint of feedback control theory. Typically, you have an input, an output, a measurement of the output, and a
by Animats 2mo ago
It's worth thinking about incentives from the standpoint of feedback control theory. Typically, you have an input, an output, a measurement of the output, and an output goal. There is some lag between the input and the output, and there may be lag between the output and the measurement of the output used to drive the controller.
The output will oscillate somewhat, more if there is more lag. Too much lag will result in oscillation so bad that convergence never happens. Much of classic control theory is devoted to understanding when that will happen and what to do about it.
Incentive systems often suffer from error and excessive lag between the output and the measurement of the output. This is a known problem in quality control. See Deming, the Toyota Production System, and continuous improvement. Even if you're measuring the desired output in a reasonable way, lag in that measurement will cause oscillation, and may prevent convergence.
School grades and work performance reviews are examples of systems with high lag between
output and the measurement of output. That happens even if the metrics are good, but not immediate.
If the measurement method is noisy, it may have to be filtered before use. This adds to lag. (Think about how a trailing moving average works.) Many incentive systems also have that property. School tests are intermittent noisy measurements filtered out by averaging.
These are known problems with incentive systems, but not well-known problems. Even if you're measuring the right thing, you can hit these problems.