4 ms·
Put a rat in a box. Connect a lever to a pellet dispenser. When the rat pushes lever, it gets a food pellet. This trains the rat to push the lever. Now modify
by mikeash 11y ago
Put a rat in a box. Connect a lever to a pellet dispenser. When the rat pushes lever, it gets a food pellet. This trains the rat to push the lever.
Now modify the lever to only give a food pellet sometimes. Sometimes there's nothing. This turns out to be much more effective at getting the rat to compulsively press the lever.
Now look at the internet, and services with frequent updates like Facebook, Twitter, or even HN. Sometimes you push the lever and get a reward, and sometimes you don't, effectively training the user to compulsively check.