Yep. Experiments in "rationality" and "irrationality" usually seem to rely on the experimenter rigging up an experimentally normative behavior (a "right answer

Yep. Experiments in "rationality" and "irrationality" usually seem to rely on the experimenter rigging up an experimentally normative behavior (a "right answer") which differs, often dramatically, from the ecologically normative behavior (the correct way to act in the subjects' everyday lives). The experimenter then gets to publish an "interesting" paper showing that very clever people behave "wrongly" because they didn't leap to what were actually quite improbable interpretations of events (if you hadn't seen the experiment before). It makes it sound a lot like the Hollow-Face Illusion (https://en.wikipedia.org/wiki/Hollow-Face_illusion https://en.wikipedia.org/wiki/Hollow-Face_illusion), which we are subject to precisely because our expectations accurately reflect normal life. We need more experiments on rationality in which the "irrational" behavior is guaranteed not to be Bayes-optimal when given a previous human life.