For dice the ensemble average is the time-average: if you roll the dice 1000 times the probability of getting a different result doesn't change. For almost eve

For dice the ensemble average is the time-average: if you roll the dice 1000 times the probability of getting a different result doesn't change. For almost everything in the world, action on it, changes it. There are vanishingly few areas where this isn't the case (most physics, most chemistry, etc.). Imagine trying to do statistics but every time you sampled from reality the distribution of your sample changes not due to randomness, but because reality has changed. Now, can you do statistics? No. It makes all the difference in the world to have a body and hold the thing you're studying. Statistics is trying to guess the shape of the ice cube from the puddle; animal learning is making ice cubes.