4 ms·
> If we're calculating the entropy of dice rolls (where the outcome is the 'message'), and I know the dice are loaded but you don't, my entropy will be lower th
by empath75 2y ago
> If we're calculating the entropy of dice rolls (where the outcome is the 'message'), and I know the dice are loaded but you don't, my entropy will be lower than yours.
That's got nothing to do with entropy being subjective. If 2 people are calculating any property and one of them is making a false assumption, they'll end up with a different (false) conclusion.
- glial 2y agoEntropy is based on your model of the world and every model, being a simplification and an estimate, is false.
- mitthrowaway2 2y agoWhat if I told you the dice were loaded, but I didn't tell you which face they were loaded in favor of? Then you (presumably) assign a uniform probability over one true assumption and five false assumptions. Which is the sort of situation where subjective entropy seems quite appropriate.
- canjobear 2y ago> If 2 people are calculating any property and one of them is making a false assumption, they'll end up with a different (false) conclusion. This implies that there is an objectively true conclusion. The true probability is objective.
- mitthrowaway2 2y agoOk. I rolled a die and the result was 5. What should the true objective probability have been for the outcome of that roll?