3 ms·
This is not true. Consider the two sequences: 1 2 3 4 5 6 And 6 4 6 3 8 2 Do these sequences really have equivalent entropy? Welcome to algorithmic informa
by deepnotderp 6y ago
This is not true.
Consider the two sequences:
1 2 3 4 5 6
And
6 4 6 3 8 2
Do these sequences really have equivalent entropy? Welcome to algorithmic information theory :)
- lisper 6y agoYour example is vacuous. You cannot determine the information content of a sequence of numbers in isolation. You can only determine information content of a system with respect to a model that tells you how to use the state of the system to distinguish between a number of possible states. The information content of the system is the log of the number of possible states from which the state of the system allows you to select one. Yes, algorithmic information theory is a thing. But neither it nor your example refute what I said (because what I said is in fact true).
- Dylan16807 6y agoIf they're that short, they basically do, to be honest.