4 ms·

No, the interesting thing about Shannon entropy is that it is totally independent of how information is represented (as symbols, alphabets, numbers, structured

No, the interesting thing about Shannon entropy is that it is totally independent of how information is represented (as symbols, alphabets, numbers, structured objects, whatever).

dr_dshiv 5y ago
It is based on the symbol set exchanged, so how is it independent?
- canjobear 5y ago
  Information is a function only of the probabilities, not of the symbols.