4 ms·
Maybe I'm wrong, but doesn't entropy in an information source mean there's _more_ information rather than less ?
by worldimperator 15y ago
Maybe I'm wrong, but doesn't entropy in an information source mean there's _more_ information rather than less ?
- Nick_C 15y agoNo, assuming you mean high entropy. (You need a qualifier with "entropy", e.g. high or low.) Roughly, high entropy means disorder, information means order: http://en.wikipedia.org/wiki/Entropy_(statistical_views) http://en.wikipedia.org/wiki/Entropy_(statistical_views) Look at the coin toss example.