high entropy in information theory is as much information per unit as possible as I understand it, but I confess I had to look it up to make sure :) I think the

high entropy in information theory is as much information per unit as possible as I understand it, but I confess I had to look it up to make sure :) I think the confusion is from physics where entropy is more about disorder http://en.wikipedia.org/wiki/Entropy_%28information_theory%29 http://en.wikipedia.org/wiki/Entropy_%28information_theory%2...