4 ms·
> higher entropy How so? The entropy looks (dangerously) low to me.
by Koshkin 8y ago
> higher entropy
How so? The entropy looks (dangerously) low to me.
- StavrosK 8y agoHigh entropy = very low margin for error. "aaaaaaaaaaaaaaaaaaaaaaaa" is low entropy, "JkjgpUBn74AREExy" is high.
- deleted 8y ago[deleted]
- Koshkin 8y agoWell I guess I am more used to the physicist’s definition of entropy, which can be described as “the higher the entropy, the less we care about the details.”
- StavrosK 8y agoVery possibly, but, as far as I know, in the information-theoretic sense (which is what we mean when we talk about alphabets and conflating one letter for another) it's "high entropy" = "low redundancy".