5 ms·
This is very cool but the use of the terms "Information Entropy" together as if they were a separate thing is maybe the furthest that any "ATM-machine"-type phr
by tbalsam 2y ago
This is very cool but the use of the terms "Information Entropy" together as if they were a separate thing is maybe the furthest that any "ATM-machine"-type phrase has rustled my jimmies.
It is a cool article, just, wowzers, what a phrase.
- cobbzilla 2y agoare signal and noise the same thing?
- ClassyJacket 2y agoI mean, it's obviously not relevant here, but technically there is also heat entropy, isn't there? It's not always information.
- hughesjj 2y agoTo be fair I think information entropy is more self descriptive than Shannon entropy
- tbalsam 2y agoCorporate has asked you to find the differences between these two pictures.
- hughesjj 2y agoThey're two names which references the same concept, but Shannon entropy is not the only type of entropy. I mean maybe everything really is just Shannon entropy if you look deep enough and have a sufficiently powerful model of physics but we're not there today.
- tbalsam 2y agoI'm meaning the term "information entropy". Both of those words are generally used interchangeably to mean the same thing (to include the different forms of entropy, as I understand it. :')))) ) <3 :'))))
- hughesjj 2y agoOh, no I was talking about ex https://en.m.wikipedia.org/wiki/Entropy_(classical_thermodynamics) https://en.m.wikipedia.org/wiki/Entropy_(classical_thermodyn... There's other kinds of 'entropy' that have distinct lineages and contexts than 'information entropy', but information is kind of the basis for everything physically so if you squint a bit you can make any non-information entropy look like information entropy
- tbalsam 2y agoYes that's where the term came from. They're (effectively) the same thing as I understand it.