35 ms·
Statistical mechanical (Boltzmann) entropy and informational (Shannon) entropy are not the same thing, but they are closely related. Subtleties are important.
by andbberger 6y ago
Statistical mechanical (Boltzmann) entropy and informational (Shannon) entropy are not the same thing, but they are closely related. Subtleties are important.
The Shannon entropy of the distribution of the positions and velocities is precisely the Boltzmann entropy of the same, but there is no statistical mechanical analog to the Shannon entropy of a (non-Boltzmann) distribution, to my knowledge.
- kgwgk 6y ago> Statistical mechanical (Boltzmann) entropy While Boltzmann entropy was first, and an important breakthrough, it has some limitations. Statistical mechanics is actually based on Gibbs/von Neumann entropy, which is equivalent to Shannon entropy. There are many subtleties indeed but I think the relationship between statistical mechanics and information theory may be closer than you think.