> Statistical mechanical (Boltzmann) entropy While Boltzmann entropy was first, and an important breakthrough, it has some limitations. Statistical mechanics i

> Statistical mechanical (Boltzmann) entropy While Boltzmann entropy was first, and an important breakthrough, it has some limitations. Statistical mechanics is actually based on Gibbs/von Neumann entropy, which is equivalent to Shannon entropy. There are many subtleties indeed but I think the relationship between statistical mechanics and information theory may be closer than you think.