3 ms·
When defining statistical entropy in his Cambridge lecture course on Coding and Cryptography, Thomas Korner adds the following footnote: "It is unwise for the
by n4r9 5y ago
When defining statistical entropy in his Cambridge lecture course on Coding and Cryptography, Thomas Korner adds the following footnote:
"It is unwise for the beginner and may or may not be fruitless for the expert to seek a
link with entropy in physics."
https://www.dpmms.cam.ac.uk/~twk/Shan.pdf https://www.dpmms.cam.ac.uk/~twk/Shan.pdf
- sudosysgen 5y agoDoes Landauer's principle not already create a very strong link between the two? https://en.wikipedia.org/wiki/Landauer%27s_principle https://en.wikipedia.org/wiki/Landauer%27s_principle It even predicts a direct equivalence between the unit of bit and Joules per Kelvin with the entropy produced in the erasure of a bit being equal to 9.6e-24 J/K Unless I'm making some mistake, you can even use computer science principles combined with Landauer's limit to solve Maxwell's Demon.
- kgwgk 5y agoThe link was established quite early and it wasn’t fruitless: https://bayes.wustl.edu/etj/articles/theory.1.pdf https://bayes.wustl.edu/etj/articles/theory.1.pdf