Indeed, the idea of information (bits) as entropy is fascinating to me too. And not just Shannon entropy, they're all related somehow. See https://en.wikipedia.

Indeed, the idea of information (bits) as entropy is fascinating to me too. And not just Shannon entropy, they're all related somehow. See https://en.wikipedia.org/wiki/Bekenstein_bound https://en.wikipedia.org/wiki/Bekenstein_bound And then there is the fact that life encodes and persists information. There was a recent HN thread that got me interested: https://news.ycombinator.com/item?id=13496133 https://news.ycombinator.com/item?id=13496133 I did read Gleick's "The Information" but was disappointed it didn't dig very deep into the concept. I got further following links on Wikipedia.