3 ms·
I've written a few articles about Entropy (I'm a physicist working in DS). Almost all of them have Python code to illustrate concepts. - 1. Entropy of a fair
by Maro 2y ago
I've written a few articles about Entropy (I'm a physicist working in DS).
Almost all of them have Python code to illustrate concepts.
-
1. Entropy of a fair coin toss - https://bytepawn.com/what-is-the-entropy-of-a-fair-coin-toss.html https://bytepawn.com/what-is-the-entropy-of-a-fair-coin-toss...
2. Cross entropy, joint entropy, conditional entropy and relative entropy - https://bytepawn.com/cross-entropy-joint-entropy-conditional-entropy-and-relative-entropy.html https://bytepawn.com/cross-entropy-joint-entropy-conditional...
3. Entropy in Data Science - https://bytepawn.com/entropy-in-data-science.html https://bytepawn.com/entropy-in-data-science.html
4. Entropy of a [monoatomic] ideal gas with coarse-graining - https://bytepawn.com/entropy-of-an-ideal-gas-with-coarse-graining.html https://bytepawn.com/entropy-of-an-ideal-gas-with-coarse-gra...
5. All entropy related posts - https://bytepawn.com/tag/entropy.html https://bytepawn.com/tag/entropy.html
- dr_dshiv 2y agoWhat’s the difference between information entropy and physical entropy?