4 ms·
I don't think it's an oversight. Shannon entropy, Von Neumann entropy and other information theory entropies are useful, but not physically fundamental in the s
by dr_dshiv 7y ago
I don't think it's an oversight. Shannon entropy, Von Neumann entropy and other information theory entropies are useful, but not physically fundamental in the sense of the second law of thermodynamics.
That said, I don't under whether Gibbs entropy or Boltzmann entropy is fundamental-- ?
- dvt 7y ago> Shannon entropy, Von Neumann entropy and other information theory entropies are useful, but not physically fundamental... I have to disagree, especially given that one of the great mysteries of our generation (the Black Hole Information Paradox) hinges on what happens to information -- sure, it's information about particles, whatever that might mean. But Jacob Bekenstein (among others) argues that Thermodynamic entropy is analogous to information (Shannon) entropy[1]. [1] http://webhome.phy.duke.edu/~mkruse/Phy255/255S06_Joyce_Coppock_bh.pdf http://webhome.phy.duke.edu/~mkruse/Phy255/255S06_Joyce_Copp...
- dr_dshiv 7y agoBut, analogous?
- hcs 7y agoI take your point, it might have been interesting to talk about how a lot of relativity and quantum mechanics can be thought of in terms of propagation and destruction of information. And for many students, talking about codes is a lot more interesting than pressure gradients in ideal gasses. A missed opportunity, perhaps.
- kgwgk 7y agohttp://backreaction.blogspot.com/2019/08/how-do-black-holes-destroy-information.html http://backreaction.blogspot.com/2019/08/how-do-black-holes-... “As you have probably noticed, I didn’t say anything about information. That’s because really the reference to information in “black hole information loss” is entirely unnecessary and just causes confusion. The problem of black hole “information loss” really has nothing to do with just exactly what you mean by information. It’s just a term that loosely speaking says you can’t tell from the final state what was the exact initial state.“
- abdullahkhalids 7y agoThis is not the consensus opinion in the physics community. Many physicists consider information as fundamental to this "paradox".
- kgwgk 7y agoRight. The other view isn’t the consensus either. I was just presenting an alternative exposition.
- jbay808 7y agoShannon / information entropy absolutely is fundamental to thermodynamics. It clears up a lot of confusion when you realize that the entropy isn't in the system itself, it's in your head (your lack of information about a system's exact state, knowing only summary statistics like its mass, volume, and temperature).
- antpls 7y agoI studied Shannon entropy like any CS student back in University, so I'm not an expert in all interpretations of Shannon entropy, but I don't think Shannon entropy tells you anything about what or how much information you are lacking about the system. It may be used to this end, but it's not what Shannon entropy directly gives you. There is no way to reduce the entropy of a totally random system by knowing more about it, unless your hypothesis is that true randomness doesn't exist in the universe
- jbay808 7y agoTo connect them, the entropy of a system (such as an ideal gas) can be computed as the logarithm of the number of equally probable microstates in your probability distribution for that system. (You need to define a sensible measure, because the state variables are continuous, but that's not important). You can express this in terms of the message length or number of bits of information you would need to gain about that container of ideal gas in order to narrow it down to a particular microstate. It's no different than the entropy of, say, a password. > There is no way to reduce the entropy of a totally random system by knowing more about it There absolutely is! For example, Maxwell's demon. Maxwell's demon will fail to reduce system entropy if it doesn't know the microstate to begin with, but otherwise it can use its knowledge to reduce the entropy of a gas by separating its parts. > unless your hypothesis is that true randomness doesn't exist in the universe I do also subscribe to this hypothesis, that like entropy, randomness also only exists in our heads as a reflection of our lack of information about a system, and isn't a property of any system itself. But I don't think I need to rely on this assumption.
- dr_dshiv 7y ago