Information entropy is formally defined in terms of probability. Are you implying that some sort of inverse is possible and probability can de derived in terms

Information entropy is formally defined in terms of probability. Are you implying that some sort of inverse is possible and probability can de derived in terms of entropy? Could you write or cite what the formula would be in this case? It appears to me that the formula for entropy itself recursively suffers from rising entropy. Thus you cannot reverse it... You cannot derive individual probabilities of each state from just entropy. Source: https://en.wikipedia.org/wiki/Entropy_(information_theory) https://en.wikipedia.org/wiki/Entropy_(information_theory) (in terms of the mathematical formula from Wikipedia, by saying you can't reverse it, I am saying that no individual P(xi) can be determined when you are just given H(X) as an input) Thus because of the reasoning above, probability must be the axiomatic source of entropy. It makes sense intuitively. Entropy is the macro phenomenon arising from the micro phenomenon of probability. The law of numerically higher probability events being more likely to occur then numerically lower probability events when following the arrow of time is the more fundamental explanation of what's going on here. Entropy is simply a macro numerical summary of these probabilistic events happening in aggregate.