E. T. Jaynes gave some very good answers (symmetry groups and maximum entropy principle). You should read "Probability Theory: The Logic Of Science". In it, y

E. T. Jaynes gave some very good answers (symmetry groups and maximum entropy principle). You should read "Probability Theory: The Logic Of Science". In it, you will learn that the supposed "hole" has been closed pretty nicely.