Not the above poster, but I concur, and recommend Jaynes' "Probability: the logic of science" for the philosophy and history, and "Breakthroughs in statistics"

Not the above poster, but I concur, and recommend Jaynes' "Probability: the logic of science" for the philosophy and history, and "Breakthroughs in statistics" volumes 1 and 2 for the history as told through original foundational papers, from the 1700s on.