And it's not just like people found these probabilities and then decided to stop trying to explain things and said "what if these are just how physics worked".

And it's not just like people found these probabilities and then decided to stop trying to explain things and said "what if these are just how physics worked". Instead, people found that any attempts at removing the probabilities (through local hidden variable theories) ended in contradictions, and then accepted that they must be fundamental.