All this means is that statistical significance is not enough to reject anything. All statistical significance means is that the effect did not come from sampli

All this means is that statistical significance is not enough to reject anything. All statistical significance means is that the effect did not come from sampling error. It can come from any number of other confounders still. Statistical significance is a hint that it could be worth running more replication studies, and vary the conditions in other studies. Significance alone does not indicate the effect as real.