Just to note, there's a tradeoff here - not publishing work until you are massively certain of it would also cause real life harm. Reducing the p value doesn't

Just to note, there's a tradeoff here - not publishing work until you are massively certain of it would also cause real life harm. Reducing the p value doesn't automatically reduce harm. Physicists require extremely low values before confirming a discovery has been made, but that's different from requiring it before publishing. The problem is with people interpreting published work as if once its published, its completely certain. Maybe each publication should come with a headline 'confidence' stat beside the title. I guess this is a step in that direction.