3 ms·
Mechanisms and rules are the problem, not the solution. The reason we got the reproducibility crisis in the first place is because too many people believe in ru
by jltsiren 4y ago
Mechanisms and rules are the problem, not the solution. The reason we got the reproducibility crisis in the first place is because too many people believe in rules. They believe that if you discover something by following the accepted rules of science, you have a scientific result.
But when you have a system, you always have people gaming it. People who believe that it's ok to bend the rules a bit. People who believe it's ok to break them, as long as you don't get caught. If you don't get caught, people who believe in the rules are inclined to accept your results, as you followed the rules.
By changing the rules, you deal with specific symptoms, but the underlying problem remains. The people gaming the system always win in the end.
And sometimes the rules are simply insufficient.
When science works, it works because people go beyond the rules. It works because people are skeptical of their own ideas and willing to show their best efforts to test them. You can't cultivate attitudes like that with rules and regulations.