3 ms·

The problem is that it is not everyone outside of academia. The vast majority of the world's modelling code for various values of modelling is written and "main

• Traster 6y ago
  I think the core difference is that most places outside of academia there is a closed feedback loop. You make a crap prediction, you lose a bunch of money, you get fired. There's a self-correcting mechanism for insuring the models work correctly. In academia you run your model, you write your paper, you publish your paper, you get your promotion. Because no decisions are made based on your model, there's no accountability. Even crappy excel models in business are more reliable than academic ones because people actually have to use the results- and that compounds over decades. But the impact of lots of academics generating rubbish and publishing it is that we're literally polluting our knowledge pool. Which is why it should be of as important for your code to be right as it is for your experimental method to be right.
  • Mvandenbergh 6y ago
    Sure, models that break along their common paths will lose people money. Models that don't produce the results they should won't lead to high impact publications. In both cases, models can break in unfortunate ways along rarely used code paths or under unusual conditions. If a model just doesn't work, then of course it will be fixed. That's in any context. If it works most of the time until it breaks badly once, then it may well not be fixed before it has caused massive damage.