3 ms·
Absolutely. Been there, done that. I worked for a guy who is top in his social science field. Total p-hacking was the norm. It was an eye-opening experience for
by jgmjgm 9y ago
Absolutely. Been there, done that. I worked for a guy who is top in his social science field. Total p-hacking was the norm. It was an eye-opening experience for someone new to the field expecting things to be done more honestly following something like the scientific method.
Once I found a major bug in some code that was the basis of a significant chunk of his major book and an important article. (Basically an optimization process that didn't work but gave some nice results he built a story around.) When I wrote him a report on what was wrong and why, he didn't respond. I was supposed to write a paper based on the same code and all he would say was along the lines of "it should work". Over time I realized that the implication was that I should "make" it work. Of course, he never said those words but over time the message was clear. After beating my head against a wall for a long time, I eventually walked away from the project. Technically bad for my career, but I honestly couldn't see the point in being at a top university essentially selling snake oil.
That being said, there are fields of social science that are much better: demography, political science, economics and even psychology (which is very difficult at the best of times!) are trying to clean up their act. Basically, any field of study with consistent data available openly is probably pretty decent.
There are other fields like business/management where the pay is generally good (i.e. motivation for a nice job with good perks is there), many of these journals don't require data to be released, and the samples being studied tend to be convenience samples or impossible to reproduce. I generally don't trust the work in this area.
Sadly, policy makers are often willing to take questionable academic studies that support their preconceived notions. When these things don't work out, the general public becomes jaded that their taxes were wasted... it makes all social science research look bad.