3 ms·
This xkcd is relevant: https://xkcd.com/435/ https://xkcd.com/435/ Unless the variables in the experiment are decently quantifiable. It is a garbage in, garba
by lotsofpulp 5y ago
This xkcd is relevant:
https://xkcd.com/435/ https://xkcd.com/435/
Unless the variables in the experiment are decently quantifiable. It is a garbage in, garbage out situation.
- FredPret 5y agoThe problem with psychology is: the subject matter is the most complex system we know of. In order to make definitive statements about said system, you need to start with the most basic behaviours and characteristics. As you work your way up, you’ll mountains of data to capture every permutation of human behaviour and emotion. We’re so, so far from any of that.
- naasking 5y agoThe messier the system, the more rigorous the methodology should be. Pre-registering trials to fight p-hacking, and open data should be the norm. That's decidedly not what we've gotten from this field, and some prominent figures have even been fighting such measures and consider the reproducibility crisis to not be a big deal. That's the problem.
- ramblenode 5y agoMore often than not the constructs in the garbage studies are quantifiable, just useless. The bigger problem is the "what" of what is being measured---whether that thing is representative, useful, or important. Part of the reason bad research has the veneer of authenticity is that the numbers, graphs, and statistics dress up the nonsense.
- lotsofpulp 5y agoYes, that is the distinction I was trying to make by writing "decently quantifiable".