4 ms·

We'd find problems with many if not most published studies if we scutinized them the same way. People like him get discovered because they step out of their aca

We'd find problems with many if not most published studies if we scutinized them the same way. People like him get discovered because they step out of their academic bubble into the light of the world stage. And mind you this is psychology, the entire discipline is only borderline scientific anyway. But even studies in the hard sciences are very often flawed if not outright fabricated. Adjusting data sets to fit the desired result (who'd ever know as long as you do it properly), changing the experiment and measure until they get what they they want, repeated measuring until the "right" data for the paper appeared randomly - those are all things I personally observed in the lab. Not to even get started on the house of cards that is basing ones flawed assumptions on other flawed studies without even the slightest attempt at replicating their results first. It's standard practice to simply presume what's been published (especially by friendly authors) can be regarded as reliable.

tyrabound 1mo ago
It is still seared into my mind when a PhD openly stated in a meeting once that she likes to draw the graphs she needs for her papers and then goes looking for the data she needs to support it. I’m sure I can imaging what kind of looking she did based on the fact that she was little more than a slick, fast talking, skin revealing, fast moving, usual suspect con man.
- officehero 1mo ago
  > draw the graphs she needs for her papers and then goes looking for the data she needs to support it This is a vague statement and it's super important to be precise when blaming someone. I think what you meant is - sketch out the graphs with patterns that support the alternative hypothesis/interesting result and then look for data that make the 'real' patterns look like those in the sketch?
- suddenlybananas 1mo ago
  That's just coming up with a hypothesis.
dyauspitr 1mo ago
There is nothing scientific about psychology. There can be no science where everything is subjective.
- amanaplanacanal 1mo ago
  Pain is entirely subjective, but we are pretty sure it exists, and there is a lot of science around pain management.
  - dyauspitr 1mo ago
    Until you have an objective way of measuring pain in a subject it’s not truly scientific. Hence the endless stream of opioid users lying at the hospital to get their fix.
kodoman 1mo ago
The problem in my view is that everything can be measured like hard science in the first place (not to mention the issue with fraud you point out in hard science). I am think the idea that a thing is only a science if and only if it's empirical is actually harmful, science used to refer to a more generalized idea of study 'scientia' this could also be mathematics or theology. Then natural science begins to eat the term and becomes more limited. I think that the current place we are is one that is actually has a very dim view of anyone thinking about a topic and is naively optimistic about experimentation in general. For if one looks at Aristotle theories ideas one may laugh given what we know now, despite using empirical reasoning for lots of his observations, Never the less I think where useful at the time as it's great for a theory to be good but failing that if a theory can usefully explain phenomena and provide one with mastery of phenomena in some limited way it's still useful. Occam's often abused razor is a way of building theories like this and this whole process is similar to compression, given observable phenomena how do we explain phenomena in the most simple way, this process uses experimental and empirical data but requires thinking about the results of all experiments deeply. From an outsiders view Natural science's largely seem to have pretty good major theories that lots of results of experiments can be used to correct constants of some kind in the theory and a well established field of study of theoretical physics that largely seems to be operating in the way I outlined. But the social sciences are rather stupidly obsessed by these little experiment and no one has the guts to build bigger theories these days, for any theory of the human mind has to deal with many variables and if one wants to have descriptive theories of human mind then one needs to do a lot of thinking and theorizing and sometimes separate form empirical data and then arguing the theories using the data and reject the theories using the data, but also other kinds of analysis. I have the most dim view of modern political science and sociology even more so, they tend to adopt this way of operating the most and to actually operate in that realm they need to theorize the most and experimental data is hard to do properly (and do not neglect history one bit, this is are experimental data and is as good as we can get).

tyrabound 1mo ago

It is still seared into my mind when a PhD openly stated in a meeting once that she likes to draw the graphs she needs for her papers and then goes looking for the data she needs to support it. I’m sure I can imaging what kind of looking she did based on the fact that she was little more than a slick, fast talking, skin revealing, fast moving, usual suspect con man.

officehero 1mo ago
> draw the graphs she needs for her papers and then goes looking for the data she needs to support it This is a vague statement and it's super important to be precise when blaming someone. I think what you meant is - sketch out the graphs with patterns that support the alternative hypothesis/interesting result and then look for data that make the 'real' patterns look like those in the sketch?
suddenlybananas 1mo ago
That's just coming up with a hypothesis.

dyauspitr 1mo ago

There is nothing scientific about psychology. There can be no science where everything is subjective.

amanaplanacanal 1mo ago
Pain is entirely subjective, but we are pretty sure it exists, and there is a lot of science around pain management.
- dyauspitr 1mo ago
  Until you have an objective way of measuring pain in a subject it’s not truly scientific. Hence the endless stream of opioid users lying at the hospital to get their fix.

kodoman 1mo ago

The problem in my view is that everything can be measured like hard science in the first place (not to mention the issue with fraud you point out in hard science). I am think the idea that a thing is only a science if and only if it's empirical is actually harmful, science used to refer to a more generalized idea of study 'scientia' this could also be mathematics or theology. Then natural science begins to eat the term and becomes more limited. I think that the current place we are is one that is actually has a very dim view of anyone thinking about a topic and is naively optimistic about experimentation in general. For if one looks at Aristotle theories ideas one may laugh given what we know now, despite using empirical reasoning for lots of his observations, Never the less I think where useful at the time as it's great for a theory to be good but failing that if a theory can usefully explain phenomena and provide one with mastery of phenomena in some limited way it's still useful. Occam's often abused razor is a way of building theories like this and this whole process is similar to compression, given observable phenomena how do we explain phenomena in the most simple way, this process uses experimental and empirical data but requires thinking about the results of all experiments deeply. From an outsiders view Natural science's largely seem to have pretty good major theories that lots of results of experiments can be used to correct constants of some kind in the theory and a well established field of study of theoretical physics that largely seems to be operating in the way I outlined. But the social sciences are rather stupidly obsessed by these little experiment and no one has the guts to build bigger theories these days, for any theory of the human mind has to deal with many variables and if one wants to have descriptive theories of human mind then one needs to do a lot of thinking and theorizing and sometimes separate form empirical data and then arguing the theories using the data and reject the theories using the data, but also other kinds of analysis. I have the most dim view of modern political science and sociology even more so, they tend to adopt this way of operating the most and to actually operate in that realm they need to theorize the most and experimental data is hard to do properly (and do not neglect history one bit, this is are experimental data and is as good as we can get).