7 ms·
>> Consistent with prior research, the researchers found that the following traits are most exaggerated among females when considered separately from the rest o
by YeGoblynQueenne 7y ago
>> Consistent with prior research, the researchers found that the following traits are most exaggerated among females when considered separately from the rest of the gestalt: sensitivity, tender-mindedness, warmth, anxiety, appreciation of beauty, and openness to change. For males, the most exaggerated traits were emotional stability, assertiveness/dominance, dutifulness, conservatism, and conformity to social hierarchy and traditional structure.
I am very skeptical of any claim that such vague and abstract behaviour descriptions can be measured with accuracy. The cited studies are claimed to have been conducted cross-culturally, but I really doubt that different cultures would really assign the same meaning to these words. Even people within the same culture would understand what "sensitivity" or "dutifulness" means differently. For instance, if I like flowers, am I "sensitive"? If I cry at weddings? If I cry at Game of Thrones? At MMA fights? [1]
_____________
[1] It's not a joke. I cried at the end of the Coleman-Emelianenko fight. When they hug at the end, with Coleman's face a bloody mess? I cried my fucking eyes out. Does that make me "sensitive"? "Appreciating of beauty"?
- adnzzzzZ 7y agoI think most of these are based on the Big Five, so they're defined from self reports. Personality questionnaires are far from ideal but they're what we've got and they're fairly reliable.
- YeGoblynQueenne 7y agoYou're right. I had a look at the methods sections of three of the four studies cited in the article. It seems how they collect data is they have people fill in questionnaires, then calculate personality scores based on those questionnaires. For example, in the Mac Giolla and Kajonius study [1] the data came from an online questionnaire. I'm finding it very hard to criticise the methodology of this sort of study without [edited out] being extremely rude and dismissive to a whole field of research. But, I really don't understand how all this is supposed to make sense. I look at the plot in the middle of the Scientific American article that is marked "Agreeableness" on the x-axis (with a score from 1 to 5). I look at the papers cited. There's plenty of maths there, but what is anything calculating? What is "agreeableness" and why is it measured on a scale of 1 to 5? It seems to be a term that has a specific meaning in psychology and sociology, and that ultimately translates to "a score of n in this standardised questionnaire". But, if you can just define whatever quantities you like and give them a commonly used word for a name- then what does anything mean anymore? You can just define anything you like as anything you like and measure it anyway you like- and claim anything you want at all. At the end of the day, is all this measuring anything other than trends in filling up questionnaires? Can we really draw any other conclusions about the differences of men and women than that the samples of the studies filled in their questionnaires in different ways? Is even that a safe conclusion? If you take statistics on a random process you can always model it- but you'll be modelling noise. How is this possibility excluded here? All the statistics are quantifying the answers that respondents gave to questionnaires and how the researchers rated them - without any attempt to blind or randomise anything, to protect from participant or researcher bias, as far as I can tell (I'm searching for the word "blind" in the papers and finding nothing). In the study I link below, participants found the website by internet searches and word-of-mouth. The study itself points out that this is a self-selecting sample, but what have they done to exclude the possibility of adversarial participation (people purposefully filling in a form in a certain way to confuse results)? There is so much that is extremely precarious about the findings of those studies and yet the Scientific American article jumps directly to d values. Yes, but d-values on what? What is being measured? What do the numbers stand for? This is just heartbreaking to see that such a contentious issue is treated with such frivolity. If it's not possible to lay to rest such hot button issues with solid scientific work- then don't do it. It will just make matters worse. __________________ [1] https://onlinelibrary.wiley.com/doi/epdf/10.1002/ijop.12529 https://onlinelibrary.wiley.com/doi/epdf/10.1002/ijop.12529?
- datashow 7y ago> What is "agreeableness" Quote from the article https://www.frontiersin.org/articles/10.3389/fpsyg.2011.00178/full https://www.frontiersin.org/articles/10.3389/fpsyg.2011.0017...: "Agreeableness comprises traits relating to altruism, such as empathy and kindness. Agreeableness involves the tendency toward cooperation, maintenance of social harmony, and consideration of the concerns of others (as opposed to exploitation or victimization of others). Women consistently score higher than men on Agreeableness and related measures, such as tender-mindedness (Feingold, 1994; Costa et al., 2001)." > why is it measured on a scale of 1 to 5 Quote from the article https://www.frontiersin.org/articles/10.3389/fpsyg.2011.00178/full https://www.frontiersin.org/articles/10.3389/fpsyg.2011.0017...: "Participants rate their agreement with how well each statement describes them using a five-point scale ranging from strongly disagree to strongly agree." > But, if you can just define whatever quantities you like and give them a commonly used word for a name- then what does anything mean anymore? You can just define anything you like as anything you like and measure it anyway you like- and claim anything you want at all. > At the end of the day, is all this measuring anything other than trends in filling up questionnaires? Can we really draw any other conclusions about the differences of men and women than that the samples of the studies filled in their questionnaires in different ways? Is even that a safe conclusion? If you take statistics on a random process you can always model it- but you'll be modelling noise. How is this possibility excluded here? Not that simple. There is a whole field called Psychometrics. https://en.wikipedia.org/wiki/Psychometrics https://en.wikipedia.org/wiki/Psychometrics If you really care to answer those questions you need to take a complete psychometric theory course such as https://personality-project.org/revelle/syllabi/405.syllabus.html https://personality-project.org/revelle/syllabi/405.syllabus... Before you learned the whole thing, don't assume the field is as superficial as you imagined. > All the statistics are quantifying the answers that respondents gave to questionnaires and how the researchers rated them - without any attempt to blind or randomise anything, to protect from participant or researcher bias, as far as I can tell (I'm searching for the word "blind" in the papers and finding nothing). Your searching for the word "blind" means you don't know anything about psychology research. We don't use this word in our research. In psychology studies, we care about "reliability" and "validity" and we have extensive methods to test those. > In the study I link below, participants found the website by internet searches and word-of-mouth. The study itself points out that this is a self-selecting sample, but what have they done to exclude the possibility of adversarial participation (people purposefully filling in a form in a certain way to confuse results)? Maybe there are a few people try to do that. But with a sample size of 130,602, these response wouldn't impact the research findings at all, unless it is an organized effort trying to influence the research. > There is so much that is extremely precarious about the findings of those studies and yet the Scientific American article jumps directly to d values. Yes, but d-values on what? What is being measured? What do the numbers stand for? The ScientificAmerican article does fail to clear this up. But the first linked study using "D" clearly stated it is "Cattell's 16PF (fifth edition)". https://onlinelibrary.wiley.com/doi/pdf/10.1111/jopy.12500 https://onlinelibrary.wiley.com/doi/pdf/10.1111/jopy.12500 > This is just heartbreaking to see that such a contentious issue is treated with such frivolity. If it's not possible to lay to rest such hot button issues with solid scientific work- then don't do it. It will just make matters worse. Maybe the ScientificAmerican article is not flawless, but I think you need to calm down a little bit.
- causality0 7y agoThere are also a lot of connotations attached to those terms with significant implications. For example, does "conformity to social hierarchy" contradict previous findings indicating men tend to be more ambitious and take more risks? How does one tell the difference between a person with a lesser appreciation of beauty and a person who's been taught not to express their appreciation of beauty? The difference between not appreciating beauty and not prioritizing beauty?
- deleted 7y ago[deleted]
- seventhtiger 7y agoIt depends on the specific distribution of those traits. You can say both "women suffer from breast cancer more often than men" and "women have longer life spans than men." If a study found more men among the ambitious and risk takers men may still be more conforming to hierarchy on average. It's not necessarily contradictory.
- itronitron 7y agoI think a study would need to account for each person's self-perceived context when answering as I think most people would be heavily influenced by cultural norms in their responses.
- TulliusCicero 7y agoI mean, even if the cultural norms vary heavily, what does it say that the results they got from those varying cultures were so consistent?
- YeGoblynQueenne 7y agoYou can get consistent results modelling a random process. For instance, if you have a very small sample, you might "luck out" and get consistent results. If you have a large sample you'll get consistent results because you'll approximate the true distribution. In either case, the process remains random and you're only modelling noise. One kind of research bias is p-hacking where you basically mine your data for spurious correlations and only form a theory to explain the correlations once you find them. The problem with that is that, to paraphrase the philosopher, if you look hard enough into the noise, the noise turns up correlations. You can always find a signal if you look hard enough. (I think this is a better answer- sorry for the multipl edits).
- underpand 7y agoI'm curious how this study compares to the average research coming from social sciences which seems to be generally accepted as valid.
- andreilys 7y agoI don’t think most people accept social science research as valid. Replication crisis is a real phenomenon that will likely never go away unless we accept that social sciences will never have the rigor of hard sciences. More often than not it’s wielded as a political tool to support pre-existing biases and positions. Also it doesn’t help that academia doesn’t reward those who seek to replicate studies which likely hides the magnitude of the problem. “ According to a 2016 poll of 1,500 scientists reported that 70% of them had failed to reproduce at least one other scientist's experiment (50% had failed to reproduce one of their own experiments). In 2009, 2% of scientists admitted to falsifying studies at least once and 14% admitted to personally knowing someone who did” https://en.wikipedia.org/wiki/Replication_crisis https://en.wikipedia.org/wiki/Replication_crisis
- datashow 7y agoExperimental studies have replication crisis, but the studies on this topic are not experimental studies. They are based on survey data and statistical analysis. They do have their challenges, but have nothing to do with the replication crisis.
- andreilys 7y agoIf we were to try to replicate this study by sampling a different cohort of individuals we would likely see very different results.
- FabHK 7y agoWhat makes you say that? You have heard of the replication crisis - don’t you think that the researchers in that very field have heard of the replication crisis?
- kingkawn 7y agoIf women and men are these things it is because we have made ourselves this way overtime. If we choose another way we will find our way there too.
- rowanG077 7y agoAre you suggesting we should start genetically altering ourselves for purpose of making men and women the same?
- rubidium 7y agoYou’re rather cavalier about the impact of biology on creatures. Choose can do some things... but there are limits.
- autokad 7y agosome people thought (some still do) that, but so far research where men and women where most free to do what they want, the differences become bigger - not smaller. Which actually makes sense. if we are made up of influences from nature and nurture and you remove one of those influences, differences in the other becomes more clear. its not rocket science but somehow people are still surprised by it.
- Hasu 7y ago> Which actually makes sense. if we are made up of influences from nature and nurture and you remove one of those influences, differences in the other becomes more clear. its not rocket science but somehow people are still surprised by it. It's not clear that differences in nurture are actually being removed, though. Just because people are free to do what they want regardless of their sex, does not mean that nurture has been removed as a variable. What people want has very much to do with their experiences in life and how people have treated them based on preconceived notions of what they 'should' do. In more plain terms: from birth, males and females are treated differently and live with different expectations. Teasing the effect of those differences out from the effect of biological differences does not seem possible without unethical controlled experiments that would involve raising a group of children without any influence from adults who already have preconceived notions and expectations of differences between sexes. You'd need computerized parenting that treats all the children the same from birth, without exposure to the culture and history of humanity. That would give us a better understanding of inherent biological differences between the sexes, but it would be horrifically unethical. I don't think we're anywhere close to being capable of doing it technologically, not to mention the technological and sociological challenges involved in having humans create something that could raise human children without any of the human biases we all share. I'm not saying I don't think there are inherent biological differences in personality between the sexes, I'm saying they're inevitably conflated with non-biological differences, and our science is nowhere near advanced enough to reliably distinguish the true origin of any given difference we can detect.
- whiddershins 7y agoI’m reading down this particular thread and it seems to be dismissing the notion that we can have any meaningful psychological concepts at all. I am worried that even though skepticism is good, skepticism from people outside of a field can lead into a downward spiral of rejecting all conclusions made by serious practitioners of that field. How many other endeavors would be impossible to undertake if people constantly disregarded the methods and practices of researchers and specialists within these disciplines? At what point are we merely finding ourselves skeptical of research which contradicts our preconceptions? How do we know when we are going too far in picking apart methodology that we don’t even understand that well?
- YeGoblynQueenne 7y ago>> I’m reading down this particular thread and it seems to be dismissing the notion that we can have any meaningful psychological concepts at all. Not at all, at least not on my part. I think psychology is important. I am not convinced by the methodology though.
- codyb 7y agoI wonder how they measured them. Is it possible with large enough sample sizes the average values would probably be about right? Sort of like that idea if you get 10,000 people to guess how many beans are in a jar, the average will get closer and closer to the actual value as you go?
- JamesBarney 7y agoThe methodology of the field of psychology?
- YeGoblynQueenne 7y agoSorry, that was a bit vague. What I mean about "methodology" is the current trend of quantifying human personality traits, like that damned "agreeableness". I understand the aspiration to quantify the human personality (although I also personally find it a little off-putting) but it seems to me that it is very difficult to do with the tools with which it is being attempted. In fact, I think it's impossible to do what psychologists are trying to do, i.e. to do statistics on the human personality. Because the things you are trying to measure are impossible to define clearly and observe objectively since they have no physical substance. So why do it at all? Why does psychology _need_ to have statistics on personality traits, when they are not really personality traits but complicated proxies for things we think may be representative of personality traits? Wouldn't the same effort be better spent on a different project? Can't psychology be taken seriously as a science without trying to do maths with things that don't really exist?
- JamesBarney 7y ago>> I am very skeptical of any claim that such vague and abstract behaviour descriptions can be measured with accuracy. What they mean by sensitivity, is " is someone who experiences acute physical, mental, or emotional responses to stimuli." This isn't very vague or abstract compared to things we measure all the time like "GDP". >> The cited studies are claimed to have been conducted cross-culturally, but I really doubt that different cultures would really assign the same meaning to these words. It really doesn't matter if they assign the same meaning to those words, or even have words to describe the concept. You're not measuring whether they are sensitive relative to their own meaning of the word, but if they are sensitive relative to a specific trait that psychology professors are interested in measuring. A baby has no concept of weight but I can still weigh them. >> For instance, if I like flowers, am I "sensitive"? If I cry at weddings? If I cry at Game of Thrones? At MMA fights? What would make you sensitive is if you are "someone who experiences acute physical, mental, or emotional responses to stimuli." Of course people are different. Of course they find different things emotionally salient. Image we ran an experiment. And we asked two people, Person S(ensitive), and person R(ock) if they found 10 situations emotionally overwhelming. S tells you every time they were extremely overwhelmed.(Weddings, deaths, criticism, something unfair happens) R tells you they didn't feel overwhelmed at all. Now if we ask S and R if they felt overwhelmed about an 11th scenario what are they chances they say yes? Previous studies have said S is much more likely to answer yes than R. This correlation is the thing they are measuring. Btw the criticism you are making is called construct validity and is a something that psychology professors study and worry about all the time.
- YeGoblynQueenne 7y ago>> Now if we ask S and R if they felt overwhelmed about an 11th scenario what are they chances they say yes? Previous studies have said S is much more likely to answer yes than R. This correlation is the thing they are measuring. Thank you, that is a very clear explanation. And "construct validity", from its name and from a quick look on wikipedia is exactly my concern.
- Terretta 7y agoIf "the degree to which a test measures what it claims, or purports, to be measuring" is your concern, does the notion these researchers are thinking about it all the time leave you with less skepticism, or are you sure your skepticism is warranted because you’re worrying in a way they haven’t thought of while studying this caveat?
- deleted 7y ago[deleted]
- FabHK 7y agoOthers have replied to you with more patience, but I just want to highlight unequivocally that the questions you raise are 1) entirely obvious, and 2) carefully studied and discussed in the field, from the first year of undergraduate study all the way to cutting edge research. The fact that you bring none of the pertinent terms to bear makes me think that you have not the slightest idea what you are talking about. I mean, I would not claim to have any special expertise in the field, but I’ve heard the terms “operationalise”, or the criteria “objectivity”, “reliability”, “validity”. > such vague and abstract behaviour descriptions Maybe these terms are not vague and abstract descriptions, but carefully defined and embedded in a comprehensive theory including measurement apparatus? You can safely assum that every single of the terms you mention has had at least, say, five professors and many more PhD students (and their theses) obsess over that term alone, and define and operationalise and measure and validate and embed in the theoretical edifice. (Side Note: That was a big problem in the reception of the Damore memo: many people that had so little understanding of the underlying field that they didn’t even know the Big Five, but felt that they were qualified to weigh in, and evidently misinterpreted many things, for example what “neuroticism” means.) Just to reiterate: the questions you raise are enormously important and difficult and, sure, in parts controversial. What annoys me though is that your comment sounds as if you assume that researchers in the field have not grappled with them, when in fact they have, carefully and comprehensively, for over a century!