Skip to main content

Gender-related variables for health research

Abstract

Background

In this paper, we argue for Gender as a Sociocultural Variable (GASV) as a complement to Sex as a Biological Variable (SABV). Sex (biology) and gender (sociocultural behaviors and attitudes) interact to influence health and disease processes across the lifespan—which is currently playing out in the COVID-19 pandemic. This study develops a gender assessment tool—the Stanford Gender-Related Variables for Health Research—for use in clinical and population research, including large-scale health surveys involving diverse Western populations. While analyzing sex as a biological variable is widely mandated, gender as a sociocultural variable is not, largely because the field lacks quantitative tools for analyzing the influence of gender on health outcomes.

Methods

We conducted a comprehensive review of English-language measures of gender from 1975 to 2015 to identify variables across three domains: gender norms, gender-related traits, and gender relations. This yielded 11 variables tested with 44 items in three US cross-sectional survey populations: two internet-based (N = 2051; N = 2135) and a patient-research registry (N = 489), conducted between May 2017 and January 2018.

Results

Exploratory and confirmatory factor analyses reduced 11 constructs to 7 gender-related variables: caregiver strain, work strain, independence, risk-taking, emotional intelligence, social support, and discrimination. Regression analyses, adjusted for age, ethnicity, income, education, sex assigned at birth, and self-reported gender identity, identified associations between these gender-related variables and self-rated general health, physical and mental health, and health-risk behaviors.

Conclusion

Our new instrument represents an important step toward developing more comprehensive and precise survey-based measures of gender in relation to health. Our questionnaire is designed to shed light on how specific gender-related behaviors and attitudes contribute to health and disease processes, irrespective of—or in addition to—biological sex and self-reported gender identity. Use of these gender-related variables in experimental studies, such as clinical trials, may also help us understand if gender factors play an important role as treatment-effect modifiers and would thus need to be further considered in treatment decision-making.

Main text

Background

Nearly 20 years ago, the U.S. Institute of Medicine (IOM, now the Academies of Science) recognized that sex (biology) matters in determining health outcomes but also that gender (sociocultural behaviors and attitudes) interacts with sex to influence health and disease processes across the lifespan [1, 2]. In the past decade, both the Canadian Institutes of Health Research (2010) [3] and the European Commission (2014) [4] have endorsed integrating sex and gender (usually as male/female binaries) into health research, and the US National Institutes of Health (NIH) has mandated the inclusion of sex as a biological variable (SABV—2016) [5]. Yet still today, sex and gender are often inappropriately conflated in the biomedical literature [6], and gender is rarely considered largely because the field lacks quantitative tools for analyzing the influence of gender on health outcomes.

In this paper, we argue for Gender as a Sociocultural Variable (GASV) as a complement to SABV. Despite several efforts to examine gender and health [7, 8], the field lacks adequate tools to assess gender. To address this problem, we set out to develop a new instrument—the Stanford Gender-Related Variables for Health Research (GVHR).

Our interest was piqued by a 2007 study that reported that men with higher “femininity” scores had lower risk of coronary heart disease. No such relationship was observed among women [9]. Similarly, a 2015 study found that, independent of biological sex, young adults with a gender score more strongly associated with “feminine gender-related characteristics” were more likely to experience a recurrence of acute coronary syndrome (ACS)—regardless of whether they identified as a man or a woman (a non-binary option was not offered) [10, 11].

These innovative studies highlighted how challenging it is to account for both sex and gender in clinical research. Although these tools demonstrated that gender plays a key role as a determinant of health outcomes, its operational definition deserves further consideration. We were concerned that the conclusions were based on outdated gender identity constructs, such as the Bem Sex Role Inventory (BSRI, 1974) [12], developed using predominantly white, higher socioeconomic U.S. undergraduate student participants and based on outdated notions of masculinity and femininity or their cognates. We also saw that the GENESIS-PRAXY gender questionnaire used in the 2015 study was tested in a sample of 909 heart-disease patients and had not been cross-validated in broader patient, or non-patient, populations. We judged that despite its focus on gender, the GENESIS-PRAXY study used logistic regression with biological sex as the outcome to derive its final score of masculine and feminine characteristics. We also found that the internal consistency of the measure had not been explicitly tested.

More importantly, moving forward, it is important to recognize that it is no longer sufficient to reduce gender to a two-dimensional spectrum stretching from “masculinity” to “femininity,” i.e., concepts which were historically construed as complementary oppositions [13], with a man being one thing and a woman being the opposite (for example, rational/emotional; public/private; mind/body). These concepts are too broad and imprecise to be useful in health research. Given that the goal is to provide physicians and policy makers with gender-related health interventions, measures of gender-related behaviors, such as caregiving or risk-taking, should be labeled as such.

To address these limitations, we develop a new gender-variables instrument. This step toward developing more comprehensive and precise survey-based measures of gender, in relation to health, builds on insights from gender theory to capture key aspects of three dimensions of gender that can be deployed quantitatively in diverse clinical research or large health surveys: (1) Gender Norms [14], (2) Gender-Related Traits [15, 16], and (3) Gender Relations [17] (see Tables S1 and S2), each of which may correlate with sex assigned at birth or self-reported gender identity, without a predetermined coding of that behavior as masculine or feminine (see Table 1). Thus, we adopt a multidimensional understanding that seeks to capture how intrapersonal, interpersonal, and institutional aspects of gender intersect to shape people’s health and illness [17].

Table 1 Three interrelated dimensions of gender

These three meta-categories are not mutually exclusive. Gender is multidimensional: any given individual may experience different configurations of gender norms, traits, and relations that cannot be subsumed into a “masculine” or “feminine” score or considered “fixed” [23].

Our new instrument represents a step toward developing more comprehensive and precise survey-based measures of gender in relation to health. Our questionnaire is designed to shed light on how specific gender-related behaviors and attitudes contribute to health and disease processes, irrespective of—or in addition to—biological sex and self-reported gender identity.

Methods

In a systematic review of the English-language literature from 1975 to 2015, we identified 74 eligible scales used in gender-related measures. From the 74 scales, we distilled 11 composite gender constructs and developed 44 items to measure gender, which we subjected to exploratory and confirmatory factor analysis (EFA and CFA) in three independent U.S. survey samples. This reduced the original 11 gender-related variables to 7 factors: caregiver strain, work strain, independence, risk-taking, emotional intelligence, social support, and discrimination and the 44 survey items to 25. We then examined the relevance of the derived subscales in allowing for more precise analysis of variations in health-related quality of life, obesity, and risky health behaviors.

Literature search

We searched PsycINFO, PsycTESTS, and PubMed for all English-language studies using gender-related tests and scales, from 1975 through 2015, to identify existing questionnaires or scales and construct a comprehensive list of typical traits and/or characteristics used in gender-related measures in both psychology and medicine. We screened an initial sample of 2981 articles from PubMed, PsycTESTS, and PsycINFO from which 405 articles were deemed relevant for further interrogation, within which 127 unique gender-related tests and scales were identified. We also screened existing literature reviews published in books and found four additional scales. Altogether, 131 gender-related questionnaires were sorted into three overarching categories for analyzing gender norms, gender-related traits, and gender relations. Further, we checked citation frequencies for each scale to determine how often it has been used in the literature. All gender scales with at least 20 Google Scholar citations within the last 10 years were selected for further investigation, of which 74 scales met the criteria. All articles published from 2006 to 2015 were retained for further investigation irrespective of whether they were cited or not (the search methods, selection criteria, and review procedures are specified in SI text, Figure S1, and Tables S3-S4).

Several limitations made it impossible to simply plug these 74 scales into a new questionnaire. Very few existing scales (N = 8) focus on associations between gender and health [24,25,26,27,28]. The eligible gender-related scales are generally restricted to either men or women and assess either masculinity [29] or femininity [30, 31] or both as unipolar or bipolar constructs [12, 32,33,34,35,36,37,38] (e.g., hyper-masculinity or hyper-femininity) [26, 28, 39,40,41,42,43,44,45,46,47,48,49]. Further, most scales rely on “agree-disagree” ratings, making them susceptible to acquiescence bias [50].

Questionnaire development

In developing the questionnaire, we recognized the need to minimize the time burden of completing the questionnaire; therefore, we limited the initial item pool to 3–6 items per construct. To avoid acquiescence bias, we presented our items as construct-specific questions. The 74 scales guided our selection of core characteristics to be included among our gender-related measures.

  1. 1.

    Gender Norms. Guided by three of the 74 eligible scales, respondents’ adherence to gender norms was measured by three composite constructs (caregiver strain, time use, and work strain) consisting of 16 items.

    • Caregiver strain captures perceived consequences of responsibility for unpaid, long-term caregiving to children, partners, friends, and elderly (excluding housework and caregiving occupations) [51, 52] and consists of three items, adapted from Graessel and colleagues [53], recorded on a five-point scale: emotional exhaustion, physical exhaustion, and worries about the future caused by caregiving for someone in need, such as a child, elder, partner, or disabled family member. Higher scores on these items indicate higher levels of caregiver strain.

    • Time use measures individual hours spent per day, recorded as open-ended numerical estimates of daily time-spent [54], in the following categories: paid work, household activities, eating and drinking, leisure and sport, caring for others, sleeping, and commuting. The items were adapted from the American Time Use Survey.

    • Work strain measures job strain and emotional job demands as six items, recorded on a five-point scale: work speed, work repetition, emotional job demands, physical job demands, perceived risk, and physical hazards at work. The first four items were adapted from Karasek and Theorell [55]; the last two were developed by the authors. Higher scores on each item indicate higher levels of work strain.

  2. 2.

    Gender-Related Traits. Guided by 31 of the original 74 eligible scales, gender-related traits were measured as five composite constructs: competitive, risk-taking, independence, communal, and expressive, consisting of 16 items.

    • Competitive consists of two items, recorded on a five-point scale, asking respondents how often they find themselves competing with others in situations that do not call for competition and how competitive they are in general, compared to others. The first item is modified from Ryckman et al. [56], the second is developed by the authors. Higher scores on each item indicate higher levels of competitiveness.

    • Risk-taking focuses on physical and behavioral risks, measured by three items adapted from Dohmen et al. [57], recorded on a five-point scale: general risk-taking behavior, risk-taking when making financial decisions, and risk-taking with respect to recreational activities. Higher scores on each item indicate higher levels of risk-taking.

    • Independence is a personality trait characterized by a focus on the person as an individual, not as part of a community or group, which includes agency, self-confidence, self-determination, and decision-making ability, but not self-control or self-esteem [58]. Independence was based on three items, recorded on a five-point scale, adapted from Bakker et al. [59], Clark et al. [60], and Triandis et al. [61], asking respondents how important it is for them to be independent, how often they turn to others for help when in need, and how important it is for them to solve their problems independently. A higher score indicates a higher level of independence for all three items.

    • Communal is a trait characterized by a focus on the individual as part of a group or community, an orientation toward relationships and a concern for others’ needs and well-being [62]. We used four items, scored on a five-point scale, asking respondents how often they worry about what other people think about them, how often they take other people’s needs into account when making important decisions, how often friends talk to them about their problems, and how easy it is for them to spot when someone in a group is feeling uncomfortable. Item one was developed by the authors, item two was adapted from Clark et al. [60], and items three and four were adapted from Baron-Cohen and Wheelwright [63]. Higher scores indicate higher levels of communal orientation.

    • Expressive captures abilities to recognize and express emotions, such as sadness, anger, frustration, compassion, joy, or affection and includes aspects of emotional intelligence, i.e., individuals’ ability to recognize what they feel, manage those emotions, and use emotions in problem solving [64]. We used four items, recorded on a five-point scale, asking respondents how often they talk to friends about their problems, how easy it is for them to understand their own feelings, how easy it is for them to express what they are feeling, and how easy it is for them to ask other people for help when in need. Item one was developed by the authors, item two was adapted from Salovey and colleagues [65], item three was adapted from Gross and John [66], and item four was adapted from Clark and colleagues [60]. Higher scores indicate higher levels of expressivity.

  3. 3.

    Gender Relations. Guided by 40 eligible scales identified in the literature search, gender relations were measured by three composite constructs: social support, discrimination, and quality of family relationships, consisting of 13 items and a single-item measure of personal income.

    • Social support captures perceived satisfaction with the type (physical, emotional, informational, and financial), the availability, and level of support a person might receive. Support may come from partners, relatives, friends, coworkers, health-care systems, the larger community, etc. Social support consists of four items recorded on a five-point-scale measuring the availability and level of social support a person might receive. We asked respondents how often, within the past year, they had someone they could ask for advice, someone to show them love and affection, someone to help them with daily chores, and how often they felt lonely. Item one, two, and three were adapted from the ENRICHD Social Support Inventory [67] and item four was developed by the authors. Higher scores indicate higher levels of social support.

    • Discrimination refers to “systemic unfair treatment” and can occur at multiple levels. We measured micro or interpersonal discrimination. Specifically, we asked the respondents how often they had felt discriminated against because of their gender, in general, when getting hired, when at school, when receiving medical care, in other public settings, and in their family. The items were recorded on a five-point-scale, with higher scores indicating more frequent experiences of gender discrimination.

    • Quality of family relationships measures experiences of harmony and conflict in familial settings, based on two self-developed items recorded on a five-point-scale asking respondents about how they would describe the quality of their relationship with close relatives (in the past year) and how often they had argued with close relatives (in the past year). Higher scores indicate higher levels of perceived quality in family relationships.

Initial testing of the questionnaire

Content validity of the first draft of the questionnaire was assessed by nine members of the author-group who had not taken part in the construction of the item-list, some with technical expertise in the construction of survey-questionnaires and some with expertise in gender-related aspects of health. Each coauthor was asked to rate each item with respect to its relevance in measuring a given variable construct. Ratings were made on a four-point scale (4 = very relevant, 3 = relevant but needs minor alteration, 2 = unable to assess relevance without major revision, 1 = not relevant). These coauthors were also invited to suggest additional items, if they considered the proposed item-list inadequate in capturing a given construct. To improve item quality, we conducted seven cognitive interviews with people recruited by posters in the local area who varied on demographic markers such as education-level, job, age, ethnicity, and gender. In the interviews, we used verbal probing techniques to identify questions that the interviewees found vague and unclear and to elicit how they arrived at answers to the questions. We did this by asking them to reflect on what the items meant to them, how they would rephrase the question in their own words, how they came up with their answers to the questions, and whether the questions were easy or hard to answer and why.

Survey participants

Participants were recruited from the USA through two online services and a health research registry: Prolific, Amazon Mechanical Turk, and the Stanford Research Registry, which consists of ~ 4000 former adult patients at the Stanford University Medical Center who have agreed to be contacted for participation in research studies. We used the web-based Qualtrics software to collect data from Prolific (sample 1) in August and September 2017, Mechanical Turk (sample 2) in December 2017 and January 2018, and the Stanford Research Registry in May and June 2017 (sample 3). Sample 1 consisted of 2051 respondents; 1992 completed the survey. Sample 2 consisted of 2135 respondents; 2043 completed the survey. Sample 3 consisted of 489 respondents; 452 completed the survey. Sample characteristics are presented in Table 2.

Table 2 Sample characteristics

Procedures

Self-rated health was assessed using the Health-Related Quality of Life Core Module (CDC HRQoL-4). This module consists of four items about perceived general health, recent physical health, recent mental health, and recent activity limitations. The ordinal question about perceived general health did not meet the assumption of proportionality of odds required for ordered logistic regressions. Hence, we dichotomized the item into (1) fair or poor and (2) good, very good, or excellent. We measured current smoking and current vaping by number of cigarettes smoked per day and number of times vaping per day. These variables were dichotomized in the analysis (not smoking = 0, smoking = 1; not vaping = 0, vaping = 1) due to a high frequency of zero values (> 75%). Binge drinking was measured by the frequency of consuming five or more drinks on one occasion for males and four or more drinks on one occasion for females (within the last 3 months) [68]. We followed standard procedure and recoded these items into a unisex dichotomous variable (binge drinking less than monthly = 0, binge drinking monthly, weekly, or daily/almost daily = 1). BMI was calculated based on self-reported height and weight and dichotomized for analysis to reflect under or normal weight (BMI < 25 = 0) and overweight or obese (BMI ≥ 25 = 1) (item phrasing and response options for the health questions are reported in Table S5). Specifications on the nine demographic covariates (including item phrasing and response options) used in the regressions are presented in Table S6.

Exploratory factor analysis

We opted to start our analysis with EFA, rather than CFA, because we considered EFA to be the most appropriate first step for a survey measure of this novelty. While the systematic review allowed us to distill core gender-related attitudes and behaviors, we were uncertain how many latent factors would emerge in the subsequent testing. Moreover, we were uncertain how several of the items would distribute across factors (e.g., the items for time-use and quality in family relationships) and we wanted to leave open the possibility that various items would cross-load onto factors other than their parent factor, potentially leading to fewer latent factors than initially expected. As described in the results section, this happened to be the case. In addition, since we had the opportunity and resources to collect three survey samples, a complementary approach combining EFA and CFA allowed us to benefit from advantages of each method.

The EFA was based on iterated principal axis factoring as the extraction method and Promax (oblique) rotation to allow for correlated factors. Exploratory factor analysis and statistical analyses were done in SPSS. In the EFA, we examined questions from all three gender categories in a common factor model with multiple factors. All respondents with missing data for relevant items were removed from sample 1 prior to the analysis. To allow for analysis of the largest possible sample, 10 items targeting caregivers and employees were recoded so that people not currently caring for someone in need or not currently employed (or employed in the past) were ascribed the value 1, which represents no strain due to caregiving or work (see Table S7).

We subjected the 44 questionnaire items to EFA in sample 1. Velicer’s minimum average partial test suggested a 7-factor structure (Table S8, screeplot, communalities, and unique variances are presented in Figure S2 and Table S9) [69]. The conceptual clarity of this solution also best resembled the thematic gender dimensions identified in the literature review. This solution retained 35 of the 44 items subjected to EFA and explained 51% of the variance in item scores. For purposes of interpretability, we excluded all items with loadings below 0.40.

Factor one in this solution includes six items addressing perceived discrimination. Factor two consists of seven items capturing daily time spent on work and work strain-related characteristics. Factor three encompasses four items concerning perceived strain and time-use related to caregiving. Factor four includes five items capturing competitive and risk-taking behavior. Factor five encompasses three items concerning perceived social support. Factor six includes six items capturing empathy and expressive behavior. Finally, factor seven includes four questions about independence. The distribution of items on factors was consistent across alternative factor rotation methods (Tables S10-S13).

Confirmatory factor analysis

The CFA was carried out in SPSS AMOS Graphics 26 and based on maximum likelihood estimations. We allowed the factors to be correlated. The likelihood ratio test (also known as the χ2 test) is highly sensitive to even small departures of the data from exact fit, especially in large-N samples. Moreover, χ2 values increase with sample size and the number of variables in the model [70]. Therefore, we followed Cheung and Rensvold [71] and Yuan and Bentler [72] and determined global model fit and invariance based on the approximate-fit statistics. Specifically, we used the Tuckler Lewis Index (TLI), the root mean square error of approximation (RMSEA), and the standardized root mean square residual (SRMR), relying on conventional fit criteria [73]. The 35 items and 7 factors retained in the EFA were submitted to CFA in samples 1, 2, and 3. Following Gerbing and Hamilton [74], we used CFA to refine the EFA solution identified in sample 1. Next, we cross-validated the outcomes of this CFA in samples 2 and 3. Configural invariance was examined separately in samples 2 and 3. We used multiple-groups CFA to assess metric and scalar invariance across samples 2 and 3. We removed all observations with missing data for one or several of the 35 items subjected to CFA in sample 1, and for the 25 items subjected to CFA in samples 2 and 3. This slightly reduced sample 1 from n = 2051 to n = 2009, sample 2 from n = 2135 to n = 2054, and sample 3 from n = 489 to n = 449. One item concerning perceived gender discrimination in education had high rates of missing data in sample 3 (N > 100). Hence, we restricted the cross-validation in sample 3, and the multiple-groups CFA in samples 2 and 3, to the remaining 24 variables. To avoid a Heywood estimate on the Social support factor, we followed Chen et al. [75] and constrained the error variance of one item (socsupchores) to 0.001 in samples 2 and 3.

The initial 35-item solution based on the EFA did not perform satisfactorily with respect to global model fit in sample 1 (χ2 = 5897.38, df = 539, p = 0.00, TLI = 0.81, RMSEA = 0.07, SRMR = 0.07). To obtain acceptable model fit, we examined the factor loadings, removing all items with loadings ≤ 0.5. The “trimmed” solution, consisting of 25 items, exhibited good fit to the data (χ2 = 1362.53, df = 254, p = 0.00, TLI = 0.95, RMSEA = 0.05, SRMR = 0.04) (Table S14). The cross-validation of this final model in samples 2 and 3, with no equality constraints, also exhibited reasonable fit to the data, indicating configural invariance (sample 2: χ2 = 1440.7, df = 255, p = 0.00, TLI = 0.94, RMSEA = 0.05, SRMR = 0.04; sample 3: χ2 = 496.5, df = 232, p = 0.00, TLI = 0.93, RMSEA = 0.05, 3: SRMR = 0.05) (Table S15).

A more restricted multiple-groups CFA with factor loadings assumed to be equal across samples 2 and 3 also supported metric invariance (χ2 = 1899.849, df = 481, p = 0.00, TLI = 0.94, RMSEA = 0.03, SRMR = 0.04) (Table S16). Further restrictions with both factor loadings and intercepts assumed to be equal across samples 2 and 3 also indicated reasonable fit compared to prior models, supporting scalar invariance (χ2 = 2167.051, df = 505, p = 0.00, TLI = 0.93, RMSEA = 0.04, SRMR = 0.04) (Table S17). As a sensitivity check, we also ran the multiple groups CFA in samples 2 and 3 with the item on perceived gender discrimination in education included (sample 2 = 2054; sample 3 = 348) and obtained comparable model fit (metric invariance: χ2 = 2149.723, df = 528, p = 0.00, TLI = 0.93, RMSEA = 0.04, SRMR = 0.04; scalar invariance: χ2 = 2380.150, df = 553, p = 0.00, TLI = 0.93, RMSEA = 0.04, SRMR = 0.04) (Tables S18-S19).

Reliability

The reliabilities of the factors implied by the final CFA solution were assessed in all samples using Raykov’s ρ. ρ was computed using James Gaskin’s “Validity master tool” [76], and following conventional criteria [77], we considered values > 0.60 desirable.

Results

Table 3 reports the factor loadings, Raykov’s ρ, and item scoring for the trimmed CFA model in samples 1, 2, and 3, with seven variables. The 7 factors listed above represent our final gender-related variables. Our analyses yielded low to moderate inter-factor correlations (Table S20), which is not unusual in multidimensional gender measures [26, 78, 79]. We calculated mean-item subscale scores for each factor and used these as predictors in the regressions presented below. For subscales including continuous variables, mean-item scores were calculated based on standardized variables (z-scores). All variables are scored from lower to higher levels of the given constructs.

Table 3 Factor loadings for the trimmed CFA models in Samples 1, 2 and 3 and Raykov’s ρ for each factor

Figure 1 displays the z-scores (averaged by group) for the 7 gender-related variables for respondents seeing themselves as men, women, and gender fluid/non-binary in sample one. The figure demonstrates the advantage of capturing specific gender-related behaviors and attitudes through multiple variables.

Fig. 1
figure 1

Gender-related variables capturing specific behaviors and attitudes. The figure displays the z-scores for the seven gender-related variables for respondents seeing themselves as men (green), women (orange) and gender fluid/Non-binary (grey) in sample 1 (N = 1893)

Associations with self-rated health and health-risk behaviors

Existing research shows notable sex differences in health-related quality of life, obesity, and risky health behaviors, such as smoking and heavy drinking [80,81,82]. Here, we examine the relevance of our gender-related variables in predicting self-related health and health-risk behaviors.

Associations between our 7 gender-related variables, sex assigned at birth, self-reported gender identity and physical health, mental health, and activity limitations due to poor physical or mental health were analyzed in samples 1 and 2 using negative binomial regressions, with birth year, personal income, education level, race, and ethnicity as covariates. Only associations that are consistent across samples 1 and 2 are reported here. Measures of reported birth sex and gender identity were highly correlated. Therefore, we ran all models twice: once including birth sex and once including gender identity. Here, we report the outcomes of the models including birth sex as a key predictor (see Tables S21-S23 for specifications on the regression models including gender identity).

As displayed in Table 4, caregiver strain and discrimination were associated with lower physical health, mental health, and activity levels in both samples, whereas social support was associated with higher mental health and activity levels in both samples. The results for the remaining associations were inconclusive in one or both samples.

Table 4 Adjusted incidence rate ratios and 95% confidence intervals of associations with health-related measures in negative binomial regressions

Associations between our gender-related variables, sex assigned at birth, self-reported gender identity and general health status, smoking, vaping, binge drinking, and BMI were analyzed using logistic regressions in samples 1 and 2 (Table 5, adjusted for year of birth, personal income, education level, ethnicity, and race), and we ran separate models with sex and gender identity (see Tables S24-S28 for specifications on the regression models including gender identity). In both samples, caregiver strain, discrimination, and male birth sex were associated with fair or poor self-rated health, while risk-taking and social support predicted good, very good, or excellent self-rated health. Further, caregiver strain and work strain were associated with smoking, while discrimination was associated with vaping and higher levels of risk-taking was associated with binge drinking. Caregiver strain, low levels of risk-taking, discrimination, and male birth sex were associated with overweight. The results for the remaining associations were inconclusive in one or both samples.

Table 5 Adjusted odds ratios and 95% CIs of associations with health-related measures in logistic regressions

Combining the data from samples 1 and 2 (and adjusting for sample in the regression models), all associations with self-related health and health-risk behaviors reported above persisted at the 99.9% confidence level (Figs. 2 and 3), as did the following associations: emotional intelligence with smoking and male birth sex with vaping and binge drinking.

Fig. 2
figure 2

Adjusted incidence rate ratios of associations with recent physical health, mental health, and activity limitations. This figure displays the outcomes of the negative binomial regressions predicting health outcomes in the combined sample (sample 1 + sample 2) (Physical health, N = 3879; mental health, N = 3880; activity limitations, N = 3876). Error bars represent 99.9% confidence intervals. See Tables S37-S39 for model specifications

Fig. 3
figure 3

Adjusted odds ratios of associations with health status, smoking, vaping, binge drinking, and BMI. This figure displays the outcomes of the binary logistic regressions predicting health outcomes in the combined sample (sample 1 + sample 2) (health status, N = 3,894; smoking, N = 3,892 vaping, N = 3,891; binge drinking, N = 3,887; BMI, N = 3,851. Error bars represent 99.9% confidence intervals. See Tables S40-S44 for model specifications

Discussion

Following a comprehensive review of gender measures from 1975 to 2015, we have applied a rigorous process to identify key aspects of gender for the purpose of developing a new gender assessment tool for use in clinical and population research, including large-scale health surveys involving diverse Western populations. Through exploratory and confirmatory factor analyses, we reduced the original 44 survey items to 25 (Table S45) and the 11 original constructs to 7 gender-related variables: caregiver strain, work strain, independence, risk-taking, emotional intelligence, social support, and discrimination.

Each variable seeks to capture an important aspect of gender within the populations studied. Each variable measures an individual participant’s self-reported behavior or attitude for that characteristic and is designed to be scored individually, as a distinct human behavior or attribute. Behaviors are not coded “masculine” or “feminine,” and we recommend against consolidating the variable scores into these unipolar or bipolar indices. Studies that reduce gender-related variables to “femininity” or “masculinity” scores give little guidance for behavioral interventions. For example, if caregiver strain is found to be associated with higher risk of recurrence or death in patients with ACS, it should be reported as such. Subsuming gender-related factors into masculine or feminine indices will reduce, rather than improve, the precision and applicability of survey-based measures of health.

Moreover, the regression analyses (Figs. 2 and 3) suggest that the gender-related variables pertaining to norms (caregiver strain and work strain) and relations (discrimination and social support) have stronger correlations with self-rated health measures than the variables pertaining to gender-related traits (with risk-taking as an important exception). This finding aligns with extant research suggesting that institutional and interpersonal aspects of gender may be more important than individual traits and characteristics in shaping health and disease processes [17].

Clinicians and public health researchers may employ the Stanford GVHR to gain a fuller understanding of gender differences in health outcomes than can be captured by simply asking people to self-identify their sex or gender. It might be used, for example, in the treatment of chronic pain or osteoporosis research, each of which has robust gender components [83]. Specifically, we recommend that researchers start by measuring all 7 variables alongside sex assigned at birth, self-reported gender identity, and other relevant factors, such as sexual orientation, ethnicity, age, income, and education, to specify which characteristics, traits, and behaviors may be predictive of the health issue in focus. In subsequent studies and patient-based outcome measures, the focus may be restricted to a subset of variables of documented relevance to a specific disease or health condition [84]. Our gender-related variables are developed to capture how gender norms, gender-related traits, and gender relations intersect to shape people’s health and disease (and vice versa). Researchers using our instrument are encouraged to be aware of broader institutional and cultural contexts that may influence patients’ gender roles and identities and health outcomes.

The Stanford GVHR is specific to the survey cohorts, time, place, and culture in which it was developed and tested. Because gender norms, traits, and relations vary across and within cultures and change over time [85], we recommend that variables be updated with each generation or even more frequently. Obvious limitations are that our variables were developed from English-language literature and validated in nonprobability samples, recruited online and through a research registry in US populations, and the age composition of our samples (median ages range from 36 to 50 years) does not represent typical patient populations encountered in clinical practice. We strongly encourage more research to test the validity of the gender-related variables within and across age groups and cultures, as well as across a wide range of global settings.

Any association of a gender-related variable with a health outcome does not infer causality. Our assessment was cross-sectional. Confounding or even reverse causality (health phenotypes affecting gender-related behaviors and attitudes) should be considered. Another limitation is the small number of items per construct which might limit generalizability; at the same time, a smaller number of items likely increases the usefulness of the questionnaire to practitioners and researchers. An avenue for further research is the expansion the number of items for each construct, especially emotional intelligence, which had less than ideal reliability across all three samples. In addition, a few of the initial gender-related constructs that were not retained in the exploratory factor analysis, such as competition and quality of family relationships, may have been deselected due to insufficient items in the study’s initial pool of attitudes and behaviors and should be reconsidered in future research.

Perspectives and significance

This project represents an approach toward developing more comprehensive and precise survey-based measures of gender in relation to health. In the future, the proposed list of variables to measure other gender-related factors could be expanded to place more emphasis on gender relations, e.g., by integrating factors such as decision-making power (including over household resources and health expenditures) and the distribution of domestic labor in families and among both same- and different-sex cohabiting or romantic partners. Indeed, many of the measures that have informed our work may be outdated (noting that some date back to the 1970s and 1980s). It may be desirable to complement our proposed list of variables with more “timely” variables that better represent how specific patients and persons conceive of gender in 2020. It would also be interesting to explore associations between our gender-related variables and other health-related aspects such as health literacy, health-seeking behavior, and provider-patient interactions.

Conclusion

Our questionnaire is designed to shed light on how specific gender-related behaviors and attitudes contribute to health and disease processes, irrespective of—or in addition to—biological sex and self-reported gender identity. Use of these gender-related variables in experimental studies, such as clinical trials, may also help us understand if gender factors play an important role as treatment effect modifiers and would thus need to be further considered in treatment decision-making.

Availability of data and materials

Supplementary Information (SI) Text is included with this submission. Data and code needed to evaluate the conclusions are available here: https://osf.io/7yje9/.

References

  1. Wizemann TM, Pardue M-L, editors. Exploring the biological contributions to human health: does sex matter? Washington, D.C: National Academies Press; 2001.

    Google Scholar 

  2. Klein SL, Schiebinger L, Stefanick ML, Cahill L, Danska J, de Vries GJ, Kibbe MR, McCarthy MM, Mogil JS, Woodruff TK, Zucker I. Opinion: sex inclusion in basic research drives discovery. PNAS. 2015;112(17):5257–8.

    Article  CAS  PubMed  Google Scholar 

  3. Gender, Sex and Health Research Guide: A tool for CIHR applicants. Canadian Institutes of Health Research. 2010. http://www.cihr-irsc.gc.ca/e/50836.html. Accessed 19 Jan 2021.

  4. Fact sheet: Gender Equality in Horizon 2020. European Commission. 2013. https://ec.europa.eu/programmes/horizon2020/sites/horizon2020/files/FactSheet_Gender_2.pdf. Accessed 19 Jan 2021.

  5. NOT-OD-15-102: Consideration of sex as a biological variable in NIH-funded research 2015. https://grants.nih.gov/grants/guide/notice-files/NOT-OD-15-102.html. Accessed 28 Aug 2020.

  6. Madsen TE, Bourjeily G, Hasnain M, Jenkins M, Morrison MF, Sandberg K, Tong IL, Trott J, Werbinksi J, McGregor A. Sex-and gender-based medicine: the need for precise terminology. Gend Genome. 2017;1:122–8.

    Article  Google Scholar 

  7. Kuhlmann E, Annadale E. Gender and healthcare. London: Palgrave Macmillan; 2010.

    Google Scholar 

  8. Hunt K, Annadale E. Gender and health: major themes in health and social welfare. London: Routledge; 2012.

    Google Scholar 

  9. Hunt K, Lewars H, Emslie C, Batty GD. Decreased risk of death from coronary heart disease amongst men with higher ‘femininity’ scores: a general population cohort study. Int J Epidemiol. 2007;36:612–20.

    Article  PubMed  Google Scholar 

  10. Pelletier R, Khan NA. Sex versus gender-related characteristics: which predicts outcome after acute coronary syndrome in the young? J Am Coll Cardiol. 2016;67:127–35.

    Article  PubMed  Google Scholar 

  11. Pelletier R, Ditto B, Pilote L. A composite measure of gender and its association with risk factors in patients with premature acute coronary syndrome. Psychosom Med. 2015;77(5):517–26.

    Article  PubMed  Google Scholar 

  12. Bem SL. The measurement of psychological androgyny. J Consult Clin Psychol. 1974;42(2):155.

    Article  CAS  PubMed  Google Scholar 

  13. Schiebinger L. The mind has no sex? Women in the origins of modern science. Cambridge: Harvard University Press; 1989.

    Google Scholar 

  14. Cislaghi B, Heise L. Gender norms and social norms: differences, similarities and why they matter in prevention science. Sociol Health Illn. 2020;42(2):407–22.

    Article  PubMed  Google Scholar 

  15. Wood W, Eagly AH. Two traditions of research on gender identity. Sex Roles. 2015;73(11):461–73.

    Article  Google Scholar 

  16. Wood W, Eagly AH. Gender identity. In: Leary MR, Hoyle RH, editors. Handbook of individual differences in social behavior. New York: The Guilford Press; 2009. p. 109–25.

    Google Scholar 

  17. Connell R. Gender, health and theory: conceptualizing the issue, in local and world perspective. Soc Sci Med. 2012;74(11):1675–83.

    Article  PubMed  Google Scholar 

  18. Schiebinger L, Klinge I, Sánchez de Madariaga I, Paik HY, Schraudner M, Stefanick M. Term: Gender. Gendered Innovations in Science, Health & Medicine, Engineering, and Environment. 2021. http://genderedinnovations.stanford.edu/terms/gender.html. Accessed 19 Jan 2021.

    Google Scholar 

  19. Tannenbaum C, Ellis RP, Eyssel F, Zou J, Schiebinger L. Sex and gender analysis improves science and engineering. Nature. 2019;575:137–46.

    Article  CAS  PubMed  Google Scholar 

  20. Heise L, Greene ME, Opper N, Stavropoulou M, Harper C, Nascimento M, Zewdie D, Darmstadt GL, Greene ME, Hawkes S, Heise L, Henry S, Heymann J, Klugman J, Levine R, Raj A, Gupta GR. Gender inequality and restrictive gender norms: framing the challenges to health. Lancet. 2019;393(10189):2440–54.

    Article  PubMed  Google Scholar 

  21. Connell RW, Pearse R. Gender: in world perspective. Cambridge: Polity; 2014.

    Google Scholar 

  22. Cook N. Gender relations in global perspective: essential readings. Toronto: Canadian scholars Press; 2007.

    Google Scholar 

  23. Hyde JS, Bigler RS, Joel D, Tate CC, van Anders SM. The future of sex and gender in psychology: five challenges to the gender binary. Am Psychol. 2019;74(2):171–93.

    Article  PubMed  Google Scholar 

  24. Lee PH, Stewart SM, Lun VMC, Bond MH, Yu X, Lam TH. Validating the Concord Index as a measure of family relationships in China. J Fam Psychol. 2012;26(6):906–15.

    Article  PubMed  Google Scholar 

  25. Jackson FM. The development of a race and gender-specific stress measure for African-American women: Jackson, Hogue, Phillips contextualized stress measure. Ethn Dis. 2005;15(4):594–600.

    PubMed  Google Scholar 

  26. Wong YJ, Shea M, LaFollette JR, Hickman SJ, Cruz N, Boghokian T. The inventory of subjective masculinity experiences: development and psychometric properties. J Mens Stud. 2011;19(3):236–55.

    Article  Google Scholar 

  27. Zuckerman M. The development of an affect adjective check list for the measurement of anxiety. J Consult Psychol. 1960;24(5):457–62.

    Article  CAS  PubMed  Google Scholar 

  28. Gillespie BL, Eisler RM. Development of the feminine gender role stress scale: a cognitive-behavioral measure of stress, appraisal, and coping for women. Behav Modif. 1992;16(3):426–38.

    Article  CAS  PubMed  Google Scholar 

  29. Mahalik JR, Locke BD, Ludlow LH, Diemer MA, Scott RP, Gottfried M, Freitas G. Development of the conformity to masculine norms inventory. Psychol Men Masculinity. 2003;4(1):3.

    Article  Google Scholar 

  30. Mahalik JR, Morray EB, Coonerty-Femiano A, Ludlow LH, Slattery SM, Smiler A. Development of the conformity to feminine norms inventory. Sex Roles. 2005;52(7–8):417–35.

    Article  Google Scholar 

  31. Levant R, Richmond K, Cook S, House AT, Aupont M. The femininity ideology scale: factor structure, reliability, convergent and discriminant validity, and social contextual variation. Sex Roles. 2007;57(5–6):373–83.

    Article  Google Scholar 

  32. Spence JT, Helmreich RL, Stapp J. The Personal Attributes Questionnaire: a measure of sex role stereotypes and masculinity-femininity. Washington, D.C: Journal Supplement Abstract Service, American Psychological Association; 1978.

    Google Scholar 

  33. Hathaway SR, McKinley JC. Minnesota Multiphasic Personality Inventory; manual (revised). San Antonio: Psychological Corporation; 1951.

    Google Scholar 

  34. Storms MD. Sex role identity and its relationships to sex role attributes and sex role stereotypes. J Pers Soc Psychol. 1979;37(10):1779–89.

    Article  Google Scholar 

  35. Sugihara Y, Katsurada E. Gender role development in Japanese culture: diminishing gender role differences in a contemporary society. Sex Roles. 2002;47(9):443–52.

    Article  Google Scholar 

  36. Berzins JI, Welling MA, Wetter RE. A new measure of psychological androgyny based on the Personality Research Form. J Consult Clin Psychol. 1978;46(1):126.

    Article  CAS  PubMed  Google Scholar 

  37. Berger A, Krahé B. Negative attributes are gendered too: conceptualizing and measuring positive and negative facets of sex-role identity. Eur J Soc Psychol. 2013;43(6):516–31.

    Google Scholar 

  38. Basu J. Development of the Indian Gender Role Identity Scale. J Indian Acad Appl Psychol. 2010;36(1):25–34.

    Google Scholar 

  39. O’Neil JM, Helms BJ, Gable RK, David L, Wrightsman LS. Gender-Role Conflict Scale: college men’s fear of femininity. Sex Roles. 1986;14(5–6):335–50.

    Google Scholar 

  40. Thompson EH, Pleck JH. The structure of male role norms. Am Behav Sci. 1986;29(5):531–43.

    Article  Google Scholar 

  41. Pleck JH, Sonenstein FL, Ku LC. Masculinity ideology: its impact on adolescent males’ heterosexual relationships. J Soc Issues. 1993;49(3):11–29.

    Article  Google Scholar 

  42. Arciniega GM, Anderson TC, Tovar-Blank ZG, Tracey TJG. Toward a fuller conception of machismo: development of a traditional machismo and caballerismo scale. J Couns Psychol. 2008;55(1):19–33.

    Article  Google Scholar 

  43. Mosher DL, Sirkin M. Measuring a macho personality constellation. J Res Pers. 1984;18(2):150–63.

    Article  Google Scholar 

  44. Murnen SK, Bryne D. Hyperfemininity: measurement and initial validation of the construct. J Sex Res. 1991;28(3):479–89.

    Article  Google Scholar 

  45. Levant RF, Good GE, Cook SW, O’Neil JM, Smalley KB, Owen K, Richmond K. The Normative Male Alexithymia Scale: measurement of a gender-linked syndrome. Psychol Men Masculinity. 2006;7(4):212–24.

    Article  Google Scholar 

  46. Burk LR, Burkhart BR, Sikorski JF. Construction and preliminary validation of the Auburn Differential Masculinity Inventory. Psychol Men Masculinity. 2004;5(1):4–17.

    Article  Google Scholar 

  47. Rummell CM, Levant RF. Masculine gender role discrepancy strain and self-esteem. Psychol Men Masculinity. 2014;15(4):419–26.

    Article  Google Scholar 

  48. Janey BA, Kim T, Jampolskaja T, Khuda A, Larionov A, Maksimenko A, Sharapov D, Shipilova A. Development of the Russian Male Norms Inventory. Psychol Men Masculinity. 2013;14(2):138–47.

    Article  Google Scholar 

  49. Wong YJ, Horn AJ, Gomory AM, Ramos E. Measure of men’s perceived inexpressiveness norms (M2PIN): scale development and psychometric properties. Psychol Men Masculinity. 2013;14(3):288.

    Article  Google Scholar 

  50. Krosnick JA. Survey research. Annu Rev Clin Psychol. 1999;50(1):537–67.

    Article  CAS  Google Scholar 

  51. Caprara GV, Steca P, Zelli A, Capanna C. A new scale for measuring adults’ prosocialness. Eur J Psychol Assess. 2005;21(2):77–89.

    Article  Google Scholar 

  52. Lippa R. Gender, nature, and nurture. New Jersey: Lawrence Erlbaum Associates; 2005.

    Book  Google Scholar 

  53. Graessel E, Berth H, Lichte T, Grau H. Subjective caregiver burden: validity of the 10-item short version of the Burden Scale for Family Caregivers BSFC-s. BMC Geriatr. 2014;14(1):23.

    Article  PubMed  PubMed Central  Google Scholar 

  54. American Time Use Survey Tables. US Department of Labor, Bureau of Labor Statistics. 2017. https://www.bls.gov/tus/tables.htm. Accessed 4 June 2018.

  55. Karasek R, Theorell T. Healthy work: stress, productivity, and the reconstruction of working life. New York: Basic Books; 1990.

    Google Scholar 

  56. Ryckman RM, Hammer M, Kaczor LM, Gold JA. Construction of a Hypercompetitive Attitude Scale. J Pers Assess. 1990;55(3–4):630–9.

    Article  Google Scholar 

  57. Dohmen T, Falk A, Huffman D, Sunde U, Schupp J, Wagner GG. Individual risk attitudes: measurement, determinants, and behavioral consequences. J Eur Econ Assoc. 2011;9(3):522–50.

    Article  Google Scholar 

  58. Oyserman D, Coon HM, Kemmelmeier M. Rethinking individualism and collectivism: evaluation of theoretical assumptions and meta-analyses. Psychol Bull. 2002;128(1):3–72.

    Article  PubMed  Google Scholar 

  59. Bakker W, van Oudenhoven JP, van der Zee KI. Attachment styles, personality, and Dutch emigrants’ intercultural adjustment. Eur J Personal. 2004;18(5):387–404.

    Article  Google Scholar 

  60. Clark MS, Oullette R, Powell MC, Milberg S. Recipient’s mood, relationship type, and helping. J Pers Soc Psychol. 1987;53(1):94–103.

    Article  CAS  PubMed  Google Scholar 

  61. Triandis HC, Bontempo R, Villareal MJ, Asai M, Lucca N. Individualism and collectivism: cross-cultural perspectives on self-ingroup relationships. J Pers Soc Psychol. 1988;54(2):323–38.

    Article  Google Scholar 

  62. Ferguson E. Personality is of central concern to understand health: towards a theoretical model for health psychology. Health Psychol Rev. 2013;7(Suppl 1):S32–70.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Baron-Cohen S, Wheelwright S. The empathy quotient: an investigation of adults with Asperger syndrome or high functioning autism, and normal sex differences. J Autism Dev Disord. 2004;34(2):163–75.

    Article  PubMed  Google Scholar 

  64. Mayer JD, Salovey P, Caruso DR. Emotional intelligence: new ability or eclectic traits? Am Psychol. 2008;63(6):503–17.

    Article  PubMed  Google Scholar 

  65. Salovey P, Mayer JD, Goldman SL, Turvey C, Palfai TP. Emotional attention, clarity, and repair: exploring emotional intelligence using the trait meta-mood scale. In: Pennebaker JW, editor. Emotion, disclosure and health. Washington, D.C.: American Psychological Association; 1995. p. 125–54.

    Chapter  Google Scholar 

  66. Houston JM, McIntire SA, Kinnie J, Terry C. A factorial analysis of scales measuring competitiveness. Educ Psychol Meas. 2002;62(2):284–98.

    Article  Google Scholar 

  67. Investigators ENRICHD. Enhancing recovery in coronary heart disease (ENRICHD) study intervention: rationale and design. Psychosom Med. 2001 Oct;63(5):747–55.

    Google Scholar 

  68. Drinking Levels Defined. National Institute on Alcohol Abuse and Alcoholism (NIAAA). 2011. https://www.niaaa.nih.gov/alcohol-health/overview-alcohol-consumption/moderate-binge-drinking. Accessed 23 Oct 2019.

  69. Velicer WF. Determining the number of components from the matrix of partial correlations. Psychometrika. 1976;41(3):321–7.

    Article  Google Scholar 

  70. Bentler PM, Bonett DG. Significance tests and goodness of fit in the analysis of covariance structures. Psychol Bull. 1980;88(3):588–606.

    Article  Google Scholar 

  71. Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model. 2002;9(2):233–55.

    Article  Google Scholar 

  72. Yuan K-H, Bentler PM. On Chi-square difference and z tests in mean and covariance structure analysis when the base model is misspecified. Educ Psychol Meas. 2004;64(5):737–57.

    Article  Google Scholar 

  73. Hu PLT, Bentler M. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6:1–55.

    Article  Google Scholar 

  74. Gerbing DW, Hamilton JG. Viability of exploratory factor analysis as a precursor to confirmatory factor analysis. Struct Equ Model. 1996;3(1):62–72.

    Article  Google Scholar 

  75. Chen F, Bollen KA, Paxton P, Curran PJ, Kirby JB. Improper solutions in structural equation models: Causes, consequences, and strategies. Sociol Methods Res. 2001;29(4):468–508.

    Article  Google Scholar 

  76. Gaskin J, Lim J. Master validity tool. In: AMOS Plug In; Gaskination’s StatWiki; 2016.

    Google Scholar 

  77. Bagozzi RP, Yi Y. On the evaluation of structural equation models. J Acad Mark Sci. 1988;16(1):74–94.

    Article  Google Scholar 

  78. Parent MC, Moradi B. Confirmatory factor analysis of the conformity to feminine norms Inventory and Development of an Abbreviated Version: The Cfni-45. Psychol Women Q. 2010;34(1):97–109.

    Article  Google Scholar 

  79. Parent MC, Moradi B. An abbreviated tool for assessing conformity to masculine norms: Psychometric properties of the Conformity to Masculine Norms Inventory-46. Psychol Men Masculinity. 2011;12(4):339–53.

    Article  Google Scholar 

  80. Crimmins EM, Kim JK, Solé-Auró A. Gender differences in health: results from SHARE, ELSA and HRS. Eur J Pub Health. 2011;21(1):81–91.

    Article  Google Scholar 

  81. Centers for Disease Control and Prevention. Vital signs: binge drinking prevalence, frequency, and intensity among adults-United States, 2010. MMWR Surveill Summ. 2012;61:14–9.

    Google Scholar 

  82. Cherepanov D, Palta M, Fryback DG, Robert SA. Gender differences in health-related quality-of-life are partly explained by sociodemographic and socioeconomic variation between adult men and women in the US: evidence from four US nationally representative data sets. Qual Life Res. 2010;19:1115–24.

    Article  PubMed  PubMed Central  Google Scholar 

  83. Schiebinger L, Klinge I. Gendered innovations 2: how inclusive analysis contributes to research and innovation. Luxembourg: Publications Office of the European Union; 2020.

    Google Scholar 

  84. Tadiri CP, Raparelli V, Abrahamowicz M, Kautzy-Willer A, Kublickiene K, Herrero M-T, Norris CM, Pilote L, COINGFWD Consortium. Methods for prospectively incorporating gender into health sciences research. J Clin Epidemiol. 2021;129:191–7.

    Article  PubMed  Google Scholar 

  85. Garg N, Schiebinger L, Jurafsky D, Zou J. Word embeddings quantify 100 years of gender and ethnic stereotypes. Proc Natl Acad Sci USA. 2018;115(16):E3635–44.

    Article  CAS  PubMed  Google Scholar 

Download references

Funding

Stanford Humanities Center; Stanford School of Humanities and Science, Stanford University funded this research. The funder had no involvement in this study.

Author information

Authors and Affiliations

Authors

Contributions

LS, MWN, and MLS conceptualized and wrote the paper. LS, MWN, and HFL conducted the systematic literature search, reviewed the literature, and constructed the survey. MWN and LS conducted cognitive interviews. DP set up and administered the survey through Qualtrics. MWN carried out the statistical analyses. TBN, JPAI, LP, JP, and LS advised on analyses. All authors reviewed paper drafts and consulted on specific questions. The authors read and approved the final manuscript.

Corresponding author

Correspondence to Londa Schiebinger.

Ethics declarations

Ethics approval and consent to participate

Our research complies with all ethical regulations. Stanford University’s Institutional Review Board approved the study. We obtained informed consent from all participants.

Consent for publication

All authors consent to publish.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Fig. S1.

Flowchart of article inclusion and exclusion in the literature search. Fig. S2. Screeplot of the factor analysis reported in Table S8. Table S1. Item phrasing and descriptive statistics for the 44 potentially relevant gender-related items. Table S2. Response options for all 44 items included in the exploratory factor analyses. Table S3. Rank of gender characteristics based on occurrences (>2). Table S4. Search-terms for meta-analyses of existing scales measuring each gender variable. Table S5. Health-related items and response options. Table S6. Demographic items and response options. Table S7. Recoding of ten variables to allow for the largest possible sample in the EFA. Table S8. Exploratory Factor Analysis (Full factor model). Table S9. Communalities and unique variances for exploratory factor analysis presented in Table S8. Table S10. Exploratory Factor Analysis (Full factor model), Oblimin rotation. Table S11. Exploratory Factor Analysis (Full factor model), Varimax rotation. Table S12. Exploratory Factor Analysis (Full factor m odel), Equamax rotation. Table S13. Exploratory Factor Analysis (Full factor model), Quartimax rotation. Table S14. Factor loadings for CFA Models 1 and 2 in sample 1. Table S15. Factor loadings for CFA Samples 2 and 3 (Configural invariance). Table S16. Factor loadings for CFA Samples 2 and 3 (Metric invariance, 24 items). Table S17. Factor loadings for final CFA in samples 2 and 3 (Scalar invariance, 24 items). Table S18. Factor loadings for final CFA in samples 2 and 3 (Metric invariance, 25 items). Table S19. Factor loadings for final CFA samples 2 and 3 (Scalar invariance, 25 items). Table S20. Correlations between the factors in samples 1, 2 and 3. Table S21. Negative binomial regression predicting number of days with poor physical health (during past 30 days) (with gender identity as covariate). Table S22. Negative Binomial regression predicting number of days with poor mental health (during past 30 days) (with gender identity as covariate). Table S23. Negative binomial regression predicting number of days where poor mental or physical health prevented the respondent from doing usual activities (during past 30 days) (with gender identity as covariate). Table S24. Logistic regression predicting general health status (excellent, very good, good= 0, fair, poor= 1) (with gender identity as covariate). Table S25. Logistic regression predicting vaping (not vaping=0, vaping=1) (with gender identity as covariate). Table S26. Logistic regression predicting smoking (not smoking=0, smoking=1) (with gender identity as covariate). Table S27. Logistic regression predicting binge drinking (less than monthly=0, monthly, weekly, and daily=1) (with gender identity as covariate). Table S28. Logistic regression predicting overweight (BMI<25=0, BMI≥25 =1) (with gender identity as covariate). Table S29. Negative binomial regression predicting number of days with poor physical health (during past 30 days) (with sex as covariate). Table S30. Negative Binomial regression predicting number of days with poor mental health (during past 30 days) (with sex as covariate). Table S31. Negative binomial regression predicting number of days where poor mental or physical health prevented the respondent from doing usual activities (during past 30 days) (with sex as covariate). Table S32. Logistic regression predicting general health status (excellent, very good, good= 0, fair, poor= 1) (with sex as covariate). Table S33. Logistic regression predicting smoking (not smoking=0, smoking=1) (with sex as covariate). Table S34. Logistic regression predicting vaping (not vaping=0, vaping=1) (with sex as covariate). Table S35. Logistic regression predicting binge drinking (less than monthly=0, monthly, weekly, and daily=1) (with sex as covariate). Table S36. Logistic regression predicting Overweight (BMI<25=0, BMI≥25 =1) (with sex as covariate). Table S37. Negative binomial regression predicting number of days with poor physical health (during past 30 days) (combined samples). Table S38. Negative binomial regression predicting number of days with mental health (during past 30 days) (combined samples). Table S39. Negative binomial regression predicting number of days where poor mental or physical health prevented the respondent from doing usual activities (during past 30 days) (combined samples). Table S40. Logistic regression predicting general health status (excellent, very good, good= 0, fair, poor= 1) (combined samples). Table S41. Logistic regression predicting smoking (not smoking=0, smoking=1) (combined samples). Table S42. Logistic regression predicting vaping (not vaping=0, vaping=1) (combined samples). Table S43. Logistic regression predicting binge drinking (less than monthly=0, monthly, weekly, and daily=1) (combined samples). Table S44. Logistic regression predicting Overweight (BMI<25=0, BMI≥25 =1) (combined samples). Table S45. Final 25 survey items.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nielsen, M.W., Stefanick, M.L., Peragine, D. et al. Gender-related variables for health research. Biol Sex Differ 12, 23 (2021). https://doi.org/10.1186/s13293-021-00366-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13293-021-00366-3

Keywords