Advertisement

Psychometric Instruments and Women’s Mental Health

  • Jeronimo Mendes-Ribeiro
  • Mario Juruena
  • Luisa Caropreso
  • Maha M. Eltayebani
  • David L. Streiner
Chapter
  • 7 Downloads

Abstract

For both research and clinical purposes, scales are often used to measure various phenomena, such as anxiety, depression, quality of life, and other mental states. The use of psychiatric scales in clinical practice is widely known and can be useful as a part of diagnostic evaluations, to identify the presence or absence of a given mental disorder, to monitor treatment progress, and also to quantify and record symptom severity.

In order to be able to trust that the results are an accurate reflection of the person’s actual state, the scales must be constructed properly and possess adequate psychometric properties. This chapter will outline the steps involved in constructing a scale and discuss how the properties of reliability and validity are measured and assessed. It will then review a number of scales that are commonly used in the field of women’s mental health and evaluate them against these criteria.

Keywords

Reliability Validity Scales Women PMDD Perinatal Perimenopause 

References

  1. 1.
    Anderson N, Schlueter JE, Carlson JF, Geisinger KF, editors. Tests in print IX. Lincoln: University of Nebraska Press; 2016.Google Scholar
  2. 2.
    Goldman BA, Mitchell DF. Directory of unpublished experimental measures. Washington, DC: American Psychological Association; 2008.Google Scholar
  3. 3.
    Fechner GT. Elemente der Psychophysik. Leipzig: Breitkopf und Härtel; 1860.Google Scholar
  4. 4.
    Jones LV, Thissen D. A history and overview of psychometrics. Handb Stat. 2007;26:1–27.Google Scholar
  5. 5.
    Binet A, Simon T. Methodes nouvelles pour le diagnostic du niveau intellectual des anormaux. Annee Psychol. 1905;11:191–244.CrossRefGoogle Scholar
  6. 6.
    Guilford JP. Psychometric methods. New York: McGraw-Hill; 1936.Google Scholar
  7. 7.
    Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. 5th ed. Oxford: Oxford University Press; 2015.CrossRefGoogle Scholar
  8. 8.
    Embretson SE, Reise SP. Item response theory for psychologists. Mahwah: Lawrence Erlbaum Associates; 2000.Google Scholar
  9. 9.
    Bond TG, Fox CM. Applying the Rasch model: fundamental measurement in the human sciences. 2nd ed. New York: Routledge; 2007.Google Scholar
  10. 10.
    Apgar V. A proposal for new method of evaluation of the newborn infant. Curr Res Anesth Analg. 1953;32:260–7.Google Scholar
  11. 11.
    Battista J, Almond R. The development of meaning in life. Psychiatry. 1973;36:409–27.PubMedCrossRefGoogle Scholar
  12. 12.
    Ronen GM, Streiner DL, Rosenbaum P. Health-related quality of life in children with epilepsy: development and validation of self-report and parent proxy measures. Epilepsia. 2003;44:598–612.PubMedCrossRefGoogle Scholar
  13. 13.
    Melnick SA, Gable RK. The use of negative stems: a cautionary note. Educ Res Q. 1990;14:31–6.Google Scholar
  14. 14.
    Holden RR, Fekken GC, Jackson DN. Structured personality test item characteristics and validity. J Res Pers. 1985;19:386–94.CrossRefGoogle Scholar
  15. 15.
    Lawshe CH. A quantitative approach to content validity. Pers Psychol. 1985;28:563–75.CrossRefGoogle Scholar
  16. 16.
    Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86:420–8.CrossRefGoogle Scholar
  17. 17.
    McGraw KO, Wong SP. Forming inferences about some intraclass correlation coefficients. Psychol Methods. 1996;1:30–46.CrossRefGoogle Scholar
  18. 18.
    Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.CrossRefGoogle Scholar
  19. 19.
    Cortina JM. What is coefficient alpha? An examination of theory and applications. J Appl Psychol. 1993;78:98–104.CrossRefGoogle Scholar
  20. 20.
    Nunnally JC, Bernstein IH. Psychometric theory. 3rd ed. New York: McGraw-Hill; 1994.Google Scholar
  21. 21.
    Streiner DL. Starting at the beginning: an introduction to coefficient alpha and internal consistency. J Pers Assess. 2003;80:99–103.PubMedCrossRefGoogle Scholar
  22. 22.
    Cattell RB. Description and measurement of personality. World Book Company: New York; 1946.Google Scholar
  23. 23.
    Landy FJ. Stamp collecting versus science. Am Psychol. 1986;41:1183–92.CrossRefGoogle Scholar
  24. 24.
    Cronbach LJ, Meehl PE. Construct validity in psychological tests. Psychol Bull. 1955;52:281–302.PubMedCrossRefGoogle Scholar
  25. 25.
    Stevens SS. On the theory of scales of measurement. Science. 1946;103:677–80.PubMedPubMedCentralCrossRefGoogle Scholar
  26. 26.
    Steiner M, Peer M, Palova E, Freeman EW, Macdougall M, Soares CN. The premenstrual symptoms screening tool revised for adolescents (PSST-A): prevalence of severe PMS and premenstrual dysphoric disorder in adolescents. ArchWomens Ment Health. 2011;14(1):77–81.Google Scholar
  27. 27.
    Martini J, Wittchen HI, Soares CN, Rieder A, Steiner M. New women-specific diagnostic modules: the Composite International Diagnostic Interview for Women (CIDIVENUS). Arch Womens Ment Health. 2009;12(5):281–9.PubMedCrossRefGoogle Scholar
  28. 28.
    Ross LE, McLean LM. Anxiety disorders during pregnancy and the postpartum period: a systematic review. J Clin Psychiatry. 2006;67:1285–98.PubMedPubMedCentralCrossRefGoogle Scholar
  29. 29.
    Coates AO, Schaefer CA, Alexander JL. Detection of postpartum depression and anxiety in a large health plan. J Behav Health Serv Res. 2004;31:117–33.PubMedCrossRefGoogle Scholar
  30. 30.
    Nevatte T, O’Brien PMS, Backstrom T, et al. ISPMD consensus on the management of premenstrual disorders. Arch Womens Ment Health. 2013;16(4):279–91.PubMedPubMedCentralCrossRefGoogle Scholar
  31. 31.
    American Psychiatric Association. Diagnostic and statistical manual of mental disorders. Washington DC: American Psychiatric Association; 2013.CrossRefGoogle Scholar
  32. 32.
    Moos RH. The development of a menstrual distress questionnaire. Psychosom Med. 1968;30(6):853–67.PubMedPubMedCentralCrossRefGoogle Scholar
  33. 33.
    Hall E, Steiner M. Psychiatric symptoms and disorders associated with reproductive cyclicity in women: advances in screening tools. Womens Health (Lond Engl). 3rd ed. 2015;11(3):399–415.CrossRefGoogle Scholar
  34. 34.
    Steiner M, Haskett RF, Carroll BJ. Premenstrual tension syndrome: the development of research diagnostic criteria and new rating scales. Acta Psychiatr Scand. 1980;62(2):177–90.PubMedCrossRefGoogle Scholar
  35. 35.
    Steiner M, Peer M, Macdougall M, Haskett R. The premenstrual tension syndrome rating scale: an updated version. J Affect Disord. 2011;135(1–3):82–8.PubMedCrossRefPubMedCentralGoogle Scholar
  36. 36.
    McCormack HM, Horne DJ, Sheather S. Clinical applications of visual analogue scales: a critical review. Psychol Med. 1988;18(4):1007–19.PubMedCrossRefGoogle Scholar
  37. 37.
    Steiner M, Streiner DL, Steinberg S, et al. The measurement of premenstrual mood symptoms. J Affect Disord. 1999;53(3):269–73.PubMedCrossRefPubMedCentralGoogle Scholar
  38. 38.
    Endicott J, Nee J, Harrison W. Daily record of severity of problems (DRSP): reliability and validity. Arch Womens Ment Health. 2006;9(1):41–9.PubMedPubMedCentralCrossRefGoogle Scholar
  39. 39.
    Eisenlohr-Moul TA, et al. Toward the reliable diagnosis of DSM-5 premenstrual dysphoric disorder: the Carolina Premenstrual Assessment Scoring System (C-PASS). Am J Psychiatry. 2016;174(1):51–9.PubMedPubMedCentralCrossRefGoogle Scholar
  40. 40.
    Reid RL, Yen SS. The premenstrual syndrome. Clin Obstet Gynecol. 1983;26(3):710–8.PubMedCrossRefGoogle Scholar
  41. 41.
    Rubinow DR, Roy-Byrne P, Hoban MC, Gold PW, Post RM. Prospective assessment of menstrually related mood disorders. Am J Psychiatry. 1984;141(5):686.Google Scholar
  42. 42.
    Rivera-Tovar AD, Frank E. Late luteal phase dysphoric disorder in young women. Am J Psychiatry. 1990;147(12):1634–6.PubMedCrossRefGoogle Scholar
  43. 43.
    Freeman EW, DeRubeis RJ, Rickels K. Reliability and validity of a daily diary for premenstrual syndrome. Psychiatry Res. 1996;65(2):97–106.PubMedCrossRefGoogle Scholar
  44. 44.
    Mortola JF, Girton L, Beck L, Yen SSC. Diagnosis of premenstrual syndrome by a simple, prospective, and reliable instrument: the calendar of premenstrual experiences. Obstet Gynecol. 1990;76(2):302–7.PubMedGoogle Scholar
  45. 45.
    Evans J, Heron J, Francomb H, Oke S, Golding J. Cohort study of depressed mood during pregnancy and after childbirth. BMJ. 2001;323:257–60.PubMedPubMedCentralCrossRefGoogle Scholar
  46. 46.
    Eberhard-Gran M, Eskild A, Tambs K, Samuelsen SO, Opjordsmoen S. Depression in postpartum and non-postpartum women: prevalence and risk factors. Acta Psychiatr Scand. 2002;106:426–33.PubMedCrossRefGoogle Scholar
  47. 47.
    O’Connor E, Rossom RC, Henninger M, Groom HC, Burda BU. Primary care screening for and treatment of depression in pregnant and postpartum women. JAMA. American Medical Association. 2016;315(4):388–406.CrossRefGoogle Scholar
  48. 48.
    Harris B, Johns S, Fung H, et al. The hormonal environment of post-natal depression. Br J Psychiatry. 1989;154:660–7.PubMedCrossRefGoogle Scholar
  49. 49.
    Ahokas A, Aito M, Turiainen S. Association between oestradiol and puerperal psychosis. Acta Psychiatr Scand. 2000;101:167–9.PubMedCrossRefGoogle Scholar
  50. 50.
    Beck CT. Predictors of postpartum depression: an update. Nurs Res. 2001;50:275–85.PubMedCrossRefGoogle Scholar
  51. 51.
    Miller LJ. Postpartum depression. JAMA. 2002;287:762–5.PubMedCrossRefGoogle Scholar
  52. 52.
    Cox JL, Holden JM, Sagovsky R. Detection of postnatal depression. Development of the 10-item Edinburgh Postnatal Depression Scale. Br J Psychiatry. 1987;150(6):782–6.PubMedCrossRefGoogle Scholar
  53. 53.
    Clark G. Discussing emotional health in pregnancy: the Edinburgh Postnatal Depression Scale. Br J Community Nurs. 2000;5(2):91–8.PubMedCrossRefGoogle Scholar
  54. 54.
    Areias ME, et al. Comparative incidence of depression in women and men, during pregnancy and after childbirth. Validation of the Edinburgh Postnatal Depression Scale in Portuguese mothers. Br J Psychiatry. 1996;169(1):30–5.PubMedCrossRefGoogle Scholar
  55. 55.
    Matthey S, Fisher J, Rowe H. Using the Edinburgh postnatal depression scale to screen for anxiety disorders: conceptual and methodological considerations. J Affect Disord. 2013;146(2):224–30.PubMedCrossRefGoogle Scholar
  56. 56.
    Austin MP, et al. Antenatal screening for the prediction of postnatal depression: validation of a psychosocial Pregnancy Risk Questionnaire. Acta Psychiatr Scand. 2005;112(4):310–7.PubMedCrossRefGoogle Scholar
  57. 57.
    Beck CT. A checklist to identify women at risk for developing postpartum depression. J Obstet Gynecol Neonatal Nurs. 1998;27(1):39–46.PubMedCrossRefGoogle Scholar
  58. 58.
    Beck CT, Gable RK. Postpartum depression screening scale: development and psychometric testing. Nurs Res. 2000;49(5):272–82.PubMedCrossRefGoogle Scholar
  59. 59.
    Beck CT, Gable RK. Comparative analysis of the performance of the Postpartum Depression Screening Scale with two other depression instruments. Nurs Res. 2001;50(4):242–50.PubMedCrossRefGoogle Scholar
  60. 60.
    Levin JS. The factor structure of the pregnancy anxiety scale. J Health Soc Behav. 1991;32(4):368–15.PubMedCrossRefGoogle Scholar
  61. 61.
    Huizink AC, Mulder EJH, Robles de Medina PG, Visser GHA, Buitelaar JK. Is pregnancy anxiety a distinctive syndrome? Early Hum Dev. 2004;79(2):81–91.PubMedCrossRefGoogle Scholar
  62. 62.
    Wadhwa PD, Sandman CA, Porto M, Dunkel-Schetter C, Garite TJ. The association between prenatal stress and infant birth weight and gestational age at birth: a prospective investigation. Am J Obstet Gynecol. Mosby. 1993;169(4):858–65.CrossRefGoogle Scholar
  63. 63.
    Fallon V, Halford JCG, Bennett KM, Harrold JA. The postpartum specific anxiety scale: development and preliminary validation. Arch Womens Ment Health. 5 ed. 2016;19(6):1079–90.CrossRefGoogle Scholar
  64. 64.
    Holcomb JR, Stone LS, Lustman PJ, Gavard JA, Mostello DJ. Screening for depression in pregnancy: characteristics of the Beck depression inventory. Obstet Gynecol. 1996;88(6):1021–5.PubMedCrossRefGoogle Scholar
  65. 65.
    Spitzer RL. Validation and utility of a self-report version of PRIME-MD the PHQ primary care study. JAMA. 1999;282(18):1737.PubMedCrossRefGoogle Scholar
  66. 66.
    Spitzer RL, et al. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–7.PubMedPubMedCentralCrossRefGoogle Scholar
  67. 67.
    Flynn HA, Sexton M, Ratliff S, Porter K, Zivin K. Comparative performance of the Edinburgh Postnatal Depression Scale and the Patient Health Questionnaire-9 in pregnant and postpartum women seeking psychiatric services. Psychiatry Res. 2011;187(1–2):130–4.PubMedCrossRefGoogle Scholar
  68. 68.
    Simpson W, Glazer M, Michalski N, Steiner M, Frey BN. Comparative efficacy of the generalized anxiety disorder 7-item scale and the Edinburgh Postnatal Depression Scale as screening tools for generalized anxiety disorder in pregnancy and the postpartum period. Can J Psychiatry. 2014;59(8):434–40.PubMedPubMedCentralCrossRefGoogle Scholar
  69. 69.
    Hirschfeld RMA, Williams JBW, Spitzer RL, Calabrese JR, Flynn L, Keck PE Jr, et al. Development and validation of a screening instrument for bipolar spectrum disorder: the Mood Disorder Questionnaire. AJP. 2000;157(11):1873–5.CrossRefGoogle Scholar
  70. 70.
    Hirschfeld RMA, Holzer C, Calabrese JR, Weissman M, Reed M, Davies M, et al. Validity of the Mood Disorder Questionnaire: a general population study. AJP. 2003;160(1):178–80.CrossRefGoogle Scholar
  71. 71.
    Frey BN, Simpson W, Wright L, Steiner M. Sensitivity and specificity of the Mood Disorder Questionnaire as a screening tool for bipolar disorder during pregnancy and the postpartum period. J Clin Psychiatry. 2012;73(11):1456–61.CrossRefGoogle Scholar
  72. 72.
    Sharma V, Xie B. Screening for postpartum bipolar disorder: validation of the Mood Disorder Questionnaire. J Affect Disord. 2011;131(1–3):408–11.PubMedCrossRefGoogle Scholar
  73. 73.
    Clark CT, Sit DKY, Driscoll K, Eng HF, Confer AL, Luther JF, et al. Does screening with the MDQ and EPDS improve identification of bipolar disorder in an obstetrical sample? Depress Anxiety. 2015;32(7):518–26.PubMedPubMedCentralCrossRefGoogle Scholar
  74. 74.
    Uguz F, Akman C, Kaya N, Cilli AS. Postpartum-onset obsessive compulsive disorder: incidence, clinical features, and related factors. J Clin Psychiatry. 2007;68:132–8.PubMedCrossRefPubMedCentralGoogle Scholar
  75. 75.
    Zambaldi CF, Cantilino A, Montenegro AC, Paes JA, de Albuquerque TL, Sougey EB. Postpartum obsessive-compulsive disorder: prevalence and clinical characteristics. Compr Psychiatry. 2009;50:503–9.PubMedPubMedCentralCrossRefGoogle Scholar
  76. 76.
    Labad J, Menchon JM, Alonso P, Segalas C, Jimenez S, Vallejo J. Female reproductive cycle and obsessive-compulsive disorder. J Clin Psychiatry. 2005;66:428–35.PubMedPubMedCentralCrossRefGoogle Scholar
  77. 77.
    Vulink NC, Denys D, Bus L, Westenberg HG. Female hormones affect symptom severity in obsessive-compulsive disorder. Int Clin Psychopharmacol. 2006;21:171–5.PubMedPubMedCentralCrossRefGoogle Scholar
  78. 78.
    Lord C, Rieder A, Hall GBC, Soares CN, Steiner M. Piloting the Perinatal Obsessive–Compulsive Scale (POCS): development and validation. J Anxiety Disord. 2011;25(8):1079–84.PubMedCrossRefGoogle Scholar
  79. 79.
    Bromberger JT, Matthews KA, Schott LL, Brockwell S, Avis NE, Kravitz HM, et al. Depressive symptoms during the menopausal transition: the Study of Women’s Health Across the Nation (SWAN). J Affect Disord. 2007;103(1–3):267–72.PubMedPubMedCentralCrossRefGoogle Scholar
  80. 80.
    Freeman EW, Sammel MD, Liu L, Gracia CR, Nelson DB, Hollander L. Hormones and menopausal status as predictors of depression in women in transition to menopause. Arch Gen Psychiatry. 2004;61(1):62–70.PubMedCrossRefGoogle Scholar
  81. 81.
    Avis NE, Brambilla D, McKinlay SM, Vass K. A longitudinal analysis of the association between menopause and depression. Results from the Massachusetts Women’s Health Study. Ann Epidemiol. 1994;4(3):214–20.PubMedCrossRefGoogle Scholar
  82. 82.
    Cohen LS, Soares CN, Vitonis AF, Otto MW, Harlow BL. Risk for new onset of depression during the menopausal transition: the Harvard study of moods and cycles. Arch Gen Psychiatry. 2006;63(4):385–90.PubMedCrossRefGoogle Scholar
  83. 83.
    Greene JG. Constructing a standard climacteric scale. Maturitas. 1998;29:25–31.PubMedCrossRefGoogle Scholar
  84. 84.
    Greene JG. Guide to the greene climacteric scale. Glasgow: University of Glasgow; 1991.Google Scholar
  85. 85.
    Hauser GA, Huber IC, Keller PJ, Lauritzen C, Schneider HPG. Evaluation der klinischen Beschwerden (Menopause Rating Scale). Zentralbl Gynakol. 1994;116:16–23.PubMedGoogle Scholar
  86. 86.
    Potthoff P, Heinemann LAJ, Schneider HPG, Rosemeier HP, Hauser GA. Menopause-Rating Skala (MRS): methodische standardisierung in der deutschen Bevölkerung. Zentralbl Gynakol. 2000;122:280–6.PubMedGoogle Scholar
  87. 87.
    Schneider HPG, Heinemann LAJ, Rosemeier HP, Potthoff P, Behre HM. The Menopause Rating Scale (MRS): reliability of scores of menopausal complaints. Climacteric. 2000;3(1):59–64.PubMedCrossRefGoogle Scholar
  88. 88.
    Hilditch JR, Lewis J, Peter A, et al. A menopause-specific quality of life questionnaire: development and psychometric properties. Maturitas. 2008;61(1–2):107–21.PubMedCrossRefGoogle Scholar
  89. 89.
    Im E-O. The midlife women’s symptom index (MSI). Health Care Women Int. 2006;27(3):268–87.PubMedCrossRefGoogle Scholar
  90. 90.
    Avis NE, Kaufert PA, Lock M, McKinlay SM, Vass K. The evolution of menopausal symptoms. Bailliere Clin Endocrinol Metab. 1993;7(1):17–32.CrossRefGoogle Scholar
  91. 91.
    Pimenta F, Leal I, Maroco J, Ramos C. Menopause Symptoms’ Severity Inventory (MSSI-38): assessing the frequency and intensity of symptoms. Climacteric. 2012;15(2):143–52.PubMedCrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Jeronimo Mendes-Ribeiro
    • 1
  • Mario Juruena
    • 2
  • Luisa Caropreso
    • 3
  • Maha M. Eltayebani
    • 4
    • 5
  • David L. Streiner
    • 6
  1. 1.Brazilian Association of PsychiatryRio de JaneiroBrazil
  2. 2.Department of Psychological MedicineInstitute of Psychiatry, Psychology and Neurosciences-King’s College LondonLondonUK
  3. 3.McMaster University – Women’s Health Concerns Clinic (WHCC) – St. Joseph’s HealthcareHamiltonCanada
  4. 4.Women’s Health Concerns Clinic (WHCC), Mood Disorder Program – St. Joseph’s HealthcareHamiltonCanada
  5. 5.Department of Neuropsychiatry, Faculty of MedicineAlexandria UniversityAlexandriaEgypt
  6. 6.Department of Psychiatry and Behavioural NeurosciencesMcMaster UniversityHamiltonCanada

Personalised recommendations