Advertisement

Psychiatric Quarterly

, Volume 89, Issue 1, pp 141–155 | Cite as

Minimal Clinically Important Differences (MCID) in Assessing Outcomes of Post-Traumatic Stress Disorder

  • Elina A. Stefanovics
  • Robert A. Rosenheck
  • Karen M. Jones
  • Grant Huang
  • John H. Krystal
Original Paper

Abstract

This study sought to determine the minimal clinically important difference (MCID) for two frequently used measures of symptom severity in Post-Traumatic Stress Disorder: the Clinician Administered PTSD Scale (CAPS) and the PTSD Symptom Checklist (PCL). Data from a randomized clinical trial of antipsychotic medication in military-related treatment-resistant PTSD (N= 267) included assessments 4 times over 26 weeks. Methods for estimating the MCID were based on both the anchor-based approach, using the Clinical Global Impressions (CGI) severity and improvement scales, rated by both clinicians and patients; and the distribution-based approach (based on standardized z-scores). Severity and change scores on the CAPS and PCL were converted to z-scores and compared across CGI levels using analysis of variance. The average difference in CAPS z-scores between each of three CGI levels between “moderate” to “severe” and from “no change” to “much improved” was 0.758 for clinician CGI ratings and 0.525 for patient CGI ratings and were similar for the PCL (0.483 and 0.471) with all differences significant at p<.0001). Clinically meaningful CAPS and PCL severity and change z-scores range between 0.5–0.8 standard deviations. The MCID estimates suggested here provide an empirical basis for determining whether statistically significant changes in CAPS and PCL scores are clinically meaningful.

Keywords

Minimal clinically important difference PTSD Outcome assessment 

Notes

Compliance with Ethical Standards

This study is secondary data analysis only. The Human Rights Committee of the VA Cooperative Studies Program and Institutional Review Boards of each of the participating VA Medical Centers approved the original study (VA Cooperative Study 504 (CSP 504) – “Risperidone Treatment for Military Service Related Chronic Post-Traumatic Stress Disorder).

Conflicts of Interest

The authors report no conflicts of interest with respect to the content of the manuscript.

References

  1. 1.
    Breslau, N., Davis, G. C., Andreski, P., & Peterson, E. (1991). Traumatic events and posttraumatic stress disorder in an urban population of young adults. Archives of general psychiatry, 48(3), 216–222.CrossRefPubMedGoogle Scholar
  2. 2.
    Kessler, R. C., Sonnega, A., Bromet, E., Hughes, M., & Nelson, C. B. (1995). Posttraumatic stress disorder in the National Comorbidity Survey. Archives of general psychiatry, 52(12), 1048–1060.CrossRefPubMedGoogle Scholar
  3. 3.
    Brown, P. J., Recupero, P. R., & Stout, R. (1995). PTSD substance abuse comorbidity and treatment utilization. Addictive behaviors, 20(2), 251–254.CrossRefPubMedGoogle Scholar
  4. 4.
    Brown, P. J., Stout, R. L., & Mueller, T. (1999). Substance use disorder and posttraumatic stress disorder comorbidity: Addiction and psychiatric treatment rates. Psychology of Addictive Behaviors, 13(2), 115.CrossRefGoogle Scholar
  5. 5.
    Seal, K. H., Bertenthal, D., Miner, C. R., Sen, S., & Marmar, C. (2007). Bringing the war back home: Mental health disorders among 103 788 US veterans returning from Iraq and Afghanistan seen at Department of Veterans Affairs Facilities. Archives of Internal Medicine, 167(5), 476–482.CrossRefPubMedGoogle Scholar
  6. 6.
    Association, A. P. (2013). Diagnostic and Statistical Manual of Mental Disorders (DSM-5®): American Psychiatric Pub.CrossRefGoogle Scholar
  7. 7.
    DSM-5. (2013). Diagnostic and statistical manual of mental disorders (DSM-5®): American Psychiatric Pub.Google Scholar
  8. 8.
    Tanielian, T. L., & Jaycox, L. (2008). Invisible wounds of war: Psychological and cognitive injuries, their consequences, and services to assist recovery (Vol. 1): Rand Corporation.Google Scholar
  9. 9.
    Hermes, E. D., Rosenheck, R. A., Desai, R., & Fontana, A. F. (2012a). Recent trends in the treatment of posttraumatic stress disorder and other mental disorders in the VHA. Psychiatric Services.Google Scholar
  10. 10.
    Marmar, C. R., Schlenger, W., Henn-Haase, C., Qian, M., Purchia, E., Li, M.,. .. Horesh, D. (2015). Course of posttraumatic stress disorder 40 years after the Vietnam War: Findings from the National Vietnam Veterans Longitudinal Study. JAMA Psychiatry, 72(9), 875–881.Google Scholar
  11. 11.
    Forneris, C. A. (2002). Outpatient care use among female veterans: Differences between mental health and non-mental health users. Military medicine, 167(1), 10.PubMedGoogle Scholar
  12. 12.
    Berg, A., Breslau, N., Goodman, S., Lezak, M., Matchar, D., Mellman, T.,. .. Vega, W. (2008). Treatment of posttraumatic stress disorder: an assessment of the evidence. Institute of.Google Scholar
  13. 13.
    Creamer, M., & Forbes, D. (2004). Treatment of posttraumatic stress disorder in military and veteran populations. Psychotherapy: Theory, Research, Practice, Training, 41(4), 388.Google Scholar
  14. 14.
    Blake, D., Weathers, F., Nagy, L., Kaloupek, D., Klauminzer, G., Charney, D., & Keane, T. (1990). A clinician rating scale for assessing current and lifetime PTSD: The CAPS-1.Google Scholar
  15. 15.
    Blake, D. D., Weathers, F. W., Nagy, L. M., Kaloupek, D. G., Gusman, F. D., Charney, D. S., & Keane, T. M. (1995). The development of a clinician-administered PTSD scale. Journal of traumatic stress, 8(1), 75–90.CrossRefPubMedGoogle Scholar
  16. 16.
    Weathers, F. W., Keane, T. M., & Davidson, J. R. (2001). Clinician-Administered PTSD Scale: A review of the first ten years of research. Depression and anxiety, 13(3), 132–156.CrossRefPubMedGoogle Scholar
  17. 17.
    Hermes, E. D., Sokoloff, D., Stroup, T. S., & Rosenheck, R. A. (2012b). Minimum clinically important difference in the Positive and Negative Syndrome Scale with data from the Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE). The Journal of clinical psychiatry, 73(4), 1,478–532.CrossRefGoogle Scholar
  18. 18.
    Leucht, S., Kane, J. M., Kissling, W., Hamann, J., Etschel, E., & Engel, R. R. (2005b). What does the PANSS mean? Schizophrenia research, 79(2), 231–238.CrossRefPubMedGoogle Scholar
  19. 19.
    Church, D., Geronilla, L., & Dinter, I. (2009). Psychological symptom change in veterans after six sessions of Emotional Freedom Techniques (EFT): An observational study. Electronic journal article]. International Journal of Healing and Caring, 9(1).Google Scholar
  20. 20.
    Pigeon, W. R., Campbell, C. E., Possemato, K., & Ouimette, P. (2013). Longitudinal relationships of insomnia, nightmares, and PTSD severity in recent combat veterans. Journal of psychosomatic research, 75(6), 546–550.CrossRefPubMedGoogle Scholar
  21. 21.
    Difede, J., Malta, L. S., Best, S., Henn-Haase, C., Metzler, T., Bryant, R., & Marmar, C. (2007). A randomized controlled clinical treatment trial for World Trade Center attack-related PTSD in disaster workers. The Journal of nervous and mental disease, 195(10), 861–865.CrossRefPubMedGoogle Scholar
  22. 22.
    Hien, D. A., Jiang, H., Campbell, A. N., Hu, M.-C., Miele, G. M., Cohen, L. R.,. .. Robinson, J. (2010). Do treatment improvements in PTSD severity affect substance use outcomes? A secondary analysis from a randomized clinical trial in NIDA's Clinical Trials Network. American journal of Psychiatry.Google Scholar
  23. 23.
    Copay, A. G., Subach, B. R., Glassman, S. D., Polly, D. W., & Schuler, T. C. (2007). Understanding the minimum clinically important difference: a review of concepts and methods. The Spine Journal, 7(5), 541–546.CrossRefPubMedGoogle Scholar
  24. 24.
    Hays, R. D., & Woolley, J. M. (2000). The concept of clinically meaningful difference in health-related quality-of-life research. Pharmacoeconomics, 18(5), 419–423.CrossRefPubMedGoogle Scholar
  25. 25.
    Guyatt, G., Walter, S., & Norman, G. (1987). Measuring change over time: assessing the usefulness of evaluative instruments. Journal of chronic diseases, 40(2), 171–178.CrossRefPubMedGoogle Scholar
  26. 26.
    Jaeschke, R., Singer, J., & Guyatt, G. H. (1989). Measurement of health status: ascertaining the minimal clinically important difference. Controlled clinical trials, 10(4), 407–415.CrossRefPubMedGoogle Scholar
  27. 27.
    Revicki, D., Hays, R. D., Cella, D., & Sloan, J. (2008). Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. Journal of clinical epidemiology, 61(2), 102–109.CrossRefPubMedGoogle Scholar
  28. 28.
    Wells, G., Beaton, D., Shea, B., Boers, M., Simon, L., Strand, V.,. .. Tugwell, P. (2001). Minimal clinically important differences: review of methods. The Journal of rheumatology, 28(2), 406–412.Google Scholar
  29. 29.
    Crosby, R. D., Kolotkin, R. L., & Williams, G. R. (2003). Defining clinically meaningful change in health-related quality of life. Journal of clinical epidemiology, 56(5), 395–407.CrossRefPubMedGoogle Scholar
  30. 30.
    Lydick, E., & Epstein, R. (1993). Interpretation of quality of life changes. Quality of life research, 2(3), 221–226.CrossRefPubMedGoogle Scholar
  31. 31.
    Leddy-Stacy, M. A., & Rosenheck, R. (2016). Obtaining employment as an anchor for estimating the minimum clinically important difference on the Positive and Negative Syndrome Scale (PANSS) in schizophrenia. Psychiatry research, 238, 304–309.CrossRefPubMedGoogle Scholar
  32. 32.
    de Vet, H. C., Ostelo, R. W., Terwee, C. B., van der Roer, N., Knol, D. L., Beckerman, H.,. .. Bouter, L. M. (2007). Minimally important change determined by a visual method integrating an anchor-based and a distribution-based approach. Quality of life research, 16(1), 131–142.Google Scholar
  33. 33.
    Cohen, J. (1977). Statistical power analysis for the behavioral sciences (rev: Lawrence Erlbaum Associates, Inc. Google Scholar
  34. 34.
    Deyo, R. A., Diehr, P., & Patrick, D. L. (1991). Reproducibility and responsiveness of health status measures statistics and strategies for evaluation. Controlled clinical trials, 12(4), S142-S158.CrossRefGoogle Scholar
  35. 35.
    Kazis, L. E., Anderson, J. J., & Meenan, R. F. (1989). Effect sizes for interpreting changes in health status. Medical Care, 27(3), S178-S189.CrossRefPubMedGoogle Scholar
  36. 36.
    Sloan, J., Vargas-Chanes, D., Kamath, C., Sargent, D., Novotny, P., Atherton, P.,. .. Loprinzi, C. (2003). Detecting worms, ducks and elephants: a simple approach for defining clinically relevant effects in quality-of-life measures. J Cancer Integr Med, 1(1), 41–47.Google Scholar
  37. 37.
    Walters, S. J., & Brazier, J. E. (2005). Comparison of the minimally important difference for two health state utility measures: EQ-5D and SF-6D. Quality of life research, 14(6), 1523–1532.CrossRefPubMedGoogle Scholar
  38. 38.
    Krystal, J. H., Rosenheck, R. A., Cramer, J. A., Vessicchio, J. C., Jones, K. M., Vertrees, J. E.,. .. Group, V. A. C. S. N. (2011). Adjunctive risperidone treatment for antidepressant-resistant symptoms of chronic military service–related PTSD: a randomized trial. Jama, 306(5), 493–502.Google Scholar
  39. 39.
    Hovens, J., Van der Ploeg, H., Klaarenbeek, M., Bramsen, I., Schreuder, J., & Rivero, V. V. (1994). The assessment of posttraumatic stress disorder: with the Clinician Administered PTSD Scale: Dutch results. Journal of clinical psychology, 50(3), 325–340.CrossRefPubMedGoogle Scholar
  40. 40.
    Paunović, N., & Öst, L. G. (2005). Psychometric properties of a Swedish translation of the Clinician-Administered PTSD Scale-Diagnostic Version. Journal of traumatic stress, 18(2), 161–164.CrossRefPubMedGoogle Scholar
  41. 41.
    Schnyder, U., & Moergeli, H. (2002). German version of clinician-administered PTSD scale. Journal of traumatic stress, 15(6), 487–492.CrossRefPubMedGoogle Scholar
  42. 42.
    Lillywhite, A., & Neal, L. (1993). The importance of severity as a factor in post-traumatic stress disorder.Google Scholar
  43. 43.
    Gearon, J. S., Bellack, A. S., & Tenhula, W. N. (2004). Preliminary reliability and validity of the Clinician-Administered PTSD Scale for schizophrenia. Journal of consulting and clinical psychology, 72(1), 121.CrossRefPubMedGoogle Scholar
  44. 44.
    Lee, B. Y., Kim, Y., Yi, S. M., Eun, H. J., Kim, D. I., & Kim, J. Y. (1999). A reliability and validity study of a clinician-administered PTSD scale. Journal of Korean Neuropsychiatric Association, 38(3), 514–522.Google Scholar
  45. 45.
    Newman, E., Kaloupek, D. G., & Keane, T. M. (1996). Assessment of posttraumatic stress disorder in clinical and research settings.Google Scholar
  46. 46.
    Weathers, F., Litz, B., Huska, J., & Keane, T. (1994b). PTSD Checklist—Military Version (PCL-M) for DSM-IV. Boston: National Center for PTSD—Behavioral Science Division.Google Scholar
  47. 47.
    Weathers, F., Litz, B., Herman, D., Huska, J., & Keane, T. (1994a). The PTSD checklist-civilian version (PCL-C). Boston, MA: National Center for PTSD.Google Scholar
  48. 48.
    Weathers, F. W., Litz, B. T., Herman, D. S., Huska, J. A., & Keane, T. M. (1993). The PTSD Checklist (PCL): Reliability, validity, and diagnostic utility. Paper presented at the Annual Convention of the International Society for Traumatic Stress Studies.Google Scholar
  49. 49.
    Association, A. P. (1987). Diagnostic and Statistical Manual of Mental Disorders-Revision: American Psychiatric Association.Google Scholar
  50. 50.
    Creamer, M., Bell, R., & Failla, S. (2003). Psychometric properties of the impact of event scale—revised. Behaviour research and therapy, 41(12), 1489–1496.CrossRefPubMedGoogle Scholar
  51. 51.
    Forbes, D., Creamer, M., & Biddle, D. (2001). The validity of the PTSD checklist as a measure of symptomatic change in combat-related PTSD. Behaviour research and therapy, 39(8), 977–986.CrossRefPubMedGoogle Scholar
  52. 52.
    Dobie, D. J., Kivlahan, D. R., Maynard, C., Bush, K. R., McFall, M., Epler, A. J., & Bradley, K. A. (2002). Screening for post-traumatic stress disorder in female Veteran’s Affairs patients: validation of the PTSD checklist. General Hospital Psychiatry, 24(6), 367–374.CrossRefPubMedGoogle Scholar
  53. 53.
    Lang, A. J., Laffaye, C., Satz, L. E., Dresselhaus, T. R., & Stein, M. B. (2003). Sensitivity and specificity of the PTSD checklist in detecting PTSD in female veterans in primary care. Journal of traumatic stress, 16(3), 257–264.CrossRefPubMedGoogle Scholar
  54. 54.
    Walker, E. A., Newman, E., Dobie, D. J., Ciechanowski, P., & Katon, W. (2002). Validation of the PTSD checklist in an HMO sample of women. General Hospital Psychiatry, 24(6), 375–380.CrossRefPubMedGoogle Scholar
  55. 55.
    Guy, W. (1976). Clinical global impression scale. The ECDEU Assessment Manual for Psychopharmacology-Revised Volume DHEW Publ No ADM, 76(338), 218–222.Google Scholar
  56. 56.
    Hale, A., Corral, R.-M., Mencacci, C., Ruiz, J. S., Severo, C. A., & Gentil, V. (2010). Superior antidepressant efficacy results of agomelatine versus fluoxetine in severe MDD patients: a randomized, double-blind study. International clinical psychopharmacology, 25(6), 305–314.CrossRefPubMedGoogle Scholar
  57. 57.
    Hsieh, M.-H., Lin, W.-W., Chen, S.-T., Chen, K.-C., Chen, K.-P., Chiu, N.-Y.,. .. Lai, T.-J. (2010). A 64-week, multicenter, open-label study of aripiprazole effectiveness in the management of patients with schizophrenia or schizoaffective disorder in a general psychiatric outpatient setting. Annals of General Psychiatry, 9(1), 1.Google Scholar
  58. 58.
    Bandelow, B., Baldwin, D. S., Dolberg, O. T., Andersen, H. F., & Stein, D. J. (2006). What is the threshold for symptomatic response and remission for major depressive disorder, panic disorder, social anxiety disorder, and generalized anxiety disorder? The Journal of clinical psychiatry, 67(9), 1428–1434.CrossRefPubMedGoogle Scholar
  59. 59.
    Leucht, S., & Engel, R. R. (2006). The relative sensitivity of the Clinical Global Impressions Scale and the Brief Psychiatric Rating Scale in antipsychotic drug trials. Neuropsychopharmacology, 31(2), 406–412.CrossRefPubMedGoogle Scholar
  60. 60.
    Leucht, S., Kane, J. M., Kissling, W., Hamann, J., Etschel, E., & Engel, R. (2005a). Clinical implications of brief psychiatric rating scale scores. The British Journal of Psychiatry, 187(4), 366–371.CrossRefPubMedGoogle Scholar
  61. 61.
    Spielmans, G. I., & McFall, J. P. (2006). A comparative meta-analysis of clinical global impressions change in antidepressant trials. The Journal of nervous and mental disease, 194(11), 845–852.CrossRefPubMedGoogle Scholar
  62. 62.
    Zaider, T. I., Heimberg, R. G., Fresco, D., Schneier, F., & Liebowitz, M. (2003). Evaluation of the clinical global impression scale among individuals with social anxiety disorder. Psychological medicine, 33(04), 611–622.CrossRefPubMedGoogle Scholar
  63. 63.
    Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Beck depression inventory-II. San Antonio, TX, 78204–72498.Google Scholar
  64. 64.
    Hamilton, M. (1967). Development of a rating scale for primary depressive illness. British journal of social and clinical psychology, 6(4), 278–296.CrossRefPubMedGoogle Scholar
  65. 65.
    Kørner, A., Lauritzen, L., Abelskov, K., Gulmann, N. C., Brodersen, A.-M., Wedervang-Jensen, T., & Kjeldgaard, K. M. (2007). Rating scales for depression in the elderly: external and internal validity. The Journal of clinical psychiatry, 68(3), 384–389.CrossRefPubMedGoogle Scholar
  66. 66.
    Montgomery, S. A., & Asberg, M. (1979). A new depression scale designed to be sensitive to change. The British Journal of Psychiatry, 134(4), 382–389.CrossRefPubMedGoogle Scholar
  67. 67.
    Riedel, M., Möller, H.-J., Obermeier, M., Schennach-Wolff, R., Bauer, M., Adli, M.,. .. Laux, G. (2010). Response and remission criteria in major depression–a validation of current practice. Journal of psychiatric research, 44(15), 1063–1068.Google Scholar
  68. 68.
    Samsa, G., Edelman, D., Rothman, M. L., Williams, G. R., Lipscomb, J., & Matchar, D. (1999). Determining clinically important differences in health status measures. Pharmacoeconomics, 15(2), 141–155.CrossRefPubMedGoogle Scholar
  69. 69.
    Spearman, C. (1904). The proof and measurement of association between two things. The American journal of psychology, 15(1), 72–101.CrossRefGoogle Scholar
  70. 70.
    SAS Institute, I. (2011). SAS® 9.3: Software. SAS Institute, Inc. Cary, NC.Google Scholar
  71. 71.
    Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences. 2nd edn. Hillsdale, New Jersey: L: Erlbaum.Google Scholar
  72. 72.
    Steenkamp, M. M., Litz, B. T., Hoge, C. W., & Marmar, C. R. (2015). Psychotherapy for military-related PTSD: A review of randomized clinical trials. Jama, 314(5), 489–500.CrossRefPubMedGoogle Scholar
  73. 73.
    Davidson, J. R., Rothbaum, B. O., van der Kolk, B. A., Sikes, C. R., & Farfel, G. M. (2001). Multicenter, double-blind comparison of sertraline and placebo in the treatment of posttraumatic stress disorder. Archives of general psychiatry, 58(5), 485–492.CrossRefPubMedGoogle Scholar
  74. 74.
    Marshall, R. D., Beebe, K. L., Oldham, M., & Zaninelli, R. (2001). Efficacy and safety of paroxetine treatment for chronic PTSD: a fixed-dose, placebo-controlled study. American journal of Psychiatry, 158(12), 1982–1988.CrossRefPubMedGoogle Scholar
  75. 75.
    Schnurr, P. P., Friedman, M. J., Foy, D. W., Shea, M. T., Hsieh, F. Y., Lavori, P. W.,. .. Bernardy, N. C. (2003). Randomized trial of trauma-focused group therapy for posttraumatic stress disorder: Results from a Department of Veterans Affairs cooperative study. Archives of general psychiatry, 60(5), 481–489.Google Scholar
  76. 76.
    Schnurr, P. P., Friedman, M. J., Engel, C. C., Foa, E. B., Shea, M. T., Chow, B. K.,. .. Haug, R. (2007). Cognitive behavioral therapy for posttraumatic stress disorder in women: a randomized controlled trial. Jama, 297(8), 820–830.Google Scholar
  77. 77.
    Sloan, J. A., Cella, D., & Hays, R. D. (2005). Clinical significance of patient-reported questionnaire data: another step toward consensus. Journal of clinical epidemiology, 58(12), 1217–1219.CrossRefPubMedGoogle Scholar
  78. 78.
    Dworkin, R. H., Turk, D. C., Wyrwich, K. W., Beaton, D., Cleeland, C. S., Farrar, J. T.,. .. Ader, D. N. (2008). Interpreting the clinical importance of treatment outcomes in chronic pain clinical trials: IMMPACT recommendations. The Journal of Pain, 9(2), 105–121.Google Scholar
  79. 79.
    Wisco, B. E., Marx, B. P., Miller, M. W., Wolf, E. J., Mota, N. P., Krystal, J. H.,. .. Pietrzak, R. H. (2016). Probable posttraumatic stress disorder in the US veteran population according to DSM-5: results from the National Health and Resilience in Veterans Study. The Journal of clinical psychiatry, 77(11), 1503–1510.Google Scholar
  80. 80.
    Zoellner, L. A., Pruitt, L. D., Farach, F. J., & Jun, J. J. (2014). Understanding heterogeneity in PTSD: fear, dysphoria, and distress. Depression and anxiety, 31(2), 97–106.CrossRefPubMedGoogle Scholar
  81. 81.
    Haagsma, J. A., Polinder, S., Olff, M., Toet, H., Bonsel, G. J., & van Beeck, E. F. (2012). Posttraumatic stress symptoms and health-related quality of life: a two year follow up study of injury treated at the emergency department. BMC psychiatry, 12(1), 1.CrossRefPubMedPubMedCentralGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2017

Authors and Affiliations

  • Elina A. Stefanovics
    • 1
    • 2
  • Robert A. Rosenheck
    • 1
    • 2
  • Karen M. Jones
    • 3
  • Grant Huang
    • 4
  • John H. Krystal
    • 1
    • 2
    • 5
  1. 1.VA New England Mental Illness Research and Education Center, VA Connecticut Healthcare System (116A-4)West HavenUSA
  2. 2.Department of PsychiatryYale University School of MedicineNew HavenUSA
  3. 3.VA Cooperative Studies Coordinating CenterPerryUSA
  4. 4.VA Cooperative Studies Program Central OfficeWashingtonUSA
  5. 5.Clinical Neuroscience Division, Department of Veterans Affairs National Center for PTSDWest HavenUSA

Personalised recommendations