Advertisement

The Association Between Clinician and Perceived Organizational Factors with Early Fidelity to Cognitive Processing Therapy for Posttraumatic Stress Disorder in a Randomized Controlled Implementation Trial

  • Iris Sijercic
  • Jeanine E. M. Lane
  • Cassidy A. Gutner
  • Candice M. Monson
  • Shannon Wiltsey StirmanEmail author
Original Article

Abstract

A common metric for determining implementation success is the measurement of clinician adherence to, and competence in, delivering a psychotherapy. The present study examined clinician and organizational factors as predictors of early adherence and competence among 78 clinicians delivering cognitive processing therapy (CPT), an evidence-based psychotherapy (EBP) for posttraumatic stress disorder, in a randomized controlled implementation trial. Results indicated that clinicians’ willingness to adopt an EBP if required to do so was significantly associated with early adherence and competence in CPT delivery. Level of clinician education was significantly associated with early competence in delivering CPT. Organizational factors did not predict early adherence or competence. Implications of the findings are discussed.

Keywords

Implementation outcomes Dissemination Fidelity Organizational factors Clinician factors Cognitive processing therapy 

Notes

Funding

This study was funded by the Canadian Institutes for Health Research Grant [259353].

Compliance with Ethical Standards

Conflict of interest

Dr. Monson receives book royalties from publication of the Cognitive Processing Therapy Comprehensive Manual (Resick et al. 2016). All other authors declare no conflicts of interest.

References

  1. Aarons, G. A. (2005). Measuring provider attitudes toward evidence-based practice: Consideration of organizational context and individual differences. Child and Adolescent Psychiatric Clinics of North America, 14, 255–271.  https://doi.org/10.1016/j.chc.2004.04.008.CrossRefGoogle Scholar
  2. Aarons, G. A., Cafri, G., Lugo, L., & Sawitzky, A. (2012). Expanding the domains of attitudes towards evidence-based practice: The Evidence Based Practice Attitude Scale-50. Administration and Policy in Mental Health and Mental Health Services Research, 39, 331–340.  https://doi.org/10.1007/s10488-010-0302-3.CrossRefGoogle Scholar
  3. Aarons, G. A., & Sawitzky, A. (2006). Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychological Services, 3, 61–72.  https://doi.org/10.1037/1541-1559.3.1.61.CrossRefGoogle Scholar
  4. Aarons, G. A., Sommerfeld, D. H., Hecht, D. B., Silovsky, J. F., & Chaffin, M. J. (2009). The impact of evidence-based practice implementation and fidelity monitoring on staff turnover: Evidence for a protective effect. Journal of Consulting and Clinical Psychology, 77, 270–280.  https://doi.org/10.1037/a0013223.CrossRefGoogle Scholar
  5. Asgary-Eden, V., & Lee, C. M. (2012). Implementing an evidence-based parenting program in community agencies: What helps and what gets in the way? Administration and Policy in Mental Health and Mental Health Services Research, 39, 478–488.  https://doi.org/10.1007/s10488-011-0371-y.CrossRefGoogle Scholar
  6. Becker-Haimes, E. M., Williams, N. J., Okamura, K. H., & Beidas, R. S. (2019). Interactions between clinician and organizational characteristics to predict cognitive-behavioral and psychodynamic therapy use. Administration and Policy in Mental Health and Mental Health Services Research.  https://doi.org/10.1007/s10488-019-00959-6.Google Scholar
  7. Beidas, R. S., Edmunds, J., Ditty, M., Watkins, J., Walsh, L., Marcus, S., et al. (2014). Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety? Administration and Policy in Mental Health and Mental Health Services Research, 41, 788–799.  https://doi.org/10.1007/s10488-013-0529-x.CrossRefGoogle Scholar
  8. Beidas, R. S., Marcus, S., Aarons, G. A., Hoagwood, K. E., Schoenwald, S., Evans, A. C., … Mandell, D. S. (2015). Predictors of community therapists’ use of therapy techniques in a large public mental health system. Journal of the American Medical Association Pediatrics, 169, 374–382.  https://doi.org/10.1001/jamapediatrics.2014.3736
  9. Campbell, B. K., Buti, A., Fussell, H. E., Srikanth, P., McCarty, D., & Guydish, J. R. (2013). Therapist predictors of treatment delivery fidelity in a community-based trial of 12-step facilitation. The American Journal of Drug and Alcohol Abuse, 39, 304–311.  https://doi.org/10.3109/00952990.2013.799175.CrossRefGoogle Scholar
  10. Carpenter, K. M., Cheng, W. Y., Smith, J. L., Brooks, A. C., Amrhein, P. C., Wain, R. M., et al. (2012). “Old dogs” and new skills: How clinician characteristics relate to motivational interviewing skills before, during, and after training. Journal of Consulting and Clinical Psychology, 80, 560–573.  https://doi.org/10.1037/a0028362.CrossRefGoogle Scholar
  11. Cook, J. M., Dinnen, S., Thompson, R., Simiola, V., & Schnurr, P. P. (2014). Changes in implementation of two evidence-based psychotherapies for PTSD in VA residential treatment programs: A national investigation. Journal of Traumatic Stress, 27, 137–143.  https://doi.org/10.1002/jts.21902.CrossRefGoogle Scholar
  12. Creed, T. A., Frankel, S. A., German, R. E., Green, K. L., Jager-Hyman, S., Taylor, K. P., et al. (2016). Implementation of transdiagnostic cognitive therapy in community behavioral health: The beck community initiative. Journal of Consulting and Clinical Psychology.  https://doi.org/10.1037/ccp0000105.Google Scholar
  13. Decker, S. E., Jameson, M. T., & Naugle, A. E. (2011). Therapist training in empirically supported treatments: A review of evaluation methods for short- and long-term outcomes. Administration and Policy in Mental Health and Mental Health Services Research, 38, 254–286.  https://doi.org/10.1007/s10488-011-0360-1.CrossRefGoogle Scholar
  14. Ehrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2014). Assessing the organizational context for EBP implementation: The development and validity testing of the implementation climate scale (ICS). Implementation Science, 9, 11.  https://doi.org/10.1186/s13012-014-0157-1.CrossRefGoogle Scholar
  15. Enders, C. K. (2001). A primer on maximum likelihood algorithms available for use with missing data. Structural Equation Modeling, 8, 128–141.  https://doi.org/10.1207/S15328007SEM0801_7.CrossRefGoogle Scholar
  16. Farmer, C. C., Mitchell, K. S., Parker-Guilbert, K., & Galovski, T. E. (2017). Fidelity to the cognitive processing therapy protocol: Evaluation of critical elements. Behavior Therapy, 48, 195–206.  https://doi.org/10.1016/j.beth.2016.02.009.CrossRefGoogle Scholar
  17. Forsberg, S., Fitzpatrick, K. K., Darcy, A., Aspen, V., Accurso, E. C., Bryson, S. W., … Lock, J. (2015). Development and evaluation of a treatment fidelity instrument for family-based treatment of adolescent anorexia nervosa. International Journal of Eating Disorders, 48, 91–99.  https://doi.org/10.1002/eat.22337
  18. Garner, B. R., Hunter, B. D., Godley, S. H., & Godley, M. D. (2012). Training and retaining staff to competently deliver an evidence-based practice: The role of staff attributes and perceptions of organizational functioning. Journal of Substance Abuse Treatment, 42, 191–200.  https://doi.org/10.1016/j.jsat.2011.10.016.CrossRefGoogle Scholar
  19. Glick, W. H. (1985). Conceptualizing and measuring organizational and psychological climate: Pitfalls in multilevel research. Academy of Management Review, 10, 601–616.  https://doi.org/10.2307/258140.CrossRefGoogle Scholar
  20. Glisson, C., & Green, P. (2011). Organizational climate, services, and outcomes in child welfare systems. Child Abuse and Neglect, 35, 582–591.  https://doi.org/10.1016/j.chiabu.2011.04.009.CrossRefGoogle Scholar
  21. Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., et al. (2010). Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. Journal of Consulting and Clinical Psychology, 78, 537–550.  https://doi.org/10.1037/a0019160.CrossRefGoogle Scholar
  22. Godley, S. H., White, W. L., Diamond, G., Passetti, L., & Titus, J. C. (2001). Therapist reactions to manual-guided therapies for the treatment of adolescent marijuana users. Clinical Psychology: Science and Practice, 8, 405–417.  https://doi.org/10.1093/clipsy.8.4.405.Google Scholar
  23. Henggeler, S. W., Chapman, J. E., Rowland, M. D., Halliday-Boykins, C. A., Randall, J., Shackelford, J., et al. (2008). Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. Journal of Consulting and Clinical Psychology, 76, 556–567.  https://doi.org/10.1037/0022-006X.76.4.556.CrossRefGoogle Scholar
  24. Hoagwood, K., Schoenwald, S. K., & Chapman, J. E. (2003). Dimensions of Organizational Readiness-Revised (DOOR-R). Unpublished instrument.Google Scholar
  25. Holder, N., Holliday, R., Williams, R., Mullen, K., & Suris, A. (2017). A preliminary examination of the role of psychotherapist fidelity on outcomes of cognitive processing therapy during an RCT for military sexual trauma-related PTSD. Cognitive Behaviour Therapy, 47, 76–89.  https://doi.org/10.1080/16506073.2017.1357750.CrossRefGoogle Scholar
  26. James, I. A., Blackburn, I. M., Milne, D. L., & Reichfelt, F. K. (2001). Moderators of trainee therapists’ competence in cognitive therapy. British Journal of Clinical Psychology, 40, 131–140.  https://doi.org/10.1348/014466501163580.CrossRefGoogle Scholar
  27. James, L. R., Choi, C. C., Ko, C. H. E., McNeil, P. K., Minton, M. K., Wright, M. A., et al. (2008). Organizational and psychological climate: A review of theory and research. European Journal of work and organizational psychology, 17, 5–32.  https://doi.org/10.1080/13594320701662550.CrossRefGoogle Scholar
  28. Jerrell, J. M., & Ridgely, M. S. (1999). Impact of robustness of program implementation on outcomes of clients in dual diagnosis programs. Psychiatric Services, 50, 109–112.  https://doi.org/10.1176/ps.50.1.109.CrossRefGoogle Scholar
  29. Jones, A. P., & James, L. R. (1979). Psychological climate: Dimensions and relationships of individual and aggregated work environment perceptions. Organizational Behavior and Human Performance, 23, 201–250.  https://doi.org/10.1016/0030-5073(79)90056-4.CrossRefGoogle Scholar
  30. Kirk, R. E. (1996). Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56, 746–759.  https://doi.org/10.1177/0013164496056005002.CrossRefGoogle Scholar
  31. Kolko, D. J., Baumann, B. L., Herschell, A. D., Hart, J. A., Holden, E. A., & Wisniewski, S. R. (2012). Implementation of AF-CBT by community practitioners serving child welfare and mental health: A randomized trial. Child Maltreatment, 17, 32–46.  https://doi.org/10.1177/1077559511427346.CrossRefGoogle Scholar
  32. Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002). Assessing organizational readiness for change. Journal of Substance Abuse Treatment, 22, 197–209.  https://doi.org/10.1016/S0740-5472(02)00233-7.CrossRefGoogle Scholar
  33. Lewis, C. C., & Simons, A. D. (2011). A pilot study disseminating cognitive behavioral therapy for depression: Therapist factors and perceptions of barriers to implementation. Administration and Policy in Mental Health and Mental Health Services Research, 38, 324–334.  https://doi.org/10.1007/s10488-011-0348-x.CrossRefGoogle Scholar
  34. Little, R. J. A. (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83, 1198–1202.  https://doi.org/10.1080/01621459.1988.10478722.CrossRefGoogle Scholar
  35. Lu, W., Yanos, P. T., Gottlieb, J. D., Duva, S. M., Silverstein, S. M., Xie, H., … Mueser, K. T. (2014). Use of fidelity assessments to train clinicians in the CBT for PTSD program for clients with serious mental illness. Psychiatric Services, 63, 785–792.  https://doi.org/10.1176/appi.ps.201000458
  36. McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. American Psychologist, 65, 73–84.  https://doi.org/10.1037/a0018121.CrossRefGoogle Scholar
  37. McHugo, G. J., Drake, R. E., Teague, G. B., & Xie, H. (1999). Fidelity to assertive community treatment and client outcomes in the New Hampshire dual disorders study. Psychiatric Services, 50, 818–824.  https://doi.org/10.1176/ps.50.6.818.CrossRefGoogle Scholar
  38. Meier, A., McGovern, M. P., Lambert-Harris, C., McLeman, B., Franklin, A., Saunders, E. C., et al. (2015). Adherence and competence in two manual-guided therapies for co-occurring substance use and posttraumatic stress disorders: Clinician factors and patient outcomes. The American Journal of Drug and Alcohol Abuse, 41, 527–534.  https://doi.org/10.3109/00952990.2015.1062894.Google Scholar
  39. Monson, C. M., Shields, N., Suvak, M. K., Lane, J. E. M., Shnaider, P., Landy, M. S. H., et al. (2018). A randomized controlled effectiveness trial of training strategies in cognitive processing therapy for posttraumatic stress disorder: Impact on patient outcomes. Behaviour Research and Therapy, 110, 31–40.CrossRefGoogle Scholar
  40. Moore, G. A. (2002). Crossing the chasm: Marketing and selling high-tech products to mainstream customers. New York: Harper Collins.Google Scholar
  41. Nishith, P., & Resick, P. A. (1994). Cognitive Processing Therapy (CPT): Therapist adherence and competence protocol. St. Louis: University of Missouri.Google Scholar
  42. Patterson, M. G., West, M. A., Shackelton, V. J., Dawson, J. F., Lawthom, R., Maitlis, S., et al. (2005). Validating the organizational climate measure: Links to managerial practices, productivity and innovation. Journal of Organizational Behavior, 26, 379–408.  https://doi.org/10.1002/job.312.CrossRefGoogle Scholar
  43. Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., … Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38, 65–76.  https://doi.org/10.1007/s10488-010-0319-7
  44. Resick, P. A., Galovski, T. E., Uhlmansiek, M. O., Scher, C., Clum, G. A., & Young-Xu, Y. (2008). A randomized clinical trial to dismantle components of cognitive processing therapy for posttraumatic stress disorder in female victims of interpersonal violence. Journal of Consulting and Clinical Psychology, 76, 243–258.  https://doi.org/10.1037/0022-006X.76.2.243.CrossRefGoogle Scholar
  45. Resick, P. A., Monson, C. M., & Chard, K. (2016). Cognitive processing therapy for PTSD: A comprehensive manual. New York, NY: Guilford.Google Scholar
  46. Resick, P. A., Nishith, P., Weaver, T. L., Astin, M. C., & Feuer, C. A. (2002). A comparison of cognitive-processing therapy with prolonged exposure and a waiting condition for the treatment of chronic posttraumatic stress disorder in female rape victims. Journal of Consulting and Clinical Psychology, 70, 867–879.  https://doi.org/10.1037/0022-006X.70.4.867.CrossRefGoogle Scholar
  47. Rodriguez, A. (2016). The influence of client-, family-, and therapist-level pretreatment characteristics on therapist delivery of youth psychotherapy treatments (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 10145732).Google Scholar
  48. Sainani, K. L. (2012). Dealing with non-normal data. American Academy of Physical Medicine and Rehabilitation, 4, 1001–1005.  https://doi.org/10.1016/j.pmrj.2012.10.013.Google Scholar
  49. Saldana, L., Chapman, J. E., Henggeler, S. W., & Rowland, M. D. (2007). The Organizational readiness for change scale in adolescent programs: Criterion validity. Journal of Substance Abuse Treatment, 33, 159–169.  https://doi.org/10.1016/j.jsat.2006.12.029.CrossRefGoogle Scholar
  50. Sanders, M. R., & Turner, K. M. T. (2005). Reflections on the challenges of effective dissemination of behavioural family intervention: Our experience with the triple p-positive parenting program. Child and Adolescent Mental Health, 10, 158–169.  https://doi.org/10.1111/j.1475-3588.2005.00367.x.CrossRefGoogle Scholar
  51. Sayer, N. A., Rosen, C. S., Bernardy, N. C., Cook, J. M., Orazem, R. J., Chard, K. M., … Schnurr, P. P. (2017). Context matters: Team and organizational factors associated with reach of evidence-based psychotherapies for PTSD in the veterans health administration. Administration and Policy in Mental Health and Mental Health Services Research, 44, 904–918.  https://doi.org/10.1007/s10488-017-0809-y
  52. Scheffer, J. (2002). Dealing with missing data. Research Letters in the Information and Mathematical Sciences, 3, 153–160.Google Scholar
  53. Schoenwald, S. K., Chapman, J. E., Sheidow, A. J., & Carter, R. E. (2009). Long-term youth criminal outcomes in MST transport: The impact of therapist adherence and organizational climate and structure. Journal of Clinical Child and Adolescent Psychology, 38, 91–105.  https://doi.org/10.1080/15374410802575388.CrossRefGoogle Scholar
  54. Schoenwald, S. K., Letourneau, E. J., & Halliday-Boykins, C. (2005). Predicting therapist adherence to a transported family-based treatment for youth. Journal of Clinical Child and Adolescent Psychology, 34, 658–670.  https://doi.org/10.1207/s15374424jccp3404_8.CrossRefGoogle Scholar
  55. Shmueli, G. (2010). To explain or to predict? Statistical Science, 25, 289–310.  https://doi.org/10.1214/10-STS330.CrossRefGoogle Scholar
  56. Simpson, D. D. (2002). A conceptual framework for transferring research to practice. Journal of Substance Abuse Treatment, 22, 171–182.  https://doi.org/10.1016/S0740-5472(02)00231-3.CrossRefGoogle Scholar
  57. Stirman, S. W., Finley, E. P., Shields, N., Cook, J., Haine-Schlagel, R., Burgess, J. F., … Monson, C. M. (2017). Improving and sustaining delivery of CPT for PTSD in mental health systems: A cluster randomized trial. Implementation Science, 12, 32.  https://doi.org/10.1186/s13012-017-0544-5
  58. Stirman, S. W., Gutner, C. A., Crits-Christoph, P., Edmunds, J., Evans, A. C., & Beidas, R. S. (2015). Relationships between clinician-level attributes and fidelity-consistent and fidelity-inconsistent modifications to an evidence-based psychotherapy. Implementation Science, 10, 115–125.  https://doi.org/10.1186/s13012-015-0308-z.CrossRefGoogle Scholar
  59. Stirman, S. W., Shields, N., Deloriea, J., Landy, M. S. H., Belus, J. M., Maslej, M. M., et al. (2013). A randomized controlled dismantling trial of post-workshop consultation strategies to increase effectiveness and fidelity to an evidence-based psychotherapy for posttraumatic stress disorder. Implementation Science, 8, 82–90.  https://doi.org/10.1186/1748-5908-8-82.CrossRefGoogle Scholar
  60. Strunk, D. R., Brotman, M. A., & DeRubeis, R. J. (2010a). The process of change in cognitive therapy for depression: Predictors of early inter-session symptom gains. Behaviour Research and Therapy, 48, 599–606.  https://doi.org/10.1016/j.brat.2010.03.011.CrossRefGoogle Scholar
  61. Strunk, D. R., Brotman, M. A., DeRubeis, R. J., & Hollon, S. D. (2010b). Therapist competence in cognitive therapy for depression: Predicting subsequent symptom change. Journal of Consulting and Clinical Psychology, 78, 429–437.  https://doi.org/10.1037/a0019631.CrossRefGoogle Scholar
  62. Swain, K., Whitley, R., McHugo, G. J., & Drake, R. E. (2010). The sustainability of evidence-based practices in routine mental health agencies. Community Mental Health Journal, 46, 119–129.  https://doi.org/10.1007/s10597-009-9202-y.CrossRefGoogle Scholar
  63. Thijssen, J., Albrecht, G., Muris, P., & de Ruiter, C. (2017). Treatment fidelity during therapist initial training is related to subsequent effectiveness of parent management training: Oregon Model. Journal of Child and Family Studies, 26, 1991–1999.  https://doi.org/10.1007/s10826-017-0706-8.CrossRefGoogle Scholar
  64. Tooley, E. (2012). Organizational factors and therapist attitudes in the prediction of MI adoption (Doctoral dissertation). Retrieved from ProQuest Dissertations and Theses database. (UMI No. 3553901).Google Scholar
  65. Whitaker, D. J., Ryan, K. A., Wild, R. C., Self-Brown, S., Lutzker, J. R., Shanley, J. R., et al. (2012). Initial implementation indicators from a statewide rollout of SafeCare within a child welfare system. Child Maltreatment, 17, 96–101.  https://doi.org/10.1177/1077559511430722.CrossRefGoogle Scholar
  66. Zazzali, J. L., Sherbourne, C., Hoagwood, K. E., Greene, D., Bigley, M. F., & Sexton, T. L. (2008). The adoption and implementation of an evidence based practice in child and family mental health services organizations: A pilot study of functional family therapy in New York state. Administration and Policy in Mental Health and Mental Health Services Research, 35, 38–49.  https://doi.org/10.1007/s10488-007-0145-8.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019
corrected publication 2019

Authors and Affiliations

  • Iris Sijercic
    • 1
  • Jeanine E. M. Lane
    • 1
  • Cassidy A. Gutner
    • 2
  • Candice M. Monson
    • 1
  • Shannon Wiltsey Stirman
    • 3
    Email author
  1. 1.Ryerson UniversityTorontoCanada
  2. 2.Boston University School of MedicineBostonUSA
  3. 3.National Center for PTSDVA Palo Alto Healthcare System & Stanford UniversityMenlo ParkUSA

Personalised recommendations