Implementing Evidence Based Practices for Children’s Mental Health: A Case Study in Implementing Modular Treatments in Community Mental Health
- 268 Downloads
There is strong enthusiasm for utilizing implementation science in the implementation of evidence-based programs in children’s community mental health, but there remains work to be done to improve the process. Despite the proliferation of implementation frameworks, there is limited literature providing case examples of overcoming implementation barriers. This article examines whether the use of three implementations strategies, a structured training and coaching program, the use of professional development portfolios for coaching, and a progress monitoring data system, help to overcome barriers to implementation by facilitating four implementation drivers at a community mental health agency. Results suggest that implementation is a process of recognizing and adapting to both predictable and unpredictable barriers. Furthermore, the use of these implementation strategies is important in improving implementation outcomes.
KeywordsImplementation Youth mental health Modular treatment
This study was funded by grants from the Peter and Elizabeth C. Tower Foundation, The Blue Cross and Blue Shield of Massachusetts Foundation, and The John D. and Katherine T. MacArthur Foundation.
Compliance with Ethical Standards
Conflict of interest
Drs. Chorpita and Daleiden are partners in PracticeWise, LLC, which publishes the MATCH-ADTC program referred to in this study. Drs. Stanick and Chiu were consultants for PracticeWise, LLC at the time of the study.
All procedures performed in this study were conducted in accordance with the ethical standards of the first author’s institution and with the 1964 Helsinki declaration and its later amendments.
Informed consent was obtained from all individual participants included in the study.
- Achenbach, T., McConaughy, S., Ivanova, M., & Rescorla, L. (2011). Manual for the ASEBA Brief Problem Monitor (BPM). Burlington: ASEBA.Google Scholar
- Barwick, M. A., Boydell, K. M., Stasiulis, E., Ferguson, H. B., Blase, K., & Fixsen, D. (2005). Knowledge transfer and implementation of evidence-based practices in children’s mental health. Ontario: Children’s Mental Health Ontario.Google Scholar
- Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17(1), 1–30.Google Scholar
- Beidas, R. S., Stewart, R. E., Adams, D. R., Fernandez, T., Lustbader, S., Powell, B. J., … Rubin, R. (2016). A multi-level examination of stakeholder perspectives of implementation of evidence-based practices in a large urban publicly-funded mental health system. Administration and Policy in Mental Health and Mental Health Services Research, 43(6), 893–908.CrossRefGoogle Scholar
- Bernstein, A., Chorpita, B. F., Rosenblatt, A., Becker, K. D., Daleiden, E. L., & Ebesutani, C. K. (2015). Fit of evidence-based treatment components to youths served by wraparound process: A relevance mapping analysis. Journal of Clinical Child and Adolescent Psychology, 44(1), 44–57. https://doi.org/10.1080/15374416.2013.828296.CrossRefPubMedGoogle Scholar
- Bickman, L., Breda, C., deAndrade, A. R. V., & Kelley, S. D. (2010). CFIT evaluation Report: The effects of CFIT on clinician behavior and youth mental health outcomes. Nashville: Center for Evaluation and Program Improvement.Google Scholar
- Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on mental health outcomes of youths: Results of a randomized trial. Psychiatric Services, 62(12), 1423–1429. https://doi.org/10.1176/appi.ps.002052011.CrossRefPubMedGoogle Scholar
- Birken, S., Powell, B., Shea, C., Haines, E., Kirk, M. A., Leeman, J., Rohweder, C., Damschroder, L., & Presseau, J. (2017). Criteria for selecting implementation science theories and frameworks: Results from an international survey. Implementation Science, 12, 24. https://doi.org/10.1186/s13012-017-0656-7.CrossRefGoogle Scholar
- Bjork, E. L., & Bjork, R. A. (2011). Making things hard on yourself, but in a good way: Creating desirable difficulties to enhance learning. In M. A. Gernsbacher, R. W. Pew, L. M. Hough & J. R. Pomerantz (Eds.), FABBS foundation, psychology and the real world: Essays illustrating fundamental contributions to society (pp. 56–64). New York: Worth Publishers.Google Scholar
- Bond, G. R., Drake, R. E., McHugo, G. J., Peterson, A. E., Jones, A. M., & Williams, J. (2014). Long-term sustainability of evidence-based practices in community mental health agencies. Administration and Policy in Mental Health and Mental Health Services Research, 41(2), 228–236.CrossRefGoogle Scholar
- Chorpita, B. F., Daleiden, E. L., Park, A. L., Ward, A. M., Levy, M. C., Cromley, T.,.. . Krull, J. L. (2017). Child STEPs in California: A cluster randomized effectiveness trial comparing modular treatment with community implemented treatment for youth with anxiety, depression, conduct problems, or traumatic stress. Journal of Consulting Clinical Psychology, 85(1), 13–25. https://doi.org/10.1037/ccp0000133.CrossRefPubMedGoogle Scholar
- Chorpita, B. F., & Weisz, J. R. (2009). Modular approach to therapy for children with anxiety, depression, trauma, and conduct problems (MATCH-ADTC). Satellite Beach: PracticeWise.Google Scholar
- Delgadillo, J., de Jong, K., Lucock, M., Lutz, W., Rubel, J., Gilbody, S.,.. . McMillan, D. (2018). Feedback-informed treatment versus usual psychological treatment for depression and anxiety: A multisite, open-label, cluster randomised controlled trial. The Lancet Psychiatry, 5(7), 564–572.CrossRefGoogle Scholar
- Edmunds, J. M., Beidas, R. S., & Kendall, P. C. (2013). Dissemination and implementation of evidence-based practices: Training and consultation as implementation strategies. Clinical Psychology: Science and Practice, 20(2), 152–165.Google Scholar
- Fixsen, D. L., & Blase, K. A. (2008). Establishing an infrastructure for implementing substance abuse programs. Albany, NY: Invited presentations and workshop, Office of Alcohol and Substance Abuse Services (OASAS).Google Scholar
- Fixsen, D. L., Naoom, S. F., Blase, K. A., & Friedman, R. M. (2005). Implementation research: A synthesis of the literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, National Implementation Research Network.Google Scholar
- Franks, R. P., & Bory, C. T. (2015). Who supports the successful implementation and sustainability of evidence-based practices? Defining and understanding the roles of intermediary and purveyor organizations. New Directions for Child and Adolescent Development, 2015(149), 41–56.CrossRefGoogle Scholar
- Glisson, C., Schoenwald, S. K., Kelleher, K., Landsverk, J., Hoagwood, K. E., & Mayberg, S. … Research Network on Youth Mental Health. (2008). Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure. Administration and Policy in Mental Health and Mental Health Services Research, 35(1–2), 124–133.CrossRefGoogle Scholar
- Institute of Medicine. (2001). Crossing the quality chasm: a new health system for the 21st century. Washington: National Academy Press.Google Scholar
- Kataoka, S. H., Podell, J. L., Zima, B. T., Best, K., Sidhu, S., & Jura, M. B. (2014). MAP as a Model for Practice-Based Learning and Improvement in Child Psychiatry Training. Journal of Clinical Child and Adolescent Psychology, 43(2), 312–322. https://doi.org/10.1080/15374416.2013.848773.CrossRefPubMedGoogle Scholar
- Lyon, A. R., & Lewis, C. C. (2016). Designing health information technologies for uptake: Development and implementation of measurement feedback systems in mental health service delivery. Administration and Policy in Mental Health and Mental Health Services Research, 43(3), 344–349. https://doi.org/10.1007/s10488-015-0704-3.CrossRefPubMedGoogle Scholar
- Mcgovern, M., McHugo, G. J., Drake, R. E., Bond, G. R., & Merrens, M. R. (2013). Implementing evidence-based practices in behavioral health. Center City: Hazelden.Google Scholar
- McMillen, J. C., & Adams, D. R. (2012). Dissemination and implementation in social service settings. Dissemination and implementation research in health: Translating science to practice. 384–399.Google Scholar
- Moullin, J. C., Sabater-Hernández, D., Fernandez-Llimos, F., & Benrimoj, S. I. (2015). A systematic review of implementation frameworks of innovations in healthcare and resulting generic implementation framework. Health Research Policy and Systems, 13(1), 16. https://doi.org/10.1186/s12961-015-0005-z.CrossRefPubMedPubMedCentralGoogle Scholar
- National Implementation Research Network. (2017). Module 1: An overview of active implementation frameworks. Retrieved from http://implementation.fpg.unc.edu/module-1.
- Ng, M., Fleming, T., Robinson, M., Thomson, B., Graetz, N., Margono, C., … Abraham, J. P. (2014). Global, regional, and national prevalence of overweight and obesity in children and adults during 1980–2013: A systematic analysis for the Global Burden of Disease Study 2013. The Lancet, 384(9945), 766–781.CrossRefGoogle Scholar
- Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M.,.. . Kirchner, J. E. (2015). A refined compilation of implementation strategies: Results from the expert recommendations for implementing change (ERIC) project. Implementation Science, 10(1), 21. https://doi.org/10.1186/s13012-015-0209-1.CrossRefPubMedGoogle Scholar
- PracticeWise, L. L. C. (2013). Therapist Portfolio: Promotion review for the modular approach to therapy for children (MATCH). Satellite Beach: PracticeWise.Google Scholar
- Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., … Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76.CrossRefGoogle Scholar
- Rogers, E. M. (2010). Diffusion of innovations (4th edn.). New York: Simon and Schuster.Google Scholar
- Stetler, C. B., Legro, M. W., Rycroft-Malone, J., Bowman, C., Curran, G., Guihan, M., … Wallace, C. M. (2006). Role of” external facilitation” in implementation of research findings: A qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implementation Science, 1(1), 23.CrossRefGoogle Scholar
- Stewart, R. E., Adams, D. R., Mandell, D. S., Hadley, T. R., Evans, A. C., Rubin, R.,.. . Beidas, R. S. (2016). The perfect storm: Collision of the business of mental health and the implementation of evidence-based practices. Psychiatric Services, 67(2), 159–161. https://doi.org/10.1176/appi.ps.201500392.CrossRefPubMedGoogle Scholar
- Tweed, J. L., Cheron, D. M., Herren, J. A., Marriner, V. S. & Weisz, J. R. (2012). Mental health problems and treatment needs of child welfare involved youth in a randomized effectiveness trial of modular EBP. Poster presentation at the 59th Annual Convention of the American Academy of Child and Adolescent Psychiatry, San Francisco.Google Scholar
- Weisz, J. R., Chorpita, B. F., Frye, A., Ng, M. Y., Lau, N., Bearman, S. K.,.. . Hoagwood, K. E. (2011). Youth top problems: Using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy. Journal of Consulting and Clinical Psychology, 79(3), 369–380. https://doi.org/10.1037/a0023307.CrossRefPubMedGoogle Scholar
- Weisz, J. R., Chorpita, B. F., Palinkas, L. A., Schoenwald, S. K., Miranda, J., & Bearman, S. K. (2012). Research Network on Youth Mental. Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: A randomized effectiveness trial. Archives of General Psychiatry, 69(3), 274–282. https://doi.org/10.1001/archgenpsychiatry.2011.147.CrossRefPubMedGoogle Scholar