Advertisement

Evidence-Based Treatment Strategies in Youth Mental Health Services: Results from a National Survey of Providers

  • Evelyn ChoEmail author
  • Phillip K. Wood
  • Erin K. Taylor
  • Estee M. Hausman
  • Jack H. Andrews
  • Kristin M. HawleyEmail author
Original Article
  • 163 Downloads

Abstract

Previous surveys indicate infrequent use of evidence-based treatment (EBT) manuals in usual care youth mental health, but the extent to which providers use core and common EBT strategies and what contextual factors impact EBT strategy implementation need further study. In a national, multidisciplinary survey of 1092 youth-serving providers, providers reported regular use of many EBT strategies. Provider learning theory orientation, more recent degree, more standardized and ongoing assessment use, more positive attitudes toward innovation and evidence, fewer low-income clients, and perceptions that their agency valued quality care and provided fewer training resources predicted more frequent EBT strategy use.

Keywords

Usual care Evidence-based treatment Youth mental health Dissemination Implementation 

Notes

Acknowledgements

The authors would like to thank Jonathon Cook, Amanda Jensen-Doss, Marcia Kearns for their assistance with survey development and administration.

Funding

This research was supported in part by R03 MH077752 from the National Institute of Mental Health to Kristin M. Hawley.

Compliance with Ethical Standards

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the University of Missouri Institutional Review Board and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

This study was approved for a waiver of signed consent. All participants were provided with a consent statement.

References

  1. Aarons, G. A. (2004). Mental health provider attitudes toward adoption of evidence-based practise: The evidence-based practise attitude scale (EBPAS). Mental Health Services Research, 6(2), 61–74.  https://doi.org/10.1023/b:mhsr.0000024351.12294.65.Google Scholar
  2. Addis, M. E., & Krasnow, A. D. (2000). A national survey of practicing psychologists’ attitudes toward psychotherapy treatment manuals. Journal of Consulting and Clinical Psychology, 68(2), 331–339.  https://doi.org/10.1037/0022-006X.68.2.331.Google Scholar
  3. APA Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. The American Psychologist, 61(4), 271.  https://doi.org/10.1037/0003-066x.61.4.271.Google Scholar
  4. Becker, E. M., Smith, A. M., & Jensen-Doss, A. (2013). Who’s using treatment manuals? A national survey of practicing therapists. Behaviour Research and Therapy, 51(10), 706–710.  https://doi.org/10.1016/j.brat.2013.07.008.Google Scholar
  5. Beidas, R. S., Marcus, S., Aarons, G. A., Hoagwood, K. E., Schoenwald, S., Evans, A. C., … Mandell, D. S. (2015). Predictors of community therapists’ use of therapy techniques in a large public mental health system. JAMA Pediatrics, 169(4), 374–382.  https://doi.org/10.1001/jamapediatrics.2014.3736.Google Scholar
  6. Borntrager, C. F., Chorpita, B. F., Orimoto, T., Love, A., & Mueller, C. W. (2015). Validity of clinician’s self-reported practice elements on the monthly treatment and progress summary. Journal of Behavioral Health Services and Research, 42(3), 367–382.  https://doi.org/10.1007/s11414-013-9363-x.Google Scholar
  7. Brookman-Frazee, L., Haine, R. a., Baker-Ericzén, M., Zoffness, R., & Garland, A. F. (2010). Factors associated with use of evidence-based practice strategies in usual care youth psychotherapy. Administration and Policy in Mental Health and Mental Health Services Research, 37(3), 254–269.  https://doi.org/10.1007/s10488-009-0244-9.Google Scholar
  8. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Thousand Oaks: Sage.Google Scholar
  9. Burns, B. J., Hoagwood, K., & Mrazek, P. J. (1999). Effective treatment for mental disorders in children and adolescents. Clinical Child and Family Psychology Review, 2(4), 199–254.  https://doi.org/10.1023/A:1021826216025.Google Scholar
  10. Byrne, B. M. (2012). Structural equation modeling with Mplus: Basic concepts, applications, and programming. New York: Routledge Academic.Google Scholar
  11. Carr, A. (Ed.). (2006). Prevention: What works with children and adolescents. New York: Routledge.Google Scholar
  12. Chambless, D. L., & Hollon, S. D. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66(1), 7–18.Google Scholar
  13. Chambless, D. L., & Ollendick, T. H. (2001). Empirically supported psychological interventions: Controversies and evidence. Annual Review of Psychology, 52, 685–716.  https://doi.org/10.1146/annurev.psych.52.1.685.Google Scholar
  14. Chambless, D. L., Sanderson, W. C., Shoham, V., Bennett Johnson, S., Pope, K. S., & Crits-Christoph, P. (1996). An update on empirically validated therapies. The Clinical Psychologist, 49, 5–18.Google Scholar
  15. Chapman, J. E., McCart, M. R., Letourneau, E. J., & Sheidow, A. J. (2013). Comparison of youth, caregiver, therapist, trained, and treatment expert raters of therapist adherence to a substance abuse treatment protocol. Journal of consulting and clinical psychology, 81(4), 674–680.  https://doi.org/10.1037/a0033021.Google Scholar
  16. Chaudoir, S. R., Dugan, A. G., & Barr, C. H. I. (2013). Measuring factors affecting implementation of health innovations: A systematic review of structural, organizational, provider, patient, and innovation level measures. Implementation Science, 8, 22.  https://doi.org/10.1186/1748-5908-8-22.Google Scholar
  17. Chorpita, B. F., Daleiden, E. L., & Weisz, J. R. (2005). Identifying and selecting the common elements of evidence based interventions: A distillation and matching model. Mental Health Services Research, 7(1), 5–20.  https://doi.org/10.1007/s11020-005-1962-6.Google Scholar
  18. Chorpita, B. F., Korathu-Larson, P., Knowles, L. M., & Guan, K. (2014). Emergent life events and their impact on service delivery: Should we expect the unexpected? Professional Psychology: Research and Practice, 45(5), 387–393.  https://doi.org/10.1037/a0037746.Google Scholar
  19. Cook, J. R., Hausman, E. M., Jensen-Doss, A., & Hawley, K. M. (2017). Assessment practices of child clinicians. Assessment, 24(2), 210–221.Google Scholar
  20. Cooper, J. L., & Aratani, Y. (2009). The status of states’ policies to support evidence-based practices in children’s mental health. Psychiatric Services, 60(12), 1672–1675.  https://doi.org/10.1176/appi.ps.60.12.1672.Google Scholar
  21. Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(1), 50.  https://doi.org/10.1186/1748-5908-4-50.Google Scholar
  22. Dillman, D. A. (2000). Mail and internet surveys: The tailored design method. New York: Wiley.Google Scholar
  23. Ehrenreich, J. T., Goldstein, C. M., Wright, L. R., & Barlow, D. H. (2009). Development of a unified protocol for the treatment of emotional disorders in youth. Child & Family Behavior Therapy, 31(1), 20–37.  https://doi.org/10.1080/07317100802701228.Google Scholar
  24. Franklin, M. E., Foa, E. B., Nathan, P. E., & Gorman, J. M. (Eds.). (1998). A guide to treatments that work. New York: Oxford.Google Scholar
  25. Garland, A. F., Hawley, K. M., Brookman-Frazee, L., & Hurlburt, M. S. (2008). Identifying common elements of evidence-based psychosocial treatments for children’s disruptive behavior problems. Journal of the American Academy of Child and Adolescent Psychiatry, 47(5), 505–514.  https://doi.org/10.1097/CHI.0b013e31816765c2.Google Scholar
  26. Garland, A. F., Kruse, M., & Aarons, G. A. (2003). Clinicians and outcome measurement: What’s the use? Journal of Behavioral Health Services & Research, 30(4), 393–405.  https://doi.org/10.1007/bf02287427.Google Scholar
  27. Garland, A. F., Ph, D., Brookman-frazee, L., Hurlburt, M., Accurso, E. C., Zoffness, R., … Ganger, W. (2010). Mental health care for children with disruptive behavior problems: A view inside therapists’ offices. Psychiatric Services, 61(8), 788–795.  https://doi.org/10.1176/appi.ps.61.8.788.Google Scholar
  28. Gilbody, S. M., House, A. O., & Sheldon, T. A. (2002). Psychiatrists in the UK do not use outcomes measures. British Journal of Psychiatry, 180(2), 101–103.  https://doi.org/10.1192/bjp.180.2.101.Google Scholar
  29. Glisson, C. (2002). The organizational context of children’s mental health services. Clinical Child and Family Psychology Review, 5(4), 233–253.  https://doi.org/10.1023/A:1020972906177.Google Scholar
  30. Glisson, C., Hemmelgarn, A., Green, P., Dukes, D., Atkinson, S., & Williams, N. J. (2012). Randomized trial of the availability, responsiveness, and continuity (arc) organizational intervention with community-based mental health programs and clinicians serving youth. Journal of the American Academy of Child and Adolescent Psychiatry, 51(8), 780–787.  https://doi.org/10.1016/j.jaac.2012.05.010.Google Scholar
  31. Glisson, C., & James, L. R. (2002). The cross-level effects of culture and climate in human service teams. Journal of Organizational Behavior, 23(6), 767–794.  https://doi.org/10.1002/job.162.Google Scholar
  32. Glisson, C., Schoenwald, S. K., Kelleher, K., Landsverk, J., Hoagwood, K. E., Mayberg, S., … Health, T. R. N. on Y. M (2008). Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure. Administration and Policy in Mental Health and Mental Health Services Research, 35(1–2), 124–133.  https://doi.org/10.1007/s10488-007-0152-9.Google Scholar
  33. Graham, J. W., Taylor, B. J., Olchowski, A. E., & Cumsille, P. E. (2006). Planned missing data designes in psychological research. Psychological Methods, 11(4), 323–343.  https://doi.org/10.1037/1082-989X.11.4.323.Google Scholar
  34. Greenhalgh, T., Bate, P., Kyriakidou, O., Macfarlane, F., & Robert, G. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. The Milbank Quarterly, 82(4), 607–610.  https://doi.org/10.1111/j.0887-378x.2004.00325.x.Google Scholar
  35. Hawley, K. M., Cook, J. R., & Jensen-Doss, A. (2009). Do noncontingent incentives increase survey response rates among mental health providers? A randomized trial comparison. Administration and Policy in Mental Health and Mental Health Services Research, 36(5), 343–348.Google Scholar
  36. Hawley, K. M., & Weisz, J. R. (2003). Child, parent, and therapist (dis)agreement on target problems in outpatient therapy: The therapist’s dilemma and its implications. Journal of Consulting and Clinical Psychology, 71(1), 62–70.  https://doi.org/10.1037//0022-006X.71.1.62.Google Scholar
  37. Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clinical Psychology Review, 30(4), 448–466.  https://doi.org/10.1016/j.cpr.2010.02.005.Google Scholar
  38. Higa-McMillan, C., Kotte, A., Jackson, D., & Daleiden, E. L. (2017). Overlapping and non-overlapping practices in usual and evidence-based care for youth anxiety. Journal of Behavioral Health Services and Research, 44(4), 684–694.  https://doi.org/10.1007/s11414-016-9502-2.Google Scholar
  39. Higa-McMillan, C. K., Nakamura, B. J., Morris, A., Jackson, D. S., & Slavin, L. (2015). Predictors of use of evidence-based practices for children and adolescents in usual care. Administration and Policy in Mental Health and Mental Health Services Research, 42(4), 373–383.  https://doi.org/10.1007/s10488-014-0578-9.Google Scholar
  40. Hogue, A., Dauber, S., Lichvar, E., Bobek, M., & Henderson, C. E. (2015). Validity of therapist self-report ratings of fidelity to evidence-based practices for adolescent behavior problems: Correspondence between therapists and observers. Administration and Policy in Mental Health, 42(2), 229–243.  https://doi.org/10.1007/s10488-014-0548-2.Google Scholar
  41. Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424–453.  https://doi.org/10.1037/1082-989X.3.4.424.Google Scholar
  42. Hurlburt, M. S., Garland, A. F., Nguyen, K., & Brookman-Frazee, L. (2010). Child and family therapy process: Concordance of therapist and observational perspectives. Administration and Policy in Mental Health, 37(3), 230–244.  https://doi.org/10.1007/s10488-009-0251-x.Google Scholar
  43. Jensen-Doss, A., Cusack, K. J., & de Arellano, M. A. (2008). Workshop-based training in trauma-focused CBT: An in-depth analysis of impact on provider practices. Community Mental Health Journal, 44(4), 227–244.  https://doi.org/10.1007/s10597-007-9121-8.Google Scholar
  44. Jensen-Doss, A., & Hawley, K. M. (2010). Understanding barriers to evidence-based assessment: Clinician attitudes toward standardized assessment tools. Journal of Clinical Child & Adolescent Psychology, 39(6), 885–896.Google Scholar
  45. Jensen-Doss, A., & Hawley, K. M. (2011). Understanding clinicians’ diagnostic practices: Attitudes toward the utility of diagnosis and standardized diagnostic tools. Administration and Policy in Mental Health and Mental Health Services Research, 38(6), 476–485.Google Scholar
  46. Jensen-Doss, A., Hawley, K. M., Lopez, M., & Osterberg, L. D. (2009). Using evidence-based treatments: The experiences of youth providers working under a mandate. Professional Psychology: Research and Practice, 40(4), 417–424.  https://doi.org/10.1037/a0014690.Google Scholar
  47. Kazdin, A. E., Siegel, T. C., & Bass, D. (1990). Drawing on clinical practice to in form research on child and adolescent psychotherapy: Survey of practitioners. Professional Psychology: Research and Practice, 21(3), 189–198.  https://doi.org/10.1037//0735-7028.21.3.189.Google Scholar
  48. Kearns, M. A., & Hawley, K. M. (2014). Predictors of polypharmacy and off-label prescribing of psychotropic medications: A national survey of child and adolescent psychiatrists. Journal of Psychiatric Practice, 20(6), 438–447.Google Scholar
  49. Kendall, P. C., & Beidas, R. S. (2007). Smoothing the trail for dissemination of evidence-based practices for youth: Flexibility within fidelity. Professional Psychology: Research and Practice, 38(1), 13–20.  https://doi.org/10.1037/0735-7028.38.1.13.Google Scholar
  50. Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10(3), 288–301.  https://doi.org/10.1093/clipsy/bpg025.Google Scholar
  51. Lonigan, C. J., Elbert, J. C., & Johnson, S. B. (1998). Empirically supported psychosocial interventions for children: An overview. Journal of Clinical Child Psychology, 27(2), 138–145.  https://doi.org/10.1207/s15374424jccp2702.Google Scholar
  52. Lumley, T. (2004). Analysis of complex survey samples. Journal of Statistical Software, 9(1), 1–19.  https://doi.org/10.18637/jss.v009.i08.Google Scholar
  53. Mash, E. J., & Hunsley, J. (2005). Evidence-based assessment of child and adolescent disorders: Issues and challenges. Journal of Clinical Child & Adolescent Psychology, 34(3), 362–379.  https://doi.org/10.1207/s15374424jccp3403_1.Google Scholar
  54. Muthén, L. K., & Muthén, B. O. (2012). Mplus User’s Guide (7th ed.). Muthén & Muthén. Retrieved from https://www.statmodel.com/download/usersguide/Mplususer guide Ver_7_r3_web.pdf.
  55. Nelson, T. D., & Steele, R. G. (2007). Predictors of practitioner self-reported use of evidence-based practices: Practitioner training, clinical setting, and attitudes toward research. Administration and Policy in Mental Health and Mental Health Services Research, 34(4), 319–330.  https://doi.org/10.1007/s10488-006-0111-x.Google Scholar
  56. Nelson, T. D., Steele, R. G., & Mize, J. A. (2006). Practitioner attitudes toward evidence-based practice: Themes and challenges. Administration and Policy in Mental Health and Mental Health Services Research, 33(3), 398–409.  https://doi.org/10.1007/s10488-006-0044-4.Google Scholar
  57. Rogers, E. M. (2010). Diffusion of innovations. New York: Routledge.Google Scholar
  58. Roth, A., & Fonagy, P. (2005). What works for whom: A critical review of psychotherapy research (2nd edn.). New York: Guildford Publications.Google Scholar
  59. Schoenwald, S. K., & Hoagwood, K. (2001). Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services, 52(9), 1190–1197.  https://doi.org/10.1176/appi.ps.52.9.1190.Google Scholar
  60. Sheehan, A. K., Walrath, C. M., & Holden, E. W. (2006). Evidence-based practice use, training and implementation in the community-based service setting: A survey of children’s mental health service providers. Journal of Child and Family Studies, 16(2), 169–182.  https://doi.org/10.1007/s10826-006-9076-3.Google Scholar
  61. Silverman, W. K., & Hinshaw, S. P. (2008). The second special issue on evidence-based psychosocial treatments for children and adolescents: A 10-year update. Journal of Clinical Child & Adolescent Psychology, 37(1), 1–7.  https://doi.org/10.1080/15374410701817725.Google Scholar
  62. Task Force on Promotion and Dissemination of Psychological Procedures. (1995). Training in and dissemination of empirically-validated psychological treatment: Report and recommendations. The Clinical Psychologist, 48(1), 2–23.  https://doi.org/10.1037/e554972011-003.Google Scholar
  63. The National Advisory Mental Health Council Workgroup on Child and Adolescent Mental Health Intervention Development and Deployment. (2001). Blueprint for change: Research on child and adolescent mental health. Washington, D. C. Retrieved from https://www.nimh.nih.gov/about/advisory-boards-and-groups/namhc/reports/blueprint-for-change-research-on-child-and-adolescent-mental-health.shtml.
  64. Walrath, C. M., Sheehan, A. K., Holden, E. W., Hernandez, M., & Blau, G. (2006). Evidence-based treatments in the field: A brief report on provider knowledge, implementation, and practice. The Journal of Behavioral Health Services & Research, 33(2), 244–253.  https://doi.org/10.1007/s11414-005-9008-9.Google Scholar
  65. Weersing, V. R., Weisz, J. R., & Donenberg, G. R. (2002). Development of the therapy procedures checklist: A therapist-report measure of technique use in child and adolescent treatment. Journal of Clinical Child and Adolescent Asychology, 31(2), 168–180.  https://doi.org/10.1207/S15374424JCCP3102.Google Scholar
  66. Weisz, J., Bearman, S. K., Santucci, L. C., & Jensen-Doss, A. (2017). Initial test of a principle-guided approach to transdiagnostic psychotherapy with children and adolescents. Journal of Clinical Child & Adolescent Psychology, 46(1), 44–58.  https://doi.org/10.1080/15374416.2016.1163708.Google Scholar
  67. Weisz, J. R., Chorpita, B. F., Palinkas, L. A., Schoenwald, S. K., Miranda, J., & Bearman, S. K. … The Research Network on Youth Mental Health. (2012). Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: A randomized effectiveness trial. Archives of General Psychiatry, 69(3), 274–282.  https://doi.org/10.1001/archgenpsychiatry.2011.147.Google Scholar
  68. Weisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2006). Evidence-based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. The American Psychologist, 61(7), 671–689.  https://doi.org/10.1037/0003-066X.61.7.671.Google Scholar
  69. Weisz, J. R., Kuppens, S., Eckshtain, D., Ugueto, A. M., Hawley, K. M., & Jensen-Doss, A. (2013). Performance of evidence-based youth psychotherapies compared with usual clinical care. JAMA Psychiatry, 70(7), 750.  https://doi.org/10.1001/jamapsychiatry.2013.1176.Google Scholar
  70. Wolk, C. B., Marcus, S. C., Weersing, V. R., Hawley, K. M., Evans, A. C., Hurford, M. O., & Beidas, R. S. (2016). Therapist- and client-level predictors of use of therapy techniques during implementation in a large public mental health system. Psychiatric Services, 67(5), 551–557.  https://doi.org/10.1176/appi.ps.201500022.Google Scholar
  71. Youngstrom, E. A., Choukas-Bradley, S., Calhoun, C. D., & Jensen-Doss, A. (2015). Clinical guide to the evidence-based assessment approach to diagnosis and treatment. Cognitive and Behavioral Practice.  https://doi.org/10.1016/j.cbpra.2013.12.005.Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Evelyn Cho
    • 1
    Email author
  • Phillip K. Wood
    • 1
  • Erin K. Taylor
    • 1
    • 2
  • Estee M. Hausman
    • 1
    • 3
  • Jack H. Andrews
    • 1
  • Kristin M. Hawley
    • 1
    Email author
  1. 1.University of MissouriColumbiaUSA
  2. 2.University of Oklahoma Health Sciences CenterOklahoma CityUSA
  3. 3.Stony Brook UniversityStony BrookUSA

Personalised recommendations