Predicting Youth Improvement in Community-Based Residential Settings with Practices Derived from the Evidence-Base
- 33 Downloads
The current investigation conducted descriptive analyses on key variables in community-based residential (CBR) settings and investigated the extent to which disruptive youth between the ages of 13 and 17 years improved based on therapists’ reported alignment with using practices derived from the evidence-base (PDEBs). Results from both the descriptive analyses and multilevel modeling suggested that therapists are using practices that both do and do not align with the evidence-base for disruptive youth. In addition, both PDEBs and practices with minimal evidence-support predicted or marginally predicted final average progress rating for these youth. Findings are discussed as they relate to the importance of continued exploration of treatment outcomes for CBR youth.
KeywordsEvidence-based practices Practice elements Community-based residential Youth improvement
This study did not receive any funding.
Compliance with Ethical Standards
Conflict of interest
Dr. Izmirian and Dr. Chang declare that they have no conflict of interests. Dr. Nakamura has received funding from the State of Hawaii Child and Adolescent Mental Health Division, and does a small amount of consulting for PracticeWise, LLC.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants included in the study.
Research Involved in Human and Animal Rights
This article does not contain any studies with animals performed by any of the authors.
- Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Related Services, 38, 4–23. https://doi.org/10.1007/s10488-010-0327-7.CrossRefGoogle Scholar
- Baumann, B. L., Kolko, D. J., Collins, K., & Herschell, A. D. (2006). Understanding practitioners’ characteristics and perspectives prior to the dissemination of an evidence-based intervention. Child Abuse & Neglect, 30(7), 771–787. https://doi.org/10.1016/j.chiabu.2006.01.002.CrossRefGoogle Scholar
- Borntrager, C. F., Chorpita, B. F., Orimoto, T., Love, A., & Mueller, C. W. (2013). Validity of clinician’s self-reported practice elements on the monthly treatment and progress summary. Journal of Behavioral Health Services and Research, 42(3), 367–382. https://doi.org/10.1007/s11414-013-9363-x.CrossRefGoogle Scholar
- Brookman-Frazee, L., Haine, R. A., Baker-Ericzén, M., Zoffness, R., & Garland, A. F. (2010). Factors associated with use of evidence-based practice strategies in usual care youth psychotherapy. Administration and Policy in Mental Health and Mental Health Services Research, 37(3), 254–269. https://doi.org/10.1007/s10488-009-0244-9.CrossRefGoogle Scholar
- Child and Adolescent Mental Health Division. (2005). Service provider monthly treatment and progress summary. Honolulu: Hawaii Department of Health, Child and Adolescent Mental Health Division.Google Scholar
- Child and Adolescent Mental Health Division, Hawaii Department of Health Child and Adolescent Mental Health Division. (2012). Child and Adolescent Mental Health Performance Standards Interagency Performance Standards and Practice. Retrieved from http://health.hawaii.gov/camhd/.
- Chorpita, B. F., & Daleiden, E. (2009). Evidence-based services committee—Biennial report—Effective psychological interventions for youth with behavioral and emotional needs. Honolulu: Hawaii Department of Health Child & Adolescent Mental Health Division.Google Scholar
- Daleiden, E. L., Lee, J., & Tolman, R. (2004). Annual report. Honolulu, HI: Hawaii Department of Health, Child and Adolescent Mental Health Division.Google Scholar
- Denenny, D., & Mueller, C. (2012). Do empirically supported packages or their practices predict superior therapy outcomes for youth with conduct disorders? Paper presented at the forty-sixth annual convention of the association of behavioral and cognitive therapies, National Harbor, MD.Google Scholar
- Garland, A. F., Brookman-Frazee, L., Hurlburt, M. S., Accurso, E. C., Zoffness, R. J., Haine-Schlagel, R., & Ganger, W. (2010). Mental health care for children with disruptive behavior problems: A view inside therapists’ offices. Psychiatric Services, 61(8), 788–795. https://doi.org/10.1176/appi.ps.61.8.788.CrossRefGoogle Scholar
- Garland, A. F., Hawley, K. M., Brookman-Frazee, L., & Hurlburt, M. S. (2008). Identifying common elements of evidence-based psychosocial treatments for children’s disruptive behavior problems. Journal of the American Academy of Child and Adolescent Psychiatry, 47(5), 505–514. https://doi.org/10.1097/CHI.0b013e31816765c2.CrossRefGoogle Scholar
- Higa-McMillan, C., Powell, C. K. K., Daleiden, E. L., & Mueller, C. W. (2011). Pursuing an evidence -based culture through contextualized feedback: Aligning youth outcomes and practices. Professional Psychology: Research & Practice, 42(2), 137–144. https://doi.org/10.1037/a0022139.CrossRefGoogle Scholar
- Higa-McMillan, C. K., Nakamura, B. J., Morris, A., Jackson, D. S., & Slavin, L. (2014). Predictors of use of evidence-based practices for children and adolescents in usual care. Administration and Policy in Mental Health and Mental Health Services Research, 42(4), 373–383. https://doi.org/10.1007/s10488-014-0578-9.CrossRefGoogle Scholar
- Hoagwood, K., & Kolko, D. J. (2009). Introduction to the special section on practice contexts: A glimpse into the nether world of public mental health services for children and families. Administration and Policy in Mental Health and Mental Health Services, 36(1), 35–36. https://doi.org/10.1007/s10488-008-0201-z.CrossRefGoogle Scholar
- Hodges, K. (1990, 1994 revision). Child and adolescent functional assessment scale. Ypsilanti: Eastern Michigan University, Department of Psychology.Google Scholar
- Izmirian, S. C., Nakamura, B. J., Hill, K. A., Higa-McMillan, C. K., & Slavin, L. (2016). Therapists’ knowledge of practice elements derived from the evidence-base: Misconceptions, accuracies, and large-scale improvement guidance. Professional Psychology: Research & Practice. https://doi.org/10.1037/pro0000081. Advanced online publication.Google Scholar
- Keir, S. S., Jackson, D. S., Mueller, C. W., & Wilkie, D. (2014). Child and adolescent mental health division: Fiscal year 2013 annual factbook. Retrieved from Hawaii Department of Health Child and Adolescent Mental Health Division website: http://health.hawaii.gov/camhd/resource-library/research-and-evaluation/.
- Love, A., Orimoto, T., Powell, A., & Mueller, C. (2011, November). Examining the relationship between therapist-identified treatment targets and youth diagnoses using exploratory factor analysis. Paper presented at the Forty-Fifth Annual Convention of the Association of Behavioral and Cognitive Therapies, Toronto, Ontario.Google Scholar
- Love, A. R. (2014). A Multilevel longitudinal analysis of the relationship between therapist use of practices derived from the evidence base and outcomes for youth with mood disturbances in community-based mental health (Unpublished doctoral dissertation). University of Hawai‘i at Mānoa, Honolulu, Hawaii.Google Scholar
- Lyons, J. S., & McCulloch, J. R. (2006). Monitoring and managing outcomes in residential treatment: Practice-based evidence in search of evidence-based practice. Journal of the American Academy of Child and Adolescent Psychiatry, 45(2), 247–251. https://doi.org/10.1097/01.chi.0000190468.78200.4e.CrossRefGoogle Scholar
- Mueller, C., Daleiden, E., Chorpita, B., Tolman, R., & Higa-McMillan, C. (2009, August). Evidence-based service practice elements and youth outcomes in a state-wide system. In A. Marder (Chair), A demonstration of mapping and traversing the science-practice gap. Symposium conducted at the American Psychological Association, Toronto, Canada.Google Scholar
- Mueller, C. W., Tolman, R., Higa-McMillan, C. K., & Daleiden, E. L. (2010). Longitudinal predictors of youth functional improvement in a public mental health system. The Journal of Behavioral Health Services & Research, 37(3), 350–362. https://doi.org/10.1007/s11414-009-9172-4.CrossRefGoogle Scholar
- Nakamura, B. J., Mueller, C. W., Higa-McMillan, C., Okamura, K. H., Chang, J. P., Slaving, L., & Shimabukuro, S. (2014). Engineering youth services system infrastructure: Hawaii’s continued efforts at large-scale implementation through knowledge management strategies. Journal of Clinical Child and Adolescent Psychology, 43(2), 179–189. https://doi.org/10.1080/15374416.2013.812039.CrossRefGoogle Scholar
- Orimoto, T. E., Jackson, D., Keir, S., Ku, J., & Mueller, C. W. (2012b). Is less more? Patterns in client change across levels of care in youth public health services. Paper presented at the Association for Behavioral and Cognitive Therapies, National Harbor, MD.Google Scholar
- Orimoto, T. E., Mueller, C. W., Hayashi, K., & Nakamura, B. J. (2014). Community-based treatment for youth with co- and multimorbid disruptive behavior disorders. Administration and Policy in Mental Health and Mental Health Services Research, 41(2), 262–275. https://doi.org/10.1007/s10488-012-0464-2.CrossRefGoogle Scholar
- Orimoto, T. E., Mueller, C. W., & Nakamura, B. J. (2013). Fusing science and practice: Predicting progress ratings for disruptive behavior targets with practices derived from the evidence-based in community treatments. In R. Beidas & B. McLeod (Chair) and M. Southam-Gerow (Discussant), Translating evidence-based assessment and treatments for youth for deployments in community settings. Symposium presented at the Association for Behavioral and Cognitive Therapies, Nashville, TN.Google Scholar
- Pardini, D., & Fite, P. (2010). Symptoms of conduct disorder, oppositional defiant disorder, attention-deficit/hyperactivity disorder, and callous-unemotional traits as unique predictors of psychosocial maladjustment in boys: Advancing an evidence base for DSM-V. Journal of the American Academy of Child & Adolescent Psychiatry, 49, 1134–1144. https://doi.org/10.1016/j.jaac.2010.07.010.Google Scholar
- PracticeWise, L. L. C. (2014). PracticeWise evidence-base services database. Retrieved from https://www.practicewise.com.
- Soni, A. (2009). The five most costly children’s conditions, 2006: Estimates for the U.S. civilian noninstitutionalized children, ages 0–17. Statistical Brief #242. Agency for healthcare research and quality, Rockville, MD, April 2009. http://www.meps.ahrq.gov/mepsweb/data_files/publications/st242/stat242.pdf.
- Southam-Gerow, M. A., Daleiden, E. L., Chorpita, B. F., Bae, C., Mitchell, C., Faye, M., & Alba, M. (2013). MAPping Los Angeles Country: Taking an evidenced-informed model of mental health care to scale. Journal of Clinical Child & Adolescent Psychology, 43(2), 190–200. https://doi.org/10.1080/15374416.2013.833098.CrossRefGoogle Scholar
- Weisz, J. R., Chorpita, B. F., Palinkas, L. A., Schoenwald, S. K., Miranda, J., Bearman, S. K., & … The Research Network on Youth Mental Health (2012). Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth - A randomized effectiveness trial. Archives of General Psychiatry, 69(3), 274–282. https://doi.org/10.1001/archgenpsychiatry.2011.147.CrossRefGoogle Scholar
- Weisz, J. R., & Jensen, A. L. (2001). Child and adolescent psychotherapy in research and practice contexts: Review of the evidence and suggestions for improving the field. European Child and Adolescent Psychiatry, 10(1), 112–118.Google Scholar