Journal of Child and Family Studies

, Volume 22, Issue 3, pp 311–321 | Cite as

The Impact of Evidence-Based Practices on Requests for Out-of-Home Placements in the Context of System Reform

  • Bruce D. Stout
  • David Holleran
Original Paper


Beginning in January 2001 and continuing through April 2008 New Jersey completed statewide implementation of the basic infrastructure of a system of care (SOC) for child and adolescent behavioral health services. In 2008, the state began to enhance its service infrastructure through a large scale implementation of two community-based treatment programs that have been recognized as evidence-based: multisystemic therapy (MST) and functional family therapy (FFT). Multiple evaluations for both therapies have assessed the efficacy of the interventions at the client level. Using interrupted time series analysis, we evaluated the impact of the addition of these new treatment options to New Jersey’s SOC on a system level outcome: statewide requests for out-of-home placements. Results indicate a significant reduction in requests for out-of-home placements associated with the implementation of MST and FFT and a net overall savings to the state.


Out-of-home placement Systems of care Community-based Multisystemic therapy Functional family therapy 


  1. Alexander, J. F., & Barton, C. (1976). Behavioral systems therapy for families. In D. H. Olson (Ed.), Treating relationships (pp. 167–188). Lake Mills, IA: Graphic Publishing Co.Google Scholar
  2. Asarnow, J. R., Aoki, W., & Elson, S. (1996). Children in residential treatment: A follow-up study. Journal of Clinical Child Psychology, 25(2), 209–214.CrossRefGoogle Scholar
  3. Barth, R. P., Greeson, J. K. P., Guo, S., Green, R. L., Hurley, S., & Sisson, J. (2007). Outcomes for youth receiving intensive in-home therapy or residential care: A comparison using propensity scores. American Journal of Orthopsychiatry, 77(4), 497–505.PubMedCrossRefGoogle Scholar
  4. Barton, C., Alexander, J. F., Waldron, H., Turner, C. W., & Warburton, J. (1985). Generalizing treatment effects of functional family therapy: Three replications. The American Journal of Family Therapy, 13(3), 16–26.CrossRefGoogle Scholar
  5. Bickman, L., Foster, E. M., & Lambert, E. W. (1996). Who gets hospitalized in a continuum of care? Journal of the American Academy of Child and Adolescent Psychiatry, 35(1), 74–80.PubMedCrossRefGoogle Scholar
  6. Biglan, A., Ary, D., & Wagenaar, A. C. (2000). The value of interrupted time-series experiments for community intervention research. Prevention Science, 1(1), 31–49.PubMedCrossRefGoogle Scholar
  7. Borduin, C. M., Mann, B. J., Cone, L. T., Henggeler, S. W., Fucci, B. R., Blaske, D. M., et al. (1995). Multisystemic treatment of serious juvenile offenders: Long-term prevention of criminality and violence. Journal of Consulting and Clinical Psychology, 63(4), 569–578.PubMedCrossRefGoogle Scholar
  8. Brown, T. L., Henggeler, S. W., Schoenwald, S. K., Brondino, M. J., & Pickrel, S. G. (1999). Multisystemic treatment of substance abusing and dependent delinquents: Effects on school attendance at posttreatment and 6-month followup. Children’s Services: Social Policy, Research and Practice, 2, 81–93.Google Scholar
  9. Burns, B. J., & Hoagwood, K. (2002). Community treatment for youth: Evidence-based interventions for severe emotional and behavioral disorders. New York: Oxford University Press.Google Scholar
  10. Burns, B. J., Hoagwood, K., & Mrazek, P. (1999). Effective treatment for mental disorders for children and adolescents. Clinical Child and Family Psychology Review, 2, 199–254.PubMedCrossRefGoogle Scholar
  11. Cook, J. A., Heflinger, C. A., Hoven, C. W., Kelleher, K. J., Mulkern, V., Paulson, R. I., et al. (2004). A multi-site study of medicaid-funded managed care versus fee-for-service plans’ effects on mental health service utilization of children with severe emotional disturbance. The Journal of Behavioral Health Services & Research, 31(4), 384–402.Google Scholar
  12. Cueller, A. E., Libby, A. M., & Snowden, L. R. (2001). How capitated mental health care affects utilization by youth in the juvenile justice and child welfare systems. Mental Health Services Research, 3(2), 61–72.CrossRefGoogle Scholar
  13. Dickey, D. A., & Fuller, W. A. (1979). Distribution of the estimators for autoregressive time series with a unit root. Journal of the American Statistical Association, 74, 427–431.Google Scholar
  14. Dishion, T. J., McCord, J., & Poulin, F. (1999). When interventions harm: Peer groups and problem behaviors. American Psychologist, 54, 755–764.PubMedCrossRefGoogle Scholar
  15. Farmer, E. M. Z., Mustillo, S., Burns, B. J., & Holden, E. W. (2008). Use and predictors of out-of-home placements within systems of care. Journal of Emotional and Behavioral Disorders, 16(1), 5–14.CrossRefGoogle Scholar
  16. Foster, E. M. (2000). Does the continuum of care reduce inpatient length of stay? Evaluation and Program Planning, 23, 53–65.CrossRefGoogle Scholar
  17. Foster, E. M., & Bickman, L. (2000). Refining the cost analyses of the Fort Bragg evaluation project: The impact of cost offset and cost shifting. Mental Health Services Research, 2, 13–25.PubMedCrossRefGoogle Scholar
  18. Franses, P. H. (1998). Time series models for business and economic forecasting. UK: Cambridge University Press.Google Scholar
  19. Freidman, A. S. (1989). Family therapy vs. parent groups: Effects on adolescent drug abusers. The American Journal of Family Therapy, 17(4), 335–347.CrossRefGoogle Scholar
  20. Gordon, D. A. (1995). Functional family therapy for delinquents. In R. R. Ross, D. H. Antonowicz, & G. K. Dhallwal (Eds.), Going straight: Effective delinquency prevention and offender rehabilitation (pp. 163–178). Ottawa, ON: Air Training & Publications.Google Scholar
  21. Gottman, J. M. (1981). Time series analysis: A comprehensive introduction for social scientists. UK: Cambridge University Press.Google Scholar
  22. Hair, H. J. (2005). Outcomes for children and adolescents after residential treatment: A review of research from 1993 to 2003. Journal of Child and Family Studies, 14(A), 551–575.CrossRefGoogle Scholar
  23. Henggeler, S. W., Melton, G. B., Brondino, M. J., Scherer, D. G., & Hanley, J. H. (1997). Multisystemic therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination. Journal of Consulting and Clinical Psychology, 65(5), 821–833.PubMedCrossRefGoogle Scholar
  24. Henggeler, S. W., Melton, G. B., & Smith, L. A. (1992). Family preservation using multisystemic therapy: An effective alternative to incarcerating serious juvenile offenders. Journal of Consulting and Clinical Psychology, 60(6), 953–961.PubMedCrossRefGoogle Scholar
  25. Henggeler, S. W., Melton, G. B., Smith, L. A., Schoenwald, S. K., & Hanley, J. H. (1993). Family preservation using multisystemic treatment: Long-term follow-up to a clinical trial with serious juvenile offenders. Journal of Child and Family Studies, 2(4), 283–293.CrossRefGoogle Scholar
  26. Henggeler, S. W., Pickrel, S. G., & Brondino, M. J. (1999). Multisystemic treatment of substance-abusing and –dependent delinquents: Outcomes, treatment fidelity, and transportability. Mental Health Services Research, 1(3), 171–184.PubMedCrossRefGoogle Scholar
  27. Henggeler, S. W., Rodick, D., Borduin, C. M., Hanson, C. L., Watson, S. M., & Urey, J. R. (1986). Multisystemic treatment of juvenile offenders: Effects on adolescent behavior and family interaction. Developmental Psychology, 22(1), 132–141.CrossRefGoogle Scholar
  28. Henggeler, S. W., Schoenwald, S. K., & Munger, R. L. (1996). Families and therapists achieve clinical outcomes, systems of care mediate the process. Journal of Child and Family Studies, 5(2), 177–183.CrossRefGoogle Scholar
  29. Henggeler, S. W., Schoenwald, S. K., Pickrel, S. G., Rowland, M. D., & Santos, A. B. (1994). The contribution of treatment outcome research to the reform of children’s mental health services: Multisystemic therapy as an example. The Journal of Mental Health Administration, 21(3), 229–239.CrossRefGoogle Scholar
  30. Henggler, S. W., Schoenwald, S. K., Borduin, C. M., Rowland, M. D., & Cunningham, P. B. (1998). Multisystemic treatment of antisocial behavior in children and adolescents. New York: Guilford Press.Google Scholar
  31. Hinckley, E. C., & Ellis, W. F. (1985). An effective alternative to residential placement: Home-based services. Journal of Clinical Child Psychology, 14(3), 209–213.CrossRefGoogle Scholar
  32. Hoagwood, K., Burns, B., Kiser, L., Ringeisen, H., & Schoenwald, S. K. (2001). Evidence-based practice in child and adolescent mental health services. Psychiatric Services, 52(9), 1179–1189.PubMedCrossRefGoogle Scholar
  33. Hutchinson, A. B., & Foster, E. M. (2003). The effect of Medicaid managed care on mental health care for children: A review of the literature. Mental Health Services Research, 5(1), 39–54.PubMedCrossRefGoogle Scholar
  34. Klein, N. C., Alexander, J. F., & Parsons, B. V. (1977). Impact of family systems intervention on recidivism and sibling delinquency: A model of primary prevention and program evaluation. Journal of Consulting and Clinical Psychology, 45(3), 469–474.PubMedCrossRefGoogle Scholar
  35. Loeber, R., & Farrington, D. R. (Eds.). (1998). Serious and violent juvenile offenders: Risk factors and successful interventions. Thousand Oaks, CA: Sage Publications.Google Scholar
  36. Lyons, J. S., & McCulloch, J. R. (2006). Monitoring and managing outcomes in residential treatment: Practice-based evidence in search of evidence-based practice. Journal of the American Academy of Child and Adolescent Psychiatry, 45(2), 247–251.PubMedCrossRefGoogle Scholar
  37. Lyons, J. S., Terry, P., Martinovich, Z., Peterson, J., & Bouska, B. (2001). Outcome trajectories for adolescents in residential treatment: A statewide evaluation. Journal of Child and Family Studies, 10, 333–345.CrossRefGoogle Scholar
  38. Magellan Health Services Children’s Service Task Force. (2008). Perspectives on residential and community-based treatment for youth and families. Baltimore: Magellan Health Services Children’s Service Task Force.Google Scholar
  39. McCleary, R., Hay, R. A., Meidinger, E. E., & McDowall, D. (1980). Applied time series analysis for the social sciences. Beverly Hills, CA: Sage.Google Scholar
  40. McDowall, D., McCleary, R., Meidinger, M. F., & Hay, R. A, Jr. (1980). Interrupted time series analysis. Beverly Hills, CA: Sage.Google Scholar
  41. Montgomery, D. C., Jennings, C. L., & Kulhaci, M. (2008). Introduction to time series analysis and forecasting. Hoboken, NJ: Wiley Series in Probability and Statistics.Google Scholar
  42. New Jersey Department of Human Services. (2000). The children’s initiative concept paper. Trenton, New Jersey.Google Scholar
  43. New Jersey Division of Child Behavioral Health Services. (2010). New Jersey children’s mental health plan FFY 2010. Trenton, New Jersey.Google Scholar
  44. New Jersey Division of Child Behavioral Health Services. (2011). New Jersey children’s system of care agency summary report. Trenton, New Jersey.Google Scholar
  45. Office of Juvenile Justice and Delinquency Prevention (2004). Blueprints for violence prevention (NCJ 204274). Washington, DC.Google Scholar
  46. Parsons, B. V., & Alexander, J. A. (1973). Short-term family intervention: A therapy outcome study. Journal of Consulting and Clinical Psychology, 41(2), 195–201.PubMedCrossRefGoogle Scholar
  47. Saunders, R. C., & Heflinger, C. A. (2003). Access to and patterns of use of behavioral health services among children and adolescents in TennCare. Psychiatric Services, 54(10), 1364–1371.PubMedCrossRefGoogle Scholar
  48. Schoenwald, S. K., Ward, D. M., Henggeler, S. W., Pickrel, S. G., & Patel, H. (1996). Multisystemic therapy treatment of substance abusing or dependent adolescent offenders: Costs of reducing incarceration, inpatient, and residential placement. Journal of Child and Family Studies, 5(4), 431–444.CrossRefGoogle Scholar
  49. Schoenwald, S. K., Ward, D. M., Henggeler, S. W., & Rowland, M. D. (2000). Multisystemic therapy versus hospitalization for crisis stabilization of youth: Placement outcomes 4 months postreferral. Mental Health Services Research, 2(1), 3–12.PubMedCrossRefGoogle Scholar
  50. Sexton, T. L., & Alexander, J. F. (2002). Functional family therapy for at-risk adolescents and their families. In F. J. Kaslow & T. Patterson (Eds.), Comprehensive handbook of psychotherapy: Cognitive and behavioral approaches (pp. 117–140). Hoboken, NJ: Wiley.Google Scholar
  51. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. New York: Houghton Mifflin Company.Google Scholar
  52. Sheidow, A. J., Henggeler, S. W., & Schoenwald, S. K. (2003). Multisystemic Therapy. In A. L. Sexton, G. R. Weeks, & M. S. Robbins (Eds.), The Science and practice of working with families and couples (pp. 303–322). New York: Brunner-Routledge.Google Scholar
  53. StataCorp. (2005). Stata statistical software: Release 9. College Station, TX: StataCorp LP.Google Scholar
  54. Stroul, B. A., & Friedman, R. M. (1986). A system of care for children and youth with severe emotional disturbances (Revised Edition). Washington, DC: Georgetown University Child Development Center, CASSP Technical Assistance Center.Google Scholar
  55. Woodford, M. S. (1999). Home-based family therapy: Theory and process from “friendly visitors” to multisystemic therapy. The Family Journal: Counseling and Therapy for Couples and Families, 7(3), 265–269.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2012

Authors and Affiliations

  1. 1.Department of CriminologyThe College of New JerseyEwingUSA

Personalised recommendations