Skip to main content
Log in

Identifying Youth Problem Profiles and Predicting Remission Following Mental Health Treatment

  • Original Article
  • Published:
Administration and Policy in Mental Health and Mental Health Services Research Aims and scope Submit manuscript

Abstract

This study utilized latent profile analysis to categorize youth served by a public mental health setting into homogenous classes. Then, associations between class membership and meeting clinical criteria by the latest assessment were examined. Caregiver responses to the Ohio Scales, Short Form, Problem Severity Scale for 1090 youth completed at entry into this public mental health system were subjected to latent profile analysis. This method classifies youth into categories based on mental health problem profiles, in order to determine the degree to which these groupings are related to later mental health outcomes. The classification of youth cases that emerged was then used to predict clinical remission at or nearest end of treatment, including final Ohio Scales Problem Severity scores and a measure of day-to-day functioning, the Child and Adolescent Functional Assessment Scale (CAFAS). A four-class model was identified as best representing the data, reflecting a relatively low-risk class (63.3% of the sample), an internalizing class (23.2%), a delinquency class (8.8%), and a high-risk class (4.7%). Individuals in the internalizing and high-risk classes had lower likelihoods of achieving problem remission than those in the low-risk and delinquency classes at the time of their last completed Ohio Scales. Additionally, youth assigned to the delinquency and high-risk classes had lower likelihoods of reaching functional impairment remission than those in the internalizing and low-risk classes. Youth membership in a class based on initial problem scores can be utilized to predict clinical remission over the course of treatment in public mental health care. Such class-based predictions support other methods of predicting outcomes and can be used by clinicians to develop more informed treatment plans and to adjust treatment based on such classifications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

References

  • Alexander, J. F., Waldron, H. B., Robbins, M. S., & Neeb, A. A. (2013). Functional family therapy for adolescent behavior problems. American Psychological Association. https://doi.org/10.1037/14139-000

    Article  Google Scholar 

  • Asparouhov, T., & Muthén, B. (2014). Auxiliary variables in mixture modeling: Three-step approaches using Mplus. Structural Equation Modeling: A Multidisciplinary Journal, 21(3), 329–341. https://doi.org/10.1080/10705511.2014.915181

    Article  Google Scholar 

  • Barlow, D. H., Farchione, T. J., Bullis, J. R., Gallagher, M. W., Murray-Latin, H., Sauer-Zavala, S., Bentley, K. H., Thompson-Hollands, J., Conklin, L. R., Boswell, J. F., Ametaj, A., Carl, J. R., Boettcher, H. T., & Cassiello-Robbins, C. (2017). The unified protocol for transdiagnostic treatment of emotional disorders compared with diagnosis-specific protocols for anxiety disorders: A randomized clinical trial. JAMA Psychiatry, 74(9), 875–884. https://doi.org/10.1001/jamapsychiatry.2017.2164

    Article  PubMed  PubMed Central  Google Scholar 

  • Bonadio, F. T., Dynes, M., Lackey, J., Tompsett, C., & Amrhein, K. (2016). Grouping youth with similar symptoms: A person-centered approach to transdiagnostic subgroups. Journal of Clinical Psychology, 72(7), 676–688.

    Article  Google Scholar 

  • Bonadio, F. T., Evans, S. C., Cho, G. Y., Callahan, K. P., Chorpita, B. F., & Weisz, J. R. (2021). Whose outcomes come out? Patterns of caregiver- and youth-reported outcomes based on caregiver-youth baseline discrepancies. Journal of Clinical Child & Adolescent Psychology, 23, 1–15.

    Google Scholar 

  • Bonadio, F. T., & Tompsett, C. (2016). The factor structure of the Ohio Scales: A practical measure of psychological symptoms in youth. Journal of Child and Family Studies, 26, 101–117. https://doi.org/10.1007/s10826-016-0544-0

    Article  Google Scholar 

  • Bonadio, F. T., & Tompsett, C. (2018). Who benefits from community mental health care? Using latent profile analysis to identify differential treatment outcomes for youth? Journal of Youth and Adolescence, 47, 2320–2336.

    Article  Google Scholar 

  • Brodbeck, J., Stulz, N., Itten, S., Regli, D., Znoj, H., & Caspar, F. (2014). The structure of psychopathological symptoms and the associations with DSM-diagnoses in treatment seeking individuals. Comprehensive Psychiatry, 55(3), 714–726.

    Article  Google Scholar 

  • Celeux, G., & Soromenho, G. (1996). An entropy criterion for assessing the number of clusters in a mixture model. Journal of Classification, 13, 195–212.

    Article  Google Scholar 

  • Child and Adolescent Mental Health Division (CAMHD), Hawai‘i Department of Health. (2018). Child and Adolescent Mental Health Performance Standards. Retrieved from https://health.hawaii.gov/camhd/files/2018/06/Teal-Book-2018.pdf

  • Dickson, K. S., Stadnick, N. A., Lind, T., & Trask, E. V. (2020). Defining and predicting high cost utilization in children’s outpatient mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 47, 655–664.

    Article  Google Scholar 

  • Dowell, K. A., & Ogles, B. M. (2008). The Ohio Scales Youth form: Expansion and validation of a self-report outcome measure for young children. Journal of Child and Family Studies, 17, 291–305.

    Article  Google Scholar 

  • Farchione, T. J., Fairholme, C. P., Ellard, K. K., Boisseau, C. L., Thompson-Hollands, J., Carl, J. R., Gallagher, M. W., & Barlow, D. H. (2012). Unified protocol for transdiagnostic treatment of emotional disorders: A randomized controlled trial. Behavior Therapy, 43(3), 666–678. https://doi.org/10.1016/j.beth.2012.01.001

    Article  PubMed  PubMed Central  Google Scholar 

  • Garland, A. F., Aarons, G. A., Hawley, K. M., & Hough, R. L. (2003). Relationship of youth satisfaction with mental health services and changes in symptoms and functioning. Psychiatric Services, 54, 1544–1546. https://doi.org/10.1176/appi.ps.54.11.1544

    Article  PubMed  Google Scholar 

  • Garland, A. F., Bickman, L., & Chorpita, B. F. (2010). Change what? Identifying quality improvement targets by investigating usual mental health care. Administration and Policy in Mental Health and Mental Health Services Research, 37(1–2), 15–26.

    Article  Google Scholar 

  • Henggeler, S. W., Schoenwald, S. K., Borduin, C. M., Rowland, M. D., & Cunningham, P. B. (2009). Multisystemic therapy for antisocial behavior in children and adolescents (2nd ed.). Guilford Press.

    Google Scholar 

  • Herman, K. C., Ostrander, R., Walkup, J. T., Silva, S. G., & March, J. S. (2007). Empirically derived subtypes of adolescent depression: Latent profile analysis of co-occurring symptoms in the Treatment for Adolescents with Depression Study (TADS). Journal of Consulting and Clinical Psychology, 75(5), 716–728.

    Article  Google Scholar 

  • Hodges, K. (1998). Child and Adolescent Functional Assessment Scale (CAFAS). Ann Arbor: Functional Assessment Systems.

    Google Scholar 

  • Hodges, K., & Gust, J. (1995). Measures of impairment for children and adolescents. The Journal of Mental Health Administration, 22(4), 403–413.

    Article  CAS  Google Scholar 

  • Hodges, K., & Wong, M. M. (1996). Psychometric characteristics of a multidimensional measure to assess impairment: The Child and Adolescent Functional Assessment Scale (CAFAS). Journal of Child and Family Studies, 5, 445–467.

    Article  Google Scholar 

  • Hodges, K., Wong, M. M., & Latessa, M. (1998). Use of the Child and Adolescent Functional Assessment Scale (CAFAS) as an outcome measure in clinical settings. Journal of Behavioral Health Services & Research, 25(3), 325–336.

    Article  CAS  Google Scholar 

  • Holmes, K. L., & Mueller, C. W. (2021). Treatment focus diffusion predicts poorer clinical progress in children’s public mental health care. Journal of Behavioral and Cognitive Therapy, 32, 99–110.

    Article  Google Scholar 

  • Izmirian, S., Milette-Winfree, M., Jackson, D., & Mueller, C. (2019). Predicting repeated child and adolescent residential treatment placements. Residential Treatment for Children and Youth, 36(4), 282–297. https://doi.org/10.1080/0886571X.2018.1558162

    Article  Google Scholar 

  • Jackson, D. S., Hill, K. A., Sender, M., & Mueller, C. (2016). Youth Outcome Patterns Across Levels of Care in CAMHD Services. Honolulu: Hawaii Child and Adolescent Mental Health Division.

    Google Scholar 

  • Jackson, D. S., Keir, S. S., Sender, M., & Mueller, C. (2017). Reliable change and outcome trajectories across levels of care in a mental health system for youth. Administration and Policy in Mental Health and Mental Health Services Research, 44(1), 141–154. https://doi.org/10.1007/s10488-015-0690-5

    Article  PubMed  Google Scholar 

  • Jackson, D. S., Orimoto, T. E., Sender, M., Mueller, C. W., & Turner, H. R. (2021). Child and Adolescent Mental Health Division: Fiscal Year 2020 Annual Factbook. Child and Adolescent Mental Health Division.

    Google Scholar 

  • Krueger, R. F., & Markon, K. E. (2006). Reinterpreting comorbidity: A model-based approach to under- standing and classifying psychopathology. Annual Review of Clinical Psychology, 2, 111.

    Article  Google Scholar 

  • Laba, T. M., Vincent, A. M., Stacy, T. A., Jackson, D. S., & Nakamura, B. J. (2020, November). The Ohio Scales, short form, problem severity domain: A psychometric study using a large community mental health caregiver sample within Hawaiʻi’s youth system of care. Poster presented at the 54th Annual Convention of the Association for Behavioral and Cognitive Therapies, Philadelphia, PA.

  • Lambert, M. J. (2010). Prevention of treatment failure: The use of measuring, monitoring, and feedback in clinical practice. American Psychological Association.

    Book  Google Scholar 

  • Lanza, S. T., & Rhoades, B. L. (2013). Latent class analysis: An alternative perspective on subgroup analysis in prevention and treatment. Prevention Science, 14(2), 157–168.

    Article  Google Scholar 

  • Lanza, S. T., Tan, X., & Bray, B. C. (2013). Latent class analysis with distal outcomes: A flexible model-based approach. Structural Equation Modeling, 20, 1–26.

    Article  Google Scholar 

  • Lo, Y., Mendell, N., & Rubin, D. (2001). Testing the number of components in a normal mixture. Biometrika, 88, 767–778.

    Article  Google Scholar 

  • Lubke, G., & Neale, M. C. (2006). Distinguishing between latent classes and continuous factors: Resolution by maximum likelihood? Multivariate Behavioral Research, 41(4), 499–532.

    Article  Google Scholar 

  • McLachlan, G., & Peel, D. (2000). Finite mixture models. Wiley.

    Book  Google Scholar 

  • Milette-Winfree, M., & Mueller, C. (2018). Treatment-as-usual therapy targets for comorbid youth disproportionately focus on externalizing problems. Psychological Services, 15(1), 65–77. https://doi.org/10.1037/ser0000162

    Article  PubMed  Google Scholar 

  • Mueller, C. W., Tolman, R., Higa-McMillan, C. K., & Daleiden, E. L. (2010). Longitudinal predictors of youth functional improvement in a public mental health system. The Journal of Behavioral Health Services and Research, 37(3), 350–362.

    Article  Google Scholar 

  • Muthén, L. K., & Muthén, B. O. (1998–2017). Mplus User’s Guide (8th ed.). Muthén & Muthén.

  • Nakamura, B. J., Daleiden, E. L., & Mueller, C. W. (2007). Validity of treatment target progress ratings as indicators of youth improvement. Journal of Child and Family Studies, 16(5), 729–741.

    Article  Google Scholar 

  • Nylund, K. L., Asparouhov, T., & Muthén, B. O. (2007). Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling, 14, 535–569.

    Article  Google Scholar 

  • Odgers, C. L., Moffitt, T. E., Broadbent, J. M., Dickson, N., Hancox, R. J., Harrington, H., Poulton, R., Sears, M. R., Thomson, W. M., & Caspi, A. (2008). Female and male antisocial trajectories: From childhood origins to adult outcomes. Developmental Psychopathology, 20, 673–716.

    Article  Google Scholar 

  • Ogles, B. M. & Healy, J. (2005). Calibrating the agency worker rated Ohio Scales with the Child and Adolescent Functional Assessment Scale. In Roth, D. (Ed.). New Research in Mental Health: 2002–2003 Biennium, 16, 249–255.

  • Ogles, B. M., Lunnen, K. M., & Bonesteel, K. (2001). Clinical significance. Clinical Psychology Review, 21(3), 421–446. https://doi.org/10.1016/S0272-7358(99)00058-6

    Article  CAS  PubMed  Google Scholar 

  • Ogles, B. M., Melendez, G., Davis, D. C., & Lunnen, K. M. (1999). The Ohio Youth Problem, Functioning, and Satisfaction Scales (short form): User's manual. Ohio Department of Mental Health.

  • Ogles, B. M., Melendez, G., Davis, D. C., & Lunnen, K. M. (2000). The Ohio Youth Problem, Functioning, and Satisfaction Scales: Technical manual. Ohio Department of Mental Health.

  • Riley, S. E., Stromberg, A. J., & Clark, J. J. (2009). Relationship between caregiver hopefulness and satisfaction with their children’s mental health services. Community Mental Health Journal, 45, 307–315.

    Article  Google Scholar 

  • Southam-Gerow, M. A., Chorpita, B. F., Miller, L. M., & Gleacher, A. A. (2008). Are children with anxiety disorders self-referred to a university clinic like those from the public mental health system? Administration and Policy in Mental Health and Mental Health Services Research, 35, 168–180.

    Article  Google Scholar 

  • Tolman, R., Mueller, C., Daleiden, E., Stumpf, R., & Pestle, S. (2008). Outcomes from Multisystemic Therapy in a statewide system of care. Journal of Child and Family Studies, 17(6), 894–908. https://doi.org/10.1007/s10826-008-9197-y

    Article  Google Scholar 

  • Warnick, E. M., Weersing, V. R., Scahill, L., & Woolston, J. L. (2009). Selecting measures for use in child mental health services: A scorecard approach. Administration and Policy in Mental Health, 36, 112–122.

    Article  Google Scholar 

  • Westen, D., Novotny, C. M., & Thompson-Brenner, H. (2004). The empirical status of empirically supported psychotherapies: Assumptions, findings, and reporting in controlled clinical trials. Psychological Bulletin, 130(4), 631–663.

    Article  Google Scholar 

  • Van Wert, M. J., Malik, M., Memel, B., Moore, R., Buccino, D., Hackerman, F., Kumari, S., Everett, A., & Narrow, W. (2021). Provider perceived barriers and facilitators to integrating routine outcome monitoring into practice in an urban community psychiatry clinic: A mixed-methods quality improvement project. Journal of Evaluation in Clinical Practice, 27(4), 767–775.

    Article  Google Scholar 

  • Vermunt, J. K. (2010). Latent class modeling with covariates: Two improved three-step approaches. Political Analysis, 18, 450–469.

    Article  Google Scholar 

  • Walrath, C. M., Mandell, D. S., & Leaf, P. J. (2001). Responses of children with different intake profiles to mental health treatment. Psychiatric Services, 52, 196–201.

    Article  CAS  Google Scholar 

  • Walrath, C. M., Ybarra, M. L., & Holden, E. W. (2006). Understanding the pre-referral factors associated with differential 6-month outcomes among children receiving system-of-care services. Psychological Services, 3, 35–50.

    Article  Google Scholar 

Download references

Acknowledgements

This study was supported in part from a research and evaluation contract awarded to the sixth author by the State of Hawai‘i, Department of Health, Child and Adolescent Mental Health Division

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Holly R. Turner.

Ethics declarations

Conflict of interest

The authors have no relevant financial or non-financial interests to disclose.

Ethical Approval

This study was approved as an exempt study by the University of Hawai‘i at Mānoa Human Studies Program Institutional Review Board.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Turner, H.R., Jackson, D.S., Sender, M. et al. Identifying Youth Problem Profiles and Predicting Remission Following Mental Health Treatment. Adm Policy Ment Health 49, 810–820 (2022). https://doi.org/10.1007/s10488-022-01200-7

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-022-01200-7

Keywords

Navigation