Abstract
This study utilized latent profile analysis to categorize youth served by a public mental health setting into homogenous classes. Then, associations between class membership and meeting clinical criteria by the latest assessment were examined. Caregiver responses to the Ohio Scales, Short Form, Problem Severity Scale for 1090 youth completed at entry into this public mental health system were subjected to latent profile analysis. This method classifies youth into categories based on mental health problem profiles, in order to determine the degree to which these groupings are related to later mental health outcomes. The classification of youth cases that emerged was then used to predict clinical remission at or nearest end of treatment, including final Ohio Scales Problem Severity scores and a measure of day-to-day functioning, the Child and Adolescent Functional Assessment Scale (CAFAS). A four-class model was identified as best representing the data, reflecting a relatively low-risk class (63.3% of the sample), an internalizing class (23.2%), a delinquency class (8.8%), and a high-risk class (4.7%). Individuals in the internalizing and high-risk classes had lower likelihoods of achieving problem remission than those in the low-risk and delinquency classes at the time of their last completed Ohio Scales. Additionally, youth assigned to the delinquency and high-risk classes had lower likelihoods of reaching functional impairment remission than those in the internalizing and low-risk classes. Youth membership in a class based on initial problem scores can be utilized to predict clinical remission over the course of treatment in public mental health care. Such class-based predictions support other methods of predicting outcomes and can be used by clinicians to develop more informed treatment plans and to adjust treatment based on such classifications.
Similar content being viewed by others
References
Alexander, J. F., Waldron, H. B., Robbins, M. S., & Neeb, A. A. (2013). Functional family therapy for adolescent behavior problems. American Psychological Association. https://doi.org/10.1037/14139-000
Asparouhov, T., & Muthén, B. (2014). Auxiliary variables in mixture modeling: Three-step approaches using Mplus. Structural Equation Modeling: A Multidisciplinary Journal, 21(3), 329–341. https://doi.org/10.1080/10705511.2014.915181
Barlow, D. H., Farchione, T. J., Bullis, J. R., Gallagher, M. W., Murray-Latin, H., Sauer-Zavala, S., Bentley, K. H., Thompson-Hollands, J., Conklin, L. R., Boswell, J. F., Ametaj, A., Carl, J. R., Boettcher, H. T., & Cassiello-Robbins, C. (2017). The unified protocol for transdiagnostic treatment of emotional disorders compared with diagnosis-specific protocols for anxiety disorders: A randomized clinical trial. JAMA Psychiatry, 74(9), 875–884. https://doi.org/10.1001/jamapsychiatry.2017.2164
Bonadio, F. T., Dynes, M., Lackey, J., Tompsett, C., & Amrhein, K. (2016). Grouping youth with similar symptoms: A person-centered approach to transdiagnostic subgroups. Journal of Clinical Psychology, 72(7), 676–688.
Bonadio, F. T., Evans, S. C., Cho, G. Y., Callahan, K. P., Chorpita, B. F., & Weisz, J. R. (2021). Whose outcomes come out? Patterns of caregiver- and youth-reported outcomes based on caregiver-youth baseline discrepancies. Journal of Clinical Child & Adolescent Psychology, 23, 1–15.
Bonadio, F. T., & Tompsett, C. (2016). The factor structure of the Ohio Scales: A practical measure of psychological symptoms in youth. Journal of Child and Family Studies, 26, 101–117. https://doi.org/10.1007/s10826-016-0544-0
Bonadio, F. T., & Tompsett, C. (2018). Who benefits from community mental health care? Using latent profile analysis to identify differential treatment outcomes for youth? Journal of Youth and Adolescence, 47, 2320–2336.
Brodbeck, J., Stulz, N., Itten, S., Regli, D., Znoj, H., & Caspar, F. (2014). The structure of psychopathological symptoms and the associations with DSM-diagnoses in treatment seeking individuals. Comprehensive Psychiatry, 55(3), 714–726.
Celeux, G., & Soromenho, G. (1996). An entropy criterion for assessing the number of clusters in a mixture model. Journal of Classification, 13, 195–212.
Child and Adolescent Mental Health Division (CAMHD), Hawai‘i Department of Health. (2018). Child and Adolescent Mental Health Performance Standards. Retrieved from https://health.hawaii.gov/camhd/files/2018/06/Teal-Book-2018.pdf
Dickson, K. S., Stadnick, N. A., Lind, T., & Trask, E. V. (2020). Defining and predicting high cost utilization in children’s outpatient mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 47, 655–664.
Dowell, K. A., & Ogles, B. M. (2008). The Ohio Scales Youth form: Expansion and validation of a self-report outcome measure for young children. Journal of Child and Family Studies, 17, 291–305.
Farchione, T. J., Fairholme, C. P., Ellard, K. K., Boisseau, C. L., Thompson-Hollands, J., Carl, J. R., Gallagher, M. W., & Barlow, D. H. (2012). Unified protocol for transdiagnostic treatment of emotional disorders: A randomized controlled trial. Behavior Therapy, 43(3), 666–678. https://doi.org/10.1016/j.beth.2012.01.001
Garland, A. F., Aarons, G. A., Hawley, K. M., & Hough, R. L. (2003). Relationship of youth satisfaction with mental health services and changes in symptoms and functioning. Psychiatric Services, 54, 1544–1546. https://doi.org/10.1176/appi.ps.54.11.1544
Garland, A. F., Bickman, L., & Chorpita, B. F. (2010). Change what? Identifying quality improvement targets by investigating usual mental health care. Administration and Policy in Mental Health and Mental Health Services Research, 37(1–2), 15–26.
Henggeler, S. W., Schoenwald, S. K., Borduin, C. M., Rowland, M. D., & Cunningham, P. B. (2009). Multisystemic therapy for antisocial behavior in children and adolescents (2nd ed.). Guilford Press.
Herman, K. C., Ostrander, R., Walkup, J. T., Silva, S. G., & March, J. S. (2007). Empirically derived subtypes of adolescent depression: Latent profile analysis of co-occurring symptoms in the Treatment for Adolescents with Depression Study (TADS). Journal of Consulting and Clinical Psychology, 75(5), 716–728.
Hodges, K. (1998). Child and Adolescent Functional Assessment Scale (CAFAS). Ann Arbor: Functional Assessment Systems.
Hodges, K., & Gust, J. (1995). Measures of impairment for children and adolescents. The Journal of Mental Health Administration, 22(4), 403–413.
Hodges, K., & Wong, M. M. (1996). Psychometric characteristics of a multidimensional measure to assess impairment: The Child and Adolescent Functional Assessment Scale (CAFAS). Journal of Child and Family Studies, 5, 445–467.
Hodges, K., Wong, M. M., & Latessa, M. (1998). Use of the Child and Adolescent Functional Assessment Scale (CAFAS) as an outcome measure in clinical settings. Journal of Behavioral Health Services & Research, 25(3), 325–336.
Holmes, K. L., & Mueller, C. W. (2021). Treatment focus diffusion predicts poorer clinical progress in children’s public mental health care. Journal of Behavioral and Cognitive Therapy, 32, 99–110.
Izmirian, S., Milette-Winfree, M., Jackson, D., & Mueller, C. (2019). Predicting repeated child and adolescent residential treatment placements. Residential Treatment for Children and Youth, 36(4), 282–297. https://doi.org/10.1080/0886571X.2018.1558162
Jackson, D. S., Hill, K. A., Sender, M., & Mueller, C. (2016). Youth Outcome Patterns Across Levels of Care in CAMHD Services. Honolulu: Hawaii Child and Adolescent Mental Health Division.
Jackson, D. S., Keir, S. S., Sender, M., & Mueller, C. (2017). Reliable change and outcome trajectories across levels of care in a mental health system for youth. Administration and Policy in Mental Health and Mental Health Services Research, 44(1), 141–154. https://doi.org/10.1007/s10488-015-0690-5
Jackson, D. S., Orimoto, T. E., Sender, M., Mueller, C. W., & Turner, H. R. (2021). Child and Adolescent Mental Health Division: Fiscal Year 2020 Annual Factbook. Child and Adolescent Mental Health Division.
Krueger, R. F., & Markon, K. E. (2006). Reinterpreting comorbidity: A model-based approach to under- standing and classifying psychopathology. Annual Review of Clinical Psychology, 2, 111.
Laba, T. M., Vincent, A. M., Stacy, T. A., Jackson, D. S., & Nakamura, B. J. (2020, November). The Ohio Scales, short form, problem severity domain: A psychometric study using a large community mental health caregiver sample within Hawaiʻi’s youth system of care. Poster presented at the 54th Annual Convention of the Association for Behavioral and Cognitive Therapies, Philadelphia, PA.
Lambert, M. J. (2010). Prevention of treatment failure: The use of measuring, monitoring, and feedback in clinical practice. American Psychological Association.
Lanza, S. T., & Rhoades, B. L. (2013). Latent class analysis: An alternative perspective on subgroup analysis in prevention and treatment. Prevention Science, 14(2), 157–168.
Lanza, S. T., Tan, X., & Bray, B. C. (2013). Latent class analysis with distal outcomes: A flexible model-based approach. Structural Equation Modeling, 20, 1–26.
Lo, Y., Mendell, N., & Rubin, D. (2001). Testing the number of components in a normal mixture. Biometrika, 88, 767–778.
Lubke, G., & Neale, M. C. (2006). Distinguishing between latent classes and continuous factors: Resolution by maximum likelihood? Multivariate Behavioral Research, 41(4), 499–532.
McLachlan, G., & Peel, D. (2000). Finite mixture models. Wiley.
Milette-Winfree, M., & Mueller, C. (2018). Treatment-as-usual therapy targets for comorbid youth disproportionately focus on externalizing problems. Psychological Services, 15(1), 65–77. https://doi.org/10.1037/ser0000162
Mueller, C. W., Tolman, R., Higa-McMillan, C. K., & Daleiden, E. L. (2010). Longitudinal predictors of youth functional improvement in a public mental health system. The Journal of Behavioral Health Services and Research, 37(3), 350–362.
Muthén, L. K., & Muthén, B. O. (1998–2017). Mplus User’s Guide (8th ed.). Muthén & Muthén.
Nakamura, B. J., Daleiden, E. L., & Mueller, C. W. (2007). Validity of treatment target progress ratings as indicators of youth improvement. Journal of Child and Family Studies, 16(5), 729–741.
Nylund, K. L., Asparouhov, T., & Muthén, B. O. (2007). Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling, 14, 535–569.
Odgers, C. L., Moffitt, T. E., Broadbent, J. M., Dickson, N., Hancox, R. J., Harrington, H., Poulton, R., Sears, M. R., Thomson, W. M., & Caspi, A. (2008). Female and male antisocial trajectories: From childhood origins to adult outcomes. Developmental Psychopathology, 20, 673–716.
Ogles, B. M. & Healy, J. (2005). Calibrating the agency worker rated Ohio Scales with the Child and Adolescent Functional Assessment Scale. In Roth, D. (Ed.). New Research in Mental Health: 2002–2003 Biennium, 16, 249–255.
Ogles, B. M., Lunnen, K. M., & Bonesteel, K. (2001). Clinical significance. Clinical Psychology Review, 21(3), 421–446. https://doi.org/10.1016/S0272-7358(99)00058-6
Ogles, B. M., Melendez, G., Davis, D. C., & Lunnen, K. M. (1999). The Ohio Youth Problem, Functioning, and Satisfaction Scales (short form): User's manual. Ohio Department of Mental Health.
Ogles, B. M., Melendez, G., Davis, D. C., & Lunnen, K. M. (2000). The Ohio Youth Problem, Functioning, and Satisfaction Scales: Technical manual. Ohio Department of Mental Health.
Riley, S. E., Stromberg, A. J., & Clark, J. J. (2009). Relationship between caregiver hopefulness and satisfaction with their children’s mental health services. Community Mental Health Journal, 45, 307–315.
Southam-Gerow, M. A., Chorpita, B. F., Miller, L. M., & Gleacher, A. A. (2008). Are children with anxiety disorders self-referred to a university clinic like those from the public mental health system? Administration and Policy in Mental Health and Mental Health Services Research, 35, 168–180.
Tolman, R., Mueller, C., Daleiden, E., Stumpf, R., & Pestle, S. (2008). Outcomes from Multisystemic Therapy in a statewide system of care. Journal of Child and Family Studies, 17(6), 894–908. https://doi.org/10.1007/s10826-008-9197-y
Warnick, E. M., Weersing, V. R., Scahill, L., & Woolston, J. L. (2009). Selecting measures for use in child mental health services: A scorecard approach. Administration and Policy in Mental Health, 36, 112–122.
Westen, D., Novotny, C. M., & Thompson-Brenner, H. (2004). The empirical status of empirically supported psychotherapies: Assumptions, findings, and reporting in controlled clinical trials. Psychological Bulletin, 130(4), 631–663.
Van Wert, M. J., Malik, M., Memel, B., Moore, R., Buccino, D., Hackerman, F., Kumari, S., Everett, A., & Narrow, W. (2021). Provider perceived barriers and facilitators to integrating routine outcome monitoring into practice in an urban community psychiatry clinic: A mixed-methods quality improvement project. Journal of Evaluation in Clinical Practice, 27(4), 767–775.
Vermunt, J. K. (2010). Latent class modeling with covariates: Two improved three-step approaches. Political Analysis, 18, 450–469.
Walrath, C. M., Mandell, D. S., & Leaf, P. J. (2001). Responses of children with different intake profiles to mental health treatment. Psychiatric Services, 52, 196–201.
Walrath, C. M., Ybarra, M. L., & Holden, E. W. (2006). Understanding the pre-referral factors associated with differential 6-month outcomes among children receiving system-of-care services. Psychological Services, 3, 35–50.
Acknowledgements
This study was supported in part from a research and evaluation contract awarded to the sixth author by the State of Hawai‘i, Department of Health, Child and Adolescent Mental Health Division
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors have no relevant financial or non-financial interests to disclose.
Ethical Approval
This study was approved as an exempt study by the University of Hawai‘i at Mānoa Human Studies Program Institutional Review Board.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Turner, H.R., Jackson, D.S., Sender, M. et al. Identifying Youth Problem Profiles and Predicting Remission Following Mental Health Treatment. Adm Policy Ment Health 49, 810–820 (2022). https://doi.org/10.1007/s10488-022-01200-7
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-022-01200-7