Screening for health-related quality of life in children and adolescents: Optimal cut points for the KIDSCREEN-10 for epidemiological studies
Abstract
Introduction
Generic measures of health-related quality of life are important in pediatrics. Here, we try to establish optimal cut points for the self-report and parental-report versions of the KIDSCREEN-10.
Method
We re-analyzed data from the German Health Interview and Examination Survey for Children and Adolescents (KiGGS) study. In total, data from 2566 children, 2136 younger adolescents, and 2740 older adolescents were used. The KIDSCREEN-10 was contrasted to three different anchors: the strength and difficulties questionnaire, self-rated general health, and chronic diseases. A kernel-based method and bootstrapping were used to determine the optimal cut points and their variability.
Results
We found large differences in HRQoL between children with vs. without mental health problems but there is only medium-to-small differences in HRQoL between children with vs. without chronic diseases and children with self-rated good vs. poor physical health. Acceptable levels of classification accuracy were found in relation to mental health problems for all versions (AUCs between 0.77 and 0.79), but only for the parental-report version in relation to general health and for no version in relation to chronic diseases. Cut points identified as optimal differed systematically between parental-report versions (cut point = 41.13) and self-report for younger (cut point = 42.52) and older adolescents (cut point = 40.29).
Conclusion
The results aid the interpretation of KIDSCREEN-10 in epidemiological studies. Specifically, we suggest a cut point of 41 should be used to interpret the parental-report version of the KIDSCREEN and 40 and 42, respectively, for young and older adolescents.
Keywords
Health-related quality of life Diagnostic utility Optimal cut points, boostrappingNotes
Acknowledgements
The following data were used in this study: Public Use File KiGGS, German Health Survey for Children and Adolescents, 2003–2006, Robert Koch Institute, Berlin, Germany, 2008.
Funding
The study was supported by the German Federal ministry for Education and Research (BMBF #01EK1501).
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
Research involving human and animal participants
This article does not contain any studies with human participants or animals performed by any of the authors.
Supplementary material
References
- 1.Guyatt, G. H., Feeny, D. H., & Patrick, D. L. (1993). Measuring health-related quality of life. Annals of Internal Medicine, 118(8), 622–629.CrossRefGoogle Scholar
- 2.McGrath, P. J., Walco, G. A., Turk, D. C., Dworkin, R. H., Brown, M. T., Davidson, K., et al. (2008). Core outcome domains and measures for pediatric acute and chronic/recurrent pain clinical trials: PedIMMPACT recommendations. Journal of Pain, 9(9), 771–783.CrossRefGoogle Scholar
- 3.Ravens-Sieberer, U., Erhart, M., Wille, N., Wetzel, R., Nickel, J., & Bullinger, M. (2006). Generic health-related quality-of-life assessment in children and adolescents. Pharmacoeconomics, 24(12), 1199–1220.CrossRefGoogle Scholar
- 4.Varni, J. W., Seid, M., & Kurtin, P. S. (2001). PedsQLTM 4.0: Reliability and validity of the Pediatric Quality of Life InventoryTM Version 4.0 generic core scales in healthy and patient populations. Medical Care, 39(8), 800–812.CrossRefGoogle Scholar
- 5.Simeoni, M. C., Auquier, P., Antoniotti, S., Sapin, C., & San Marco, J. L. (2000). Validation of a French health-related quality of life instrument for adolescents: The VSP-A. Quality of Life Research, 9(4), 393–403.CrossRefGoogle Scholar
- 6.Solans, M., Pane, S., Estrada, M.-D., Serra-Sutton, V., Berra, S., Herdman, M., et al. (2008). Health-related quality of life measurement in children and adolescents: A systematic review of generic and disease-specific instruments. Value In Health, 11(4), 742–764.CrossRefGoogle Scholar
- 7.Davis, E., Waters, E., Mackinnon, A., Reddihough, D., Graham, H. K., Mehmet-Radji, O., et al. (2006). Paediatric quality of life instruments: A review of the impact of the conceptual framework on outcomes. Developmental Medicine and Child Neurology, 48(4), 311–318.CrossRefGoogle Scholar
- 8.Erhart M, Ravens-Sieberer U (2006) Health-related quality of life instruments and individual diagnosis—A new area of application. GMS Psycho-Social Medicine, 3. Retrieved from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2736504.Google Scholar
- 9.Serra-Sutton, V., Ferrer, M., Rajmil, L., Tebé, C., Simeoni, M.-C., & Ravens-Sieberer, U. (2009). Population norms and cut-off-points for suboptimal health related quality of life in two generic measures for adolescents: The Spanish VSP-A and KINDL-R. Health and Quality of Life Outcomes, 7(1), 35.CrossRefGoogle Scholar
- 10.Ravens-Sieberer, U., Herdman, M., Devine, J., Otto, C., Bullinger, M., Rose, M., et al. (2014). The European KIDSCREEN approach to measure quality of life and well-being in children: Development, current application, and future advances. Quality of Life Research, 23(3), 791–803. https://doi.org/10.1007/s11136-013-0428-3.CrossRefPubMedGoogle Scholar
- 11.Ravens-Sieberer, U., Gosch, A., Rajmil, L., Erhart, M., Bruil, J., Power, M., et al. (2008). The KIDSCREEN-52 quality of life measure for children and adolescents: Psychometric results from a cross-cultural survey in 13 European countries. Value In Health, 11(4), 645–658.CrossRefGoogle Scholar
- 12.Ravens-Sieberer, U., Auquier, P., Erhart, M., Gosch, A., Rajmil, L., Bruil, J., et al. (2007). The KIDSCREEN-27 quality of life measure for children and adolescents: Psychometric results from a cross-cultural survey in 13 European countries. Quality of Life Research, 16(8), 1347–1356. https://doi.org/10.1007/s11136-007-9240-2.CrossRefPubMedGoogle Scholar
- 13.Ravens-Sieberer, U., Erhart, M., Rajmil, L., Herdman, M., Auquier, P., Bruil, J., et al. (2010). Reliability, construct and criterion validity of the KIDSCREEN-10 score: A short measure for children and adolescents’ well-being and health-related quality of life. Quality of Life Research, 19(10), 1487–1500. https://doi.org/10.1007/s11136-010-9706-5.CrossRefPubMedPubMedCentralGoogle Scholar
- 14.Revicki, D., Hays, R. D., Cella, D., & Sloan, J. (2008). Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. Journal of Clinical Epidemiology, 61(2), 102–109.CrossRefGoogle Scholar
- 15.Goodman, R. (1997). The strengths and difficulties questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38(5), 581–586.CrossRefGoogle Scholar
- 16.Fluss, R., Faraggi, D., & Reiser, B. (2005). Estimation of the youden index and its associated cutoff point. Biometrical Journal, 47(4), 458–472. https://doi.org/10.1002/bimj.200410135.CrossRefPubMedGoogle Scholar
- 17.Hirschfeld, G., & do Brasil, P. E. A. A. (2014). A simulation study into the performance of “optimal” diagnostic thresholds in the population:“Large” effect sizes are not enough. Journal of Clinical Epidemiology, 67(4), 449–453.CrossRefGoogle Scholar
- 18.Leeflang, M. M. G., Moons, K. G. M., Reitsma, J. B., & Zwinderman, A. H. (2008). Bias in sensitivity and specificity caused by data-driven selection of optimal cutoff values: Mechanisms, magnitude, and solutions. Clinical Chemistry, 54(4), 729–737.CrossRefGoogle Scholar
- 19.Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12.CrossRefGoogle Scholar
- 20.Matos, M. G. D., Gaspar, T., & Simões, C. (2012). Health-related quality of life in Portuguese children and adolescents. Psicologia, 25(2), 230–237.Google Scholar
- 21.Robert Koch Institute, Department of Epidemiology and Health Monitoring (2015) The German Health Survey for Children and Adolescents (KiGGS Wave 1). Public Use File first version, RKI Robert Koch Institute Doi: 10.7797/15-200912-1-1-1.Google Scholar
- 22.The KIDSCREEN Group Europe. (2006). The KIDSCREEN questionnaires—Quality of life questionnaires for children and adolescents. Handbook. Lengerich: Pabst Science Publisher.Google Scholar
- 23.Goodman, R. (2001). Psychometric properties of the strengths and difficulties questionnaire. Journal of the American Academy of Child and Adolescent Psychiatry, 40(11), 1337–1345. https://doi.org/10.1097/00004583-200111000-00015.CrossRefPubMedGoogle Scholar
- 24.Goodman, R., Ford, T., Simmons, H., Gatward, R., & Meltzer, H. (2000). Using the strengths and difficulties questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. The British Journal of Psychiatry, 177, 534–539.CrossRefGoogle Scholar
- 25.Cox, B., Van Oyen, H., Cambois, E., Jagger, C., Le Roy, S., Robine, J.-M., et al. (2009). The reliability of the minimum European health module. International Journal of Public Health, 54(2), 55–60.CrossRefGoogle Scholar
- 26.Breiman, L. (1996). Bagging predictors. Machine Learning, 24, 123–140.Google Scholar
- 27.Thiele C (2018) Cutpointr: Determine and evaluate optimal cutpoints in binary classification tasks. Retrieved from https://CRAN.R-project.org/package=cutpointr.Google Scholar
- 28.Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013). Applied logistic regression (Vol. 398). John Wiley & Sons.Google Scholar
- 29.Hirschfeld, G. (2014). Clinically meaningful changes in pain ratings: why we need special cut points in children and adolescents. Pain Management, 4(2), 81–83.CrossRefGoogle Scholar
- 30.Varni, J. W., Limbers, C. A., & Burwinkle, T. M. (2007). How young can children reliably and validly self-report their health-related quality of life?: An analysis of 8591 children across age subgroups with the PedsQLTM 4.0 Generic Core Scales. Health and Quality of Life Outcomes, 5(1), 1. https://doi.org/10.1186/1477-7525-5-1.CrossRefPubMedPubMedCentralGoogle Scholar
- 31.von Baeyer, C. L. (2009). Children’s self-report of pain intensity: What we know, where we are headed. Pain Research & Management, 14(1), 39–45.CrossRefGoogle Scholar
- 32.Keyes, C. L. M., Dhingra, S. S., & Simoes, E. J. (2010). Change in level of positive mental health as a predictor of future risk of mental illness. American Journal of Public Health, 100(12), 2366–2371. https://doi.org/10.2105/AJPH.2010.192245.CrossRefPubMedPubMedCentralGoogle Scholar
- 33.Guyatt, G. H., Osoba, D., Wu, A. W., Wyrwich, K. W., Norman, G. R., et al. (2002). Methods to explain the clinical significance of health status measures. Mayo Clinic Proceedings, 77(4), 371–383.CrossRefGoogle Scholar