Advertisement

Screening for health-related quality of life in children and adolescents: Optimal cut points for the KIDSCREEN-10 for epidemiological studies

  • Gerrit HirschfeldEmail author
  • Ruth von Brachel
  • Christian Thiele
Article

Abstract

Introduction

Generic measures of health-related quality of life are important in pediatrics. Here, we try to establish optimal cut points for the self-report and parental-report versions of the KIDSCREEN-10.

Method

We re-analyzed data from the German Health Interview and Examination Survey for Children and Adolescents (KiGGS) study. In total, data from 2566 children, 2136 younger adolescents, and 2740 older adolescents were used. The KIDSCREEN-10 was contrasted to three different anchors: the strength and difficulties questionnaire, self-rated general health, and chronic diseases. A kernel-based method and bootstrapping were used to determine the optimal cut points and their variability.

Results

We found large differences in HRQoL between children with vs. without mental health problems but there is only medium-to-small differences in HRQoL between children with vs. without chronic diseases and children with self-rated good vs. poor physical health. Acceptable levels of classification accuracy were found in relation to mental health problems for all versions (AUCs between 0.77 and 0.79), but only for the parental-report version in relation to general health and for no version in relation to chronic diseases. Cut points identified as optimal differed systematically between parental-report versions (cut point = 41.13) and self-report for younger (cut point = 42.52) and older adolescents (cut point = 40.29).

Conclusion

The results aid the interpretation of KIDSCREEN-10 in epidemiological studies. Specifically, we suggest a cut point of 41 should be used to interpret the parental-report version of the KIDSCREEN and 40 and 42, respectively, for young and older adolescents.

Keywords

Health-related quality of life Diagnostic utility Optimal cut points, boostrapping 

Notes

Acknowledgements

The following data were used in this study: Public Use File KiGGS, German Health Survey for Children and Adolescents, 2003–2006, Robert Koch Institute, Berlin, Germany, 2008.

Funding

The study was supported by the German Federal ministry for Education and Research (BMBF #01EK1501).

Compliance with ethical standards

Conflict of interest

The authors declare that they have no conflict of interest.

Research involving human and animal participants

This article does not contain any studies with human participants or animals performed by any of the authors.

Supplementary material

11136_2019_2324_MOESM1_ESM.R
Electronic supplementary material 1 (4 kb)

References

  1. 1.
    Guyatt, G. H., Feeny, D. H., & Patrick, D. L. (1993). Measuring health-related quality of life. Annals of Internal Medicine, 118(8), 622–629.CrossRefGoogle Scholar
  2. 2.
    McGrath, P. J., Walco, G. A., Turk, D. C., Dworkin, R. H., Brown, M. T., Davidson, K., et al. (2008). Core outcome domains and measures for pediatric acute and chronic/recurrent pain clinical trials: PedIMMPACT recommendations. Journal of Pain, 9(9), 771–783.CrossRefGoogle Scholar
  3. 3.
    Ravens-Sieberer, U., Erhart, M., Wille, N., Wetzel, R., Nickel, J., & Bullinger, M. (2006). Generic health-related quality-of-life assessment in children and adolescents. Pharmacoeconomics, 24(12), 1199–1220.CrossRefGoogle Scholar
  4. 4.
    Varni, J. W., Seid, M., & Kurtin, P. S. (2001). PedsQLTM 4.0: Reliability and validity of the Pediatric Quality of Life InventoryTM Version 4.0 generic core scales in healthy and patient populations. Medical Care, 39(8), 800–812.CrossRefGoogle Scholar
  5. 5.
    Simeoni, M. C., Auquier, P., Antoniotti, S., Sapin, C., & San Marco, J. L. (2000). Validation of a French health-related quality of life instrument for adolescents: The VSP-A. Quality of Life Research, 9(4), 393–403.CrossRefGoogle Scholar
  6. 6.
    Solans, M., Pane, S., Estrada, M.-D., Serra-Sutton, V., Berra, S., Herdman, M., et al. (2008). Health-related quality of life measurement in children and adolescents: A systematic review of generic and disease-specific instruments. Value In Health, 11(4), 742–764.CrossRefGoogle Scholar
  7. 7.
    Davis, E., Waters, E., Mackinnon, A., Reddihough, D., Graham, H. K., Mehmet-Radji, O., et al. (2006). Paediatric quality of life instruments: A review of the impact of the conceptual framework on outcomes. Developmental Medicine and Child Neurology, 48(4), 311–318.CrossRefGoogle Scholar
  8. 8.
    Erhart M, Ravens-Sieberer U (2006) Health-related quality of life instruments and individual diagnosis—A new area of application. GMS Psycho-Social Medicine, 3. Retrieved from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2736504.Google Scholar
  9. 9.
    Serra-Sutton, V., Ferrer, M., Rajmil, L., Tebé, C., Simeoni, M.-C., & Ravens-Sieberer, U. (2009). Population norms and cut-off-points for suboptimal health related quality of life in two generic measures for adolescents: The Spanish VSP-A and KINDL-R. Health and Quality of Life Outcomes, 7(1), 35.CrossRefGoogle Scholar
  10. 10.
    Ravens-Sieberer, U., Herdman, M., Devine, J., Otto, C., Bullinger, M., Rose, M., et al. (2014). The European KIDSCREEN approach to measure quality of life and well-being in children: Development, current application, and future advances. Quality of Life Research, 23(3), 791–803.  https://doi.org/10.1007/s11136-013-0428-3.CrossRefPubMedGoogle Scholar
  11. 11.
    Ravens-Sieberer, U., Gosch, A., Rajmil, L., Erhart, M., Bruil, J., Power, M., et al. (2008). The KIDSCREEN-52 quality of life measure for children and adolescents: Psychometric results from a cross-cultural survey in 13 European countries. Value In Health, 11(4), 645–658.CrossRefGoogle Scholar
  12. 12.
    Ravens-Sieberer, U., Auquier, P., Erhart, M., Gosch, A., Rajmil, L., Bruil, J., et al. (2007). The KIDSCREEN-27 quality of life measure for children and adolescents: Psychometric results from a cross-cultural survey in 13 European countries. Quality of Life Research, 16(8), 1347–1356.  https://doi.org/10.1007/s11136-007-9240-2.CrossRefPubMedGoogle Scholar
  13. 13.
    Ravens-Sieberer, U., Erhart, M., Rajmil, L., Herdman, M., Auquier, P., Bruil, J., et al. (2010). Reliability, construct and criterion validity of the KIDSCREEN-10 score: A short measure for children and adolescents’ well-being and health-related quality of life. Quality of Life Research, 19(10), 1487–1500.  https://doi.org/10.1007/s11136-010-9706-5.CrossRefPubMedPubMedCentralGoogle Scholar
  14. 14.
    Revicki, D., Hays, R. D., Cella, D., & Sloan, J. (2008). Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. Journal of Clinical Epidemiology, 61(2), 102–109.CrossRefGoogle Scholar
  15. 15.
    Goodman, R. (1997). The strengths and difficulties questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38(5), 581–586.CrossRefGoogle Scholar
  16. 16.
    Fluss, R., Faraggi, D., & Reiser, B. (2005). Estimation of the youden index and its associated cutoff point. Biometrical Journal, 47(4), 458–472.  https://doi.org/10.1002/bimj.200410135.CrossRefPubMedGoogle Scholar
  17. 17.
    Hirschfeld, G., & do Brasil, P. E. A. A. (2014). A simulation study into the performance of “optimal” diagnostic thresholds in the population:“Large” effect sizes are not enough. Journal of Clinical Epidemiology, 67(4), 449–453.CrossRefGoogle Scholar
  18. 18.
    Leeflang, M. M. G., Moons, K. G. M., Reitsma, J. B., & Zwinderman, A. H. (2008). Bias in sensitivity and specificity caused by data-driven selection of optimal cutoff values: Mechanisms, magnitude, and solutions. Clinical Chemistry, 54(4), 729–737.CrossRefGoogle Scholar
  19. 19.
    Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12.CrossRefGoogle Scholar
  20. 20.
    Matos, M. G. D., Gaspar, T., & Simões, C. (2012). Health-related quality of life in Portuguese children and adolescents. Psicologia, 25(2), 230–237.Google Scholar
  21. 21.
    Robert Koch Institute, Department of Epidemiology and Health Monitoring (2015) The German Health Survey for Children and Adolescents (KiGGS Wave 1). Public Use File first version, RKI Robert Koch Institute Doi: 10.7797/15-200912-1-1-1.Google Scholar
  22. 22.
    The KIDSCREEN Group Europe. (2006). The KIDSCREEN questionnaires—Quality of life questionnaires for children and adolescents. Handbook. Lengerich: Pabst Science Publisher.Google Scholar
  23. 23.
    Goodman, R. (2001). Psychometric properties of the strengths and difficulties questionnaire. Journal of the American Academy of Child and Adolescent Psychiatry, 40(11), 1337–1345.  https://doi.org/10.1097/00004583-200111000-00015.CrossRefPubMedGoogle Scholar
  24. 24.
    Goodman, R., Ford, T., Simmons, H., Gatward, R., & Meltzer, H. (2000). Using the strengths and difficulties questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. The British Journal of Psychiatry, 177, 534–539.CrossRefGoogle Scholar
  25. 25.
    Cox, B., Van Oyen, H., Cambois, E., Jagger, C., Le Roy, S., Robine, J.-M., et al. (2009). The reliability of the minimum European health module. International Journal of Public Health, 54(2), 55–60.CrossRefGoogle Scholar
  26. 26.
    Breiman, L. (1996). Bagging predictors. Machine Learning, 24, 123–140.Google Scholar
  27. 27.
    Thiele C (2018) Cutpointr: Determine and evaluate optimal cutpoints in binary classification tasks. Retrieved from https://CRAN.R-project.org/package=cutpointr.Google Scholar
  28. 28.
    Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013). Applied logistic regression (Vol. 398). John Wiley & Sons.Google Scholar
  29. 29.
    Hirschfeld, G. (2014). Clinically meaningful changes in pain ratings: why we need special cut points in children and adolescents. Pain Management, 4(2), 81–83.CrossRefGoogle Scholar
  30. 30.
    Varni, J. W., Limbers, C. A., & Burwinkle, T. M. (2007). How young can children reliably and validly self-report their health-related quality of life?: An analysis of 8591 children across age subgroups with the PedsQLTM 4.0 Generic Core Scales. Health and Quality of Life Outcomes, 5(1), 1.  https://doi.org/10.1186/1477-7525-5-1.CrossRefPubMedPubMedCentralGoogle Scholar
  31. 31.
    von Baeyer, C. L. (2009). Children’s self-report of pain intensity: What we know, where we are headed. Pain Research & Management, 14(1), 39–45.CrossRefGoogle Scholar
  32. 32.
    Keyes, C. L. M., Dhingra, S. S., & Simoes, E. J. (2010). Change in level of positive mental health as a predictor of future risk of mental illness. American Journal of Public Health, 100(12), 2366–2371.  https://doi.org/10.2105/AJPH.2010.192245.CrossRefPubMedPubMedCentralGoogle Scholar
  33. 33.
    Guyatt, G. H., Osoba, D., Wu, A. W., Wyrwich, K. W., Norman, G. R., et al. (2002). Methods to explain the clinical significance of health status measures. Mayo Clinic Proceedings, 77(4), 371–383.CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Faculty of Business and HealthUniversity of Applied Sciences BielefeldBielefeldGermany
  2. 2.Mental Health Research & Treatment CenterRuhr-Universität BochumBochumGermany

Personalised recommendations