Advertisement

How to Develop Well-Being Survey Questions for Young Children: Lessons Learned from Cross-Cultural Cognitive Interviews

  • Renata Franc
  • Ines Sučić
  • Toni Babarović
  • Andreja Brajša-Žganec
  • Ljiljana Kaliterna-Lipovčan
  • Ivan Dević
Chapter
Part of the Children’s Well-Being: Indicators and Research book series (CHIR, volume 19)

Abstract

There are several major challenges related to conducting cross-cultural well-being surveys, which are even more pronounced when respondents are young children. In order to explore how young children from different countries understand, interpret and process well-being survey questions, within the MYWeB project, the cognitive interviews (CI) study was conducted with young children in six European countries. The specific research objective was to test new/adapted measures of well-being, and the CI testing was focused on comprehension and appropriateness of items and exact wording, recall and judgement in the given time frames, and the given response format among young children. The CI study was conducted in three consecutive rounds, in total, 77 seven year-olds and 118 eight year-olds (N = 195) were interviewed by 26 interviewers. The chapter discuss the main findings and presents general recommendations on how to develop and conduct a well-being survey that is age-appropriate for young children.

Keywords

Survey design Young children Cognitive interviews Response scales Time frames 

References

  1. Bell, A. (2007). Designing and testing questionnaires for children. Journal of Research in Nursing, 12(5), 461–469.CrossRefGoogle Scholar
  2. Ben-Arieh, A. (2005). Where are the children? Children’s role in measuring and monitoring their well-being. Social Indicators Research, 74(3), 573–596.CrossRefGoogle Scholar
  3. Borgers, N., & Hox, J. (2001). Item nonresponse in questionnaire research with children. Journal of Official Statistics, 17(2), 321.Google Scholar
  4. Borgers, N., De Leeuw, E., & Hox, J. (2000). Children as respondents in survey research: Cognitive development and response quality 1. Bulletin of Sociological Methodology/Bulletin de Méthodologie Sociologique, 66(1), 60–75.CrossRefGoogle Scholar
  5. Borgers, N., Sikkel, D., & Hox, J. (2004). Response effects in surveys on children and adolescents: The effect of number of response options, negative wording, and neutral mid-point. Quality and Quantity, 38(1), 17–13.CrossRefGoogle Scholar
  6. Bowen, N. K. (2008). Cognitive testing and the validity of child-report data from the elementary school success profile. Social Work Research, 32(1), 1–17.CrossRefGoogle Scholar
  7. Casas, F. (2017). Analysing the comparability of 3 multi-item subjective well-being psychometric scales among 15 countries using samples of 10 and 12-year-olds. Child Indicators Research, 10(2), 297–330.  https://doi.org/10.1007/s12187-015-9360-0.CrossRefGoogle Scholar
  8. Collins, D. (2003). Pretesting survey instruments: An overview of cognitive methods. Quality of Life Research, 12, 219–227.CrossRefGoogle Scholar
  9. Cummins, R. A., & Lau, A. D. L. (2005). Personal well-being index: School children (PWI-SC) (3rd ed.). Melbourne: Deakin University.Google Scholar
  10. Dworsky, A. (2014). Children as self-informants in longitudinal studies: Substantive findings and methodological issues. In G. B. Melton, A. Ben-Arieh, J. Cashmore, G. S. Goodman, & N. K. Worley (Eds.), The Sage handbook of child research (pp. 391–431). London: SAGE.CrossRefGoogle Scholar
  11. Fitzgerald, R., Widdop, S., Gray, M., & Collins, D. (2009). Testing for equivalence using cross-national cognitive interviewing. In Centre for comparative social surveys working paper series. London: City University London, Centre for Comparative Social Surveys. https://www.city.ac.uk/__data/assets/pdf_file/0014/125132/CCSS-Working-Paper-No-01.pdf. Accessed 30 Sept 2016.Google Scholar
  12. Harkness, J. (2003). Questionnaire translation. In J. A. Harkness, F. J. R. van de Vijver, & P. P. Mohler (Eds.), Cross-cultural survey methods. New York: Wiley.Google Scholar
  13. Huebner, E. S. (1994). Preliminary development and validation of a multidimensional life satisfaction scale for children. Psychological Assessment, 6(2), 149.CrossRefGoogle Scholar
  14. Irwin, D. E., Varni, J. W., Yeatts, K., & De Walt, D. A. (2009). Cognitive interviewing methodology in the development of a pediatric item bank: A patient reported outcomes measurement information system (PROMIS) study. Health and Quality of Life Outcomes, 7(3), 1–10.  https://doi.org/10.1186/1477-7525-7-3.Google Scholar
  15. Lavrakas, P. J. (2008). Encyclopedia of survey research methods. Thousand Oaks: Sage Publications.CrossRefGoogle Scholar
  16. Lippman, L., Guzman, L., & Anderson Moore, K. (2012). Measuring flourishing among youth findings from the flourishing children positive indicators project. Washington, DC: Child Trends. https://www.childtrends.org/wp-content/uploads/2013/05/FlourishingChildren.pdf. Accessed 15 Dec 2017.Google Scholar
  17. Lippman, L. H., Moore, K. A., Guzman, L., Ryberg, R., McIntosh, H., Ramos, M. F., Caal, S., Carle, A., & Kuhfeld, M. (2014). Flourishing children. Defining and testing indicators of positive development. New York: Springer.  https://doi.org/10.1007/978-94-017-8607-2.Google Scholar
  18. Miller, K., & Willis, G. (2016). Cognitive models of answering processes. In C. Wolf (Ed.), The Sage handbook of survey methodology (pp. 210–217). SAGE Publications.  https://doi.org/10.4135/9781473957893.
  19. Olweus, D. (1996). Bullying at school: Knowledge base and an effective intervention program. New York: Wiley.Google Scholar
  20. Ravens-Sieberer, U., Herdman, M., Devine, J., Otto, C., Bullinger, M., Rose, M., & Klasen, F. (2014a). The European KIDSCREEN approach to measure quality of life and well-being in children: Development, current application, and future advances. Quality of Life Research, 23(3), 791.CrossRefGoogle Scholar
  21. Ravens-Sieberer, U., Devine, J., Bevans, K., Riley, A. W., Moon, J., Salsman, J. M., & Forrest, C. B. (2014b). Subjective well-being measures for children were developed within the PROMIS project: presentation of first results. Journal of clinical epidemiology, 67(2), 207–218.CrossRefGoogle Scholar
  22. Rebok, G., Riley, A., Forrest, C., Starfield, B., Green, B., Robertson, J., & Tambor, E. (2001). Elementary school-aged children’s reports of their health: A cognitive interview study. Quality of Life Research, 10(1), 59–70.CrossRefGoogle Scholar
  23. Rees, G., & Bradshaw, J. (2016). Children’s views on their lives and well-being in 16 countries: A report on the children’s worlds survey of children aged eight years old, 2013–15 Jacobs Foundation. http://eprints.whiterose.ac.uk/95207/1/8yearsoldreport.pdf. Accessed 15 Dec 2017.
  24. Richardson, D., & Ali, N. (2014). An Evaluation of international surveys of children (OECD Social, Employment and Migration Working Papers, No. 146). OECD Publishing.  https://doi.org/10.1787/5jxzmjrqvntf-en. Accessed 15 Dec 2017.
  25. Saywitz, K. J., & Camparo, L. B. (2014). Interviewing children: A primer. In G. B. Melton, A. Ben-Arieh, J. Cashmore, G. S. Goodman, & N. K. Worley (Eds.), The Sage handbook of child research (pp. 371–390). London: SAGE Publications Ltd..  https://doi.org/10.4135/9781446294758.CrossRefGoogle Scholar
  26. Scott, J. (2000). Children as respondents: The challenge for quantitative methods. In P. Christensen & A. James (Eds.), Research with children: Perspectives and practices (pp. 98–119). London: Falmer Press.Google Scholar
  27. Seligson, J. L., Huebner, E. S., & Valois, R. F. (2003). Preliminary validation of the brief multidimensional students’ life satisfaction scale (BMSLSS). Social Indicators Research, 61(2), 121–145.CrossRefGoogle Scholar
  28. Serracant, P., Franc, R., & Ozan, J. (2015). Deliverable 6.1 WP6 Pilot Research design and methodology. FP7 MYWeB (Measuring Youth Well Being).Google Scholar
  29. Smyth, J. D. (2016). Designing questions and questionnaires. In C. Wolf, D. E. Joye, T. W. Smith, & Y. Fu (Eds.), The Sage handbook of survey methodology (pp. 218–235). SAGE Publications.  https://doi.org/10.4135/9781473957893.
  30. Tourangeau, R. (1984). Cognitive science and survey methods: A cognitive perspective. In T. Jabine, M. Straf, J. Tanur, & R. Tourangeau (Eds.), Cognitive aspects of survey methodology: Building a bridge between disciplines. Washington, DC: National Academy Press.Google Scholar
  31. Tourangeau, R., Rips, L. J., & Rasinski, K. (2000). The psychology of survey response. Cambridge University Press.Google Scholar
  32. Varni, J. W., Limbers, C. A., & Burwinkle, T. M. (2007). Parent proxy-report of their children’s health-related quality of life: An analysis of 13,878 parents’ reliability and validity across age subgroups using the PedsQL (TM) 4.0 Generic Core Scales. Health Quality Life Outcomes, 5(2). https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1769359/.) Accessed 30 Sept 2016.
  33. Willis, G. B. (2005). Cognitive interviewing: A tool for improving questionnaire design. Thousand Oaks: Sage.  https://doi.org/10.4135/9781412983655.CrossRefGoogle Scholar
  34. Willis, G. B. (2016). Questionnaire pretesting. In C. Wolf (Ed.), The Sage handbook of survey methodology (pp. 359–381). SAGE Publications.  https://doi.org/10.4135/9781473957893.
  35. Woolley, M. E., Bowen, G. L., & Bowen, N. K. (2004). Cognitive pretesting and the developmental validity of child self-report instruments: Theory and applications. Research on Social Work Practice, 14(3), 191–200.CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Renata Franc
    • 1
  • Ines Sučić
    • 1
  • Toni Babarović
    • 1
  • Andreja Brajša-Žganec
    • 1
  • Ljiljana Kaliterna-Lipovčan
    • 1
  • Ivan Dević
    • 1
  1. 1.Ivo Pilar Institute of Social SciencesZagrebCroatia

Personalised recommendations