How to Develop Well-Being Survey Questions for Young Children: Lessons Learned from Cross-Cultural Cognitive Interviews
There are several major challenges related to conducting cross-cultural well-being surveys, which are even more pronounced when respondents are young children. In order to explore how young children from different countries understand, interpret and process well-being survey questions, within the MYWeB project, the cognitive interviews (CI) study was conducted with young children in six European countries. The specific research objective was to test new/adapted measures of well-being, and the CI testing was focused on comprehension and appropriateness of items and exact wording, recall and judgement in the given time frames, and the given response format among young children. The CI study was conducted in three consecutive rounds, in total, 77 seven year-olds and 118 eight year-olds (N = 195) were interviewed by 26 interviewers. The chapter discuss the main findings and presents general recommendations on how to develop and conduct a well-being survey that is age-appropriate for young children.
KeywordsSurvey design Young children Cognitive interviews Response scales Time frames
- Borgers, N., & Hox, J. (2001). Item nonresponse in questionnaire research with children. Journal of Official Statistics, 17(2), 321.Google Scholar
- Cummins, R. A., & Lau, A. D. L. (2005). Personal well-being index: School children (PWI-SC) (3rd ed.). Melbourne: Deakin University.Google Scholar
- Fitzgerald, R., Widdop, S., Gray, M., & Collins, D. (2009). Testing for equivalence using cross-national cognitive interviewing. In Centre for comparative social surveys working paper series. London: City University London, Centre for Comparative Social Surveys. https://www.city.ac.uk/__data/assets/pdf_file/0014/125132/CCSS-Working-Paper-No-01.pdf. Accessed 30 Sept 2016.Google Scholar
- Harkness, J. (2003). Questionnaire translation. In J. A. Harkness, F. J. R. van de Vijver, & P. P. Mohler (Eds.), Cross-cultural survey methods. New York: Wiley.Google Scholar
- Irwin, D. E., Varni, J. W., Yeatts, K., & De Walt, D. A. (2009). Cognitive interviewing methodology in the development of a pediatric item bank: A patient reported outcomes measurement information system (PROMIS) study. Health and Quality of Life Outcomes, 7(3), 1–10. https://doi.org/10.1186/1477-7525-7-3.Google Scholar
- Lippman, L., Guzman, L., & Anderson Moore, K. (2012). Measuring flourishing among youth findings from the flourishing children positive indicators project. Washington, DC: Child Trends. https://www.childtrends.org/wp-content/uploads/2013/05/FlourishingChildren.pdf. Accessed 15 Dec 2017.Google Scholar
- Miller, K., & Willis, G. (2016). Cognitive models of answering processes. In C. Wolf (Ed.), The Sage handbook of survey methodology (pp. 210–217). SAGE Publications. https://doi.org/10.4135/9781473957893.
- Olweus, D. (1996). Bullying at school: Knowledge base and an effective intervention program. New York: Wiley.Google Scholar
- Ravens-Sieberer, U., Herdman, M., Devine, J., Otto, C., Bullinger, M., Rose, M., & Klasen, F. (2014a). The European KIDSCREEN approach to measure quality of life and well-being in children: Development, current application, and future advances. Quality of Life Research, 23(3), 791.CrossRefGoogle Scholar
- Rees, G., & Bradshaw, J. (2016). Children’s views on their lives and well-being in 16 countries: A report on the children’s worlds survey of children aged eight years old, 2013–15 Jacobs Foundation. http://eprints.whiterose.ac.uk/95207/1/8yearsoldreport.pdf. Accessed 15 Dec 2017.
- Richardson, D., & Ali, N. (2014). An Evaluation of international surveys of children (OECD Social, Employment and Migration Working Papers, No. 146). OECD Publishing. https://doi.org/10.1787/5jxzmjrqvntf-en. Accessed 15 Dec 2017.
- Scott, J. (2000). Children as respondents: The challenge for quantitative methods. In P. Christensen & A. James (Eds.), Research with children: Perspectives and practices (pp. 98–119). London: Falmer Press.Google Scholar
- Serracant, P., Franc, R., & Ozan, J. (2015). Deliverable 6.1 WP6 Pilot Research design and methodology. FP7 MYWeB (Measuring Youth Well Being).Google Scholar
- Smyth, J. D. (2016). Designing questions and questionnaires. In C. Wolf, D. E. Joye, T. W. Smith, & Y. Fu (Eds.), The Sage handbook of survey methodology (pp. 218–235). SAGE Publications. https://doi.org/10.4135/9781473957893.
- Tourangeau, R. (1984). Cognitive science and survey methods: A cognitive perspective. In T. Jabine, M. Straf, J. Tanur, & R. Tourangeau (Eds.), Cognitive aspects of survey methodology: Building a bridge between disciplines. Washington, DC: National Academy Press.Google Scholar
- Tourangeau, R., Rips, L. J., & Rasinski, K. (2000). The psychology of survey response. Cambridge University Press.Google Scholar
- Varni, J. W., Limbers, C. A., & Burwinkle, T. M. (2007). Parent proxy-report of their children’s health-related quality of life: An analysis of 13,878 parents’ reliability and validity across age subgroups using the PedsQL (TM) 4.0 Generic Core Scales. Health Quality Life Outcomes, 5(2). https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1769359/.) Accessed 30 Sept 2016.
- Willis, G. B. (2016). Questionnaire pretesting. In C. Wolf (Ed.), The Sage handbook of survey methodology (pp. 359–381). SAGE Publications. https://doi.org/10.4135/9781473957893.