Abstract
Interaction analysis of question–answer sequences from a telephone survey shows that so-called mismatch answers, i.e. answers that do not correspond to the required answering format, are the most frequently occurring problematic verbal behavior. They also are likely to trigger suggestive interviewer probing. Explanations for the occurrence of mismatch answers concern cognitive and conversational factors. In both a non-experimental and an experimental study it was found that questions with formal response alternatives yield more mismatch answers than questions with colloquial response alternatives (i.e., words that are frequently used in ordinary conversations). Effects of the wording of questions were only found in the non-experimental study, indicating that formal question wording yields fewer mismatch answers than colloquial question wording. The findings suggest that, especially in case of questions that are formulated as agree–disagree opinion assertions, the chance of mismatch answers is highly reduced when colloquial response alternatives are used.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bernts T. (1991). Leven zonder zorg. Oordelen over risico’s, rechtvaardigheid en solidariteit in de gezondheidszorg. Swets en Zeitlinger, Amsterdam
Brennan S.E. and Clark H.H. (1996). Conceptual pacts and lexical choice in conversation. J. Exp. Psychol.: Learn. Mem. Cogn. 22(6): 1482–1492
Brook, R.H., Ware, J.E., Jr., Davies-Avery, A., Stewart, A.L., Donald, C.A., Rogers, W.H., Williams, K.N., Johnston, S.A.: Overview of adult health status measures fielded in Rand’s Health Insurance Study. Med. Care, 17 (7 Suppl), iii–x, 1–131 (1979)
Burnhan K.P. and Anderson D.R. (2002). Model Selection and Inference: A Practical Information-Theoretic Approach. Springer-Verlag, New York
Cannell C.F., Oksenberg L. and Converse J.M. (1977). Striving for response accuracy: experiments in new interviewing techniques. J. Mark. Res. XIV: 306–315
Dijkstra W. (1999). A new method for studying verbal interactions in survey interviews. J. Off. Stat. 15(1): 67–85
Dijkstra W. and Ongena Y.P. (2006). Question–answer sequences in survey-interviews. Qual. Quant. 40(6): 983–1011
Elchardus, M., Tresignie, C., Derks, A.: Project: het draagvlak van de solidariteit. Deelrapport 3: Levensstijl-en levensloopaansprakelijkheid.: Vakgroep Sociologie, Onderzoeksgroep TOR, Vrije Universiteit Brussel (2002)
ESS: European Social Survey. Available from http://www.europeansocialsurvey.org/ (2007). Cited March 5 2007
Fowler F.J. and Mangione T.W. (1990). Standardized Survey Interviewing: Minimizing Interviewer-Related Error. Sage, Newbury Park, CA
Houtkoop-Steenstra H. (2000). Interaction in the Standardized Survey Interview: The Living Questionnaire. Cambridge University Press, Cambridge
Kempen, K.I.J.M., Brilman, E.I., Heyink, J.W., & Ormel, J.: Het meten van de algemene gezondheidstoestand met de MOS Short-Form General Health Survey (SF-20): een handleiding (p. 32). Groningen: Noordelijk Centrum voor Gezondheidsvraagstukken, Rijksuniversiteit Groningen (1995)
Kriegsman D.M.W. and Deeg D.J.H. (1995). Psychometrische eigenschappen van de Nederlandse versie van de RAND General Health Perception Questionnaire: de Vragenlijst Algemene Gezondheidsbeleving (VAGB) [Psychometric properties of the RAND General Health Perception Questionnaire in The Netherlands]. Tijdschrift Sociale Gezondheidszorg 73(6): 390–398
Krosnick J.A. (1999). Survey research. Annu. Rev. Psychol. 50: 537–567
Landis J.R. and Koch G.G. (1977). The measurement of observer agreement for categorical data. Biometrics 45: 255–268
Ongena, Y.P.: Problematic deviations in question–answer sequences, p. 40. Unpublished manuscript, Vrije Universiteit, Amsterdam (2001)
Ongena Y.P. and Dijkstra W. (2006). Methods of behavior coding of survey interviews. J. Off. Stat. 22(3): 419–451
Oostdijk, N., Goedertier, W., Van Eynde, F., Boves, L., Martens, J.-P., Moortgat, M., Baayen, H.: Experiences from the Spoken Dutch Corpus Project. In: González Rodriguez, M., Paz Suárez Araujo, C. (eds.) Proceedings of the Third International Conference on Language Resources and Evaluation, pp. 340–347 (2002)
Prüfer P. and Rexroth M. (1985). Zur Anwendung der Interaction-Coding-Technik. ZUMA-Nachrichten 17: 2–49
RVD (2003) Belevingsmonitor Rijksoverheid, juni 2003. Den Haag: Rijksvoorlichtingsdienst/Publiek en Communicatie
Schaeffer N.C. and Maynard D.W. (1996). From paradigm to prototype and back again: interactive aspects of cognitive processing in standardized survey interviews. In: Schwarz, N. and Sudman, S. (eds) Answering Questions Methodology for Determining Cognitive and Communicative Processes in Survey Research, pp 65–88. Jossey-Bass, San Francisco
Schuman H. and Presser S. (1981). Questions and Answers in Attitude Surveys: Experiments on Question Form, Wording and Context. Academic Press, New York
Smit J.H. (1995). Suggestieve vragen in survey-interviews. Vó órkomen, oorzaken en gevolgen. Academisch proefschrift, Vrije Universiteit, Amsterdam
Smit E.G. and Neyens P.C. (2000). Segmentation based on Affinity for Advertising. J. Advert. Res. 40: 35–43
Smit J.H. and Dijkstra W. (1997). Suggestive Interviewer Behaviour in Surveys: An Experimental Study. J. Off. Stat. 13(1): 19–28
Snijders T.A.B. and Bosker R.J. (1999). Multilevel Analysis. An introduction to basic and advanced multilevel modeling. Sage publications, London
Jansen R. and Haveman H. (1986). Solidariteitsvoorkeuren ten aanzien van ziektekostenverzekering 1985. Maandbericht gezondheidsstatistiek 5(8): 5–16
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ongena, Y.P., Dijkstra, W. Preventing mismatch answers in standardized survey interviews. Qual Quant 44, 641–659 (2010). https://doi.org/10.1007/s11135-009-9227-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11135-009-9227-x