Employing TAPs to Explore Test Takers’ Cognitive Processes

  • Jufang KongEmail author


In this chapter, a contextual and critical review of Think Aloud Protocols (TAPs for short) paradigm is first presented to indicate the appropriateness of using TAPs to satisfy the purpose of the qualitative strand in this study.


  1. Afflerbach, P. P. (1990). The influence of prior knowledge on expert readers’ main idea construction strategies. Reading Research Quarterly, 25(1), 31–46.CrossRefGoogle Scholar
  2. Afflerbach, P. P., & Johnston, P. (1984). On the use of verbal reports in reading research. Journal of Reading Behavior, 16(4), 307–322.CrossRefGoogle Scholar
  3. Alanen, R. (1995). Input enhancement and rule presentation in second language acquisition. In R. Schmidt (Ed.), Attention and awareness in foreign language learning (pp. 259–302). Honolulu: University of Hawaii Press.Google Scholar
  4. Alderson, J. C. (1990a). Testing reading comprehension skills (Part One). Reading in a Foreign Language, 6(2), 425–438.Google Scholar
  5. Alderson, J. C. (1990b). Testing reading comprehension skills (Part Two) Getting students to talk about taking a reading test (A pilot study). Reading in a Foreign Language, 7(1), 465–503.Google Scholar
  6. Anderson, N., Bachman, L., Perkins, K., & Cohen, A. (1991). An exploratory study into the construct validity of a reading comprehension test: triangulation of data sources. Language Testing, 8(1), 41–66.CrossRefGoogle Scholar
  7. Barkaoui, K. (2011). Think-aloud protocols in research on essay rating: An empirical study of their veridicality and reactivity. Language Testing, 28(1), 51–75.CrossRefGoogle Scholar
  8. Block, E. (1986). The comprehension strategies of second language readers. TESOL Quarterly, 20(3), 463–494.CrossRefGoogle Scholar
  9. Bowles, M. A. (2010). The think-aloud controversy in second language research. New York: Routledge.CrossRefGoogle Scholar
  10. Caron, T. A. (1989). Strategies for reading expository prose. In S. E. McCormick, & J. E. Zutell (Eds.), Cognitive and social perspectives for literacy research and instruction. Thirty-eighth yearbook of the national reading conference (pp. 293–300). Chicago: National Reading Conference.Google Scholar
  11. Chi, M. T. H., Bassock, M., Lewis, M. W., Reimann, P., & Glaser, R. (1989). Self-explanations: How students study and use examples in learning to solve problems. Cognitive Science, 13(2), 145–182.CrossRefGoogle Scholar
  12. Cohen, A. D. (1984). On taking language tests: What the students report. Language Testing, 1(1), 70–81.CrossRefGoogle Scholar
  13. Cohen, A. D. (2006). The coming of age of research on test-taking strategies. Language Assessment Quarterly, 3(4), 307–331.CrossRefGoogle Scholar
  14. Cote, N., & Goldman, S. R. (1999). Building representations of informational text: Evidence from children’s think-aloud protocols. In H. V. Oostendor, & S. R. Goldman (Eds.), The construction of mental representations during reading (pp. 169–193). Mahwah: Lawrence Erlbaum Associates.Google Scholar
  15. Crain-Thoreson, C., Lippman, M. Z., & McClendon-Magnuson, D. (1997). Windows on comprehension: Reading comprehension processes as revealed by two think-aloud procedures. Journal of Educational Psychology, 89(4), 579–591.CrossRefGoogle Scholar
  16. Ericsson, K. A., & Simon, H. A. (1980). Verbal reports as data. Psychological Review, 87(3), 215–250.CrossRefGoogle Scholar
  17. Ericsson, K. A., & Simon, H. A. (1984). Protocol analysis: Verbal reports as data. Cambridge: MIT Press.Google Scholar
  18. Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data (Rev ed.). Cambridge: MIT Press.Google Scholar
  19. Fox, M. C., Ericsson, K. A., & Best, R. (2011). Do procedures for verbal reporting of thinking have to be reactive? A meta-analysis and recommendations for best reporting methods. Psychological Bulletin, 137(2), 316–344.CrossRefGoogle Scholar
  20. Garner, R. (1987). Metacognition and reading comprehension. Norwood: Ablex Publishing.Google Scholar
  21. Gass, S. M., & Mackey, A. (2000). Stimulated recall methodology in second language research. Mahwah: Lawrence Erlbaum Associates.Google Scholar
  22. Green, A. (1998). Verbal protocol analysis in language testing research: A handbook. Cambridge: Cambridge University Press.Google Scholar
  23. Hama, M., & Leow, R. P. (2010). Learning without awareness revisited: Extending Williams (2005). Studies in Second Language Acquisition, 32(3), 465–491.CrossRefGoogle Scholar
  24. Hare, V. C. (1981). Readers’ problem identification and problem solving strategies for high- and low-knowledge articles. Journal of Reading Behavior, 13(4), 359–365.CrossRefGoogle Scholar
  25. Hartman, D. K. (1991). The intertextual links of eight able readers using multiple passages: A postmodern/semiotic/cognitive view of meaning making. In J. E. Zutell, & S. E. McCormick (Eds.), Learner factors/teacher factors: Issues in literacy research and instruction (pp. 49–66). Chicago: Literacy Research Association.Google Scholar
  26. Hartman, D. K. (1995). Eight readers reading: The intertextual links of proficient readers reading multiple passages. Reading Research Quarterly, 30(3), 520–561.CrossRefGoogle Scholar
  27. Huey, E. B. (1908). The psychology and pedagogy of reading. Cambridge: MIT Press.Google Scholar
  28. Khalifa, H., & Weir, C. J. (2009). Examining reading: Research and practice in assessing second language reading. Cambridge: Cambridge University Press.Google Scholar
  29. Langer, J. A. (1990). The process of understanding: Reading for literary and informative purposes. Research in the Teaching of English, 24(3), 229–260.Google Scholar
  30. Leighton, J. P. (2004). Avoiding misconception, misuse, and missed opportunities: The collection of verbal reports in educational achievement testing. Educational Measurement: Issues and Practice, 23(4), 6–15.CrossRefGoogle Scholar
  31. Leow, R. P. (1998). Toward operationalizing the process of attention in SLA: Evidence for Tomlin and Villa’s (1994) fine-grained analysis of attention. Applied Psycholinguistics, 19(1), 133–159.CrossRefGoogle Scholar
  32. Leow, R. P. (2000). A study of the role of awareness in foreign language behavior: Aware versus unaware learners. Studies in Second Language Acquisition, 22(4), 557–584.CrossRefGoogle Scholar
  33. Leow, R. P. (2001). Do learners notice enhanced forms while interacting with the L2?: An online and offline study of the role of written input enhancement in L2 reading. Hispania, 84(3), 496–509.CrossRefGoogle Scholar
  34. Leow, R. P., & Morgan-Short, K. (2004). To think aloud or not to think aloud: The issue of reactivity in SLA research methodology. Studies in Second Language Acquisition, 26(1), 35–57.CrossRefGoogle Scholar
  35. Leow, R. P., Hsieh, H. C., & Moreno, N. (2008). Attention to form and meaning revisited. Language Learning, 58(3), 665–695.CrossRefGoogle Scholar
  36. Leow, R. P., Grey, S., Marijuan, S., & Moorman, C. (2014). Concurrent data elicitation procedures, processes, and the early stages of L2 learning: A critical overview. Second Language Research, 30(2), 111–127.CrossRefGoogle Scholar
  37. Lumley, T. (2005). Assessing second language writing: The rater’s perspective. Frankfurt: Peter Lang.Google Scholar
  38. Magliano, J. P., Trabasso, T., & Graesser, A. C. (1999). Strategic processes during comprehension. Journal of Educational Psychology, 91(4), 615–629.CrossRefGoogle Scholar
  39. Mann, S. J. (1982). Verbal reports as data: A focus on retrospection. In S. S. Dingwall, S. Mann, & F. Katamba (Eds.), Methods and problems in doing applied linguistic research (pp. 87–104). Department of Linguistics and Modern English Language, University of Lancaster.Google Scholar
  40. Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). Thousand Oaks: Sage.Google Scholar
  41. Morgan-Short, K., Heil, J., Botero-Moriarty, A., & Ebert, S. (2012). Allocation of attention to second language form and meaning: Issues of think-alouds and depth of processing. Studies in Second Language Acquisition, 34(4), 659–685.CrossRefGoogle Scholar
  42. Myers, S. S. (1991). Performance in reading comprehension—product or process? Educational Review, 43(3), 257–272.CrossRefGoogle Scholar
  43. Nevo, N. (1989). Test-taking strategies on a multiple-choice test of reading comprehension. Language Testing, 6(2), 199–215.CrossRefGoogle Scholar
  44. Nisbett, R. E., & Wilson, T. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84(3), 231–259.CrossRefGoogle Scholar
  45. Olshavsky, J. E. (1977). Reading as problem solving: An investigation of strategies. Reading Research Quarterly, 12(4), 654–674.CrossRefGoogle Scholar
  46. Olson, G. M., Duffy, S. A., & Mack, R. L. (1984). Thinking-out-loud as a method for studying real-time comprehension processes. In D. E. Kieras, & M. A. Just (Eds.), New methods in reading comprehension research (pp. 253–286). Mahwah: Lawrence Erlbaum Associates.Google Scholar
  47. Perkins, K. (1992). The effect of passage and topical structure types on ESL reading comprehension difficulty. Language Testing, 9(2), 163–172.CrossRefGoogle Scholar
  48. Phakiti, A. (2003). A closer look at the relationship of cognitive and metacognitive strategy use to EFL reading achievement test performance. Language Testing, 20(1), 26–56.CrossRefGoogle Scholar
  49. Plakans, L. (2009). The role of reading strategies in integrated L2 writing tasks. Journal of English for Academic Purposes, 8(4), 252–266.CrossRefGoogle Scholar
  50. Pressley, M., & Afflerbach, P. (1995). Verbal protocols of reading: The nature of constructively responsive reading. Hillsdale: Lawrence Erlbaum Associates.Google Scholar
  51. Purpura, J. E. (1999). Learner strategy use and performance on language tests: A structural equation modeling approach. Cambridge: Cambridge University Press.Google Scholar
  52. Qi, D. S., & Lapkin, S. (2001). Exploring the role of noticing in a three-stage second language writing task. Journal of Second Language Writing, 10(4), 277–303.CrossRefGoogle Scholar
  53. Rosa, E. M., & Leow, R. P. (2004). Awareness, different learning conditions, and L2 development. Applied Psycholinguistics, 25(2), 269–292.CrossRefGoogle Scholar
  54. Someren, M. W. V., Barnard, Y. F., & Sandberg, J. A. (1994). The think aloud method: A practical guide to modelling cognitive processes. London: Academic Press.Google Scholar
  55. Sternberg, R. J. (1981). Intelligence as thinking and learning skills. Educational Leadership, 39(1), 18–20.Google Scholar
  56. Thorndike, E. L. (1917). Reading as reasoning: A study of mistakes in paragraph reading. Journal of Educational Psychology, 8(6), 323–332.CrossRefGoogle Scholar
  57. Trabasso, T., & Magliano, J. P. (1996). Conscious understanding during comprehension. Discourse Processes, 21(3), 255–287.CrossRefGoogle Scholar
  58. Waern, Y. (1980). Thinking aloud during reading: A descriptive model and its application. Scandinavian Journal of Psychology, 21(1), 123–132.CrossRefGoogle Scholar
  59. Weir, C. J., Yang, H., & Jin, Y. (2000). An empirical investigation of the componentiality of L2 reading in English for academic purposes. Cambridge: Cambridge University Press.Google Scholar
  60. Whitney, P., Ritchie, B. G., & Clark, M. B. (1991). Working-memory capacity and the use of elaborative inferences in text comprehension. Discourse Processes, 14(2), 133–145.CrossRefGoogle Scholar
  61. Yoshida, M. (2008). Think-aloud protocols and type of reading task: The issue of reactivity in L2 reading research. In M. Bowles, R. Foote, S. Perpinan, & R. Bhatt (Eds.), Selected proceedings of the 2007 second language research forum (pp. 199–209). MA: Cascadilla Proceedings Project.Google Scholar
  62. Zwaan, R. A., & Brown, C. M. (1996). The influence of language proficiency and comprehension skill on situation-model construction. Discourse Processes, 21(3), 289–327.CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Zhejiang Normal UniversityJinhuaChina

Personalised recommendations