Skip to main content
SpringerLink
Log in
Book cover

Investigating the Role of Test Methods in Testing Reading Comprehension pp 95–137Cite as

Employing TAPs to Explore Test Takers’ Cognitive Processes

  • Chapter
  • First Online:

  • 565 Accesses

Abstract

In this chapter, a contextual and critical review of Think Aloud Protocols (TAPs for short) paradigm is first presented to indicate the appropriateness of using TAPs to satisfy the purpose of the qualitative strand in this study.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Nearly all the participants in the current study thought aloud in Chinese, their native language. The original coding demo was in Chinese. For an illustration purpose, it is translated into English.

References

  • Afflerbach, P. P. (1990). The influence of prior knowledge on expert readers’ main idea construction strategies. Reading Research Quarterly, 25(1), 31–46.

    Article  Google Scholar 

  • Afflerbach, P. P., & Johnston, P. (1984). On the use of verbal reports in reading research. Journal of Reading Behavior, 16(4), 307–322.

    Article  Google Scholar 

  • Alanen, R. (1995). Input enhancement and rule presentation in second language acquisition. In R. Schmidt (Ed.), Attention and awareness in foreign language learning (pp. 259–302). Honolulu: University of Hawaii Press.

    Google Scholar 

  • Alderson, J. C. (1990a). Testing reading comprehension skills (Part One). Reading in a Foreign Language, 6(2), 425–438.

    Google Scholar 

  • Alderson, J. C. (1990b). Testing reading comprehension skills (Part Two) Getting students to talk about taking a reading test (A pilot study). Reading in a Foreign Language, 7(1), 465–503.

    Google Scholar 

  • Anderson, N., Bachman, L., Perkins, K., & Cohen, A. (1991). An exploratory study into the construct validity of a reading comprehension test: triangulation of data sources. Language Testing, 8(1), 41–66.

    Article  Google Scholar 

  • Barkaoui, K. (2011). Think-aloud protocols in research on essay rating: An empirical study of their veridicality and reactivity. Language Testing, 28(1), 51–75.

    Article  Google Scholar 

  • Block, E. (1986). The comprehension strategies of second language readers. TESOL Quarterly, 20(3), 463–494.

    Article  Google Scholar 

  • Bowles, M. A. (2010). The think-aloud controversy in second language research. New York: Routledge.

    Book  Google Scholar 

  • Caron, T. A. (1989). Strategies for reading expository prose. In S. E. McCormick, & J. E. Zutell (Eds.), Cognitive and social perspectives for literacy research and instruction. Thirty-eighth yearbook of the national reading conference (pp. 293–300). Chicago: National Reading Conference.

    Google Scholar 

  • Chi, M. T. H., Bassock, M., Lewis, M. W., Reimann, P., & Glaser, R. (1989). Self-explanations: How students study and use examples in learning to solve problems. Cognitive Science, 13(2), 145–182.

    Article  Google Scholar 

  • Cohen, A. D. (1984). On taking language tests: What the students report. Language Testing, 1(1), 70–81.

    Article  Google Scholar 

  • Cohen, A. D. (2006). The coming of age of research on test-taking strategies. Language Assessment Quarterly, 3(4), 307–331.

    Article  Google Scholar 

  • Cote, N., & Goldman, S. R. (1999). Building representations of informational text: Evidence from children’s think-aloud protocols. In H. V. Oostendor, & S. R. Goldman (Eds.), The construction of mental representations during reading (pp. 169–193). Mahwah: Lawrence Erlbaum Associates.

    Google Scholar 

  • Crain-Thoreson, C., Lippman, M. Z., & McClendon-Magnuson, D. (1997). Windows on comprehension: Reading comprehension processes as revealed by two think-aloud procedures. Journal of Educational Psychology, 89(4), 579–591.

    Article  Google Scholar 

  • Ericsson, K. A., & Simon, H. A. (1980). Verbal reports as data. Psychological Review, 87(3), 215–250.

    Article  Google Scholar 

  • Ericsson, K. A., & Simon, H. A. (1984). Protocol analysis: Verbal reports as data. Cambridge: MIT Press.

    Google Scholar 

  • Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data (Rev ed.). Cambridge: MIT Press.

    Google Scholar 

  • Fox, M. C., Ericsson, K. A., & Best, R. (2011). Do procedures for verbal reporting of thinking have to be reactive? A meta-analysis and recommendations for best reporting methods. Psychological Bulletin, 137(2), 316–344.

    Article  Google Scholar 

  • Garner, R. (1987). Metacognition and reading comprehension. Norwood: Ablex Publishing.

    Google Scholar 

  • Gass, S. M., & Mackey, A. (2000). Stimulated recall methodology in second language research. Mahwah: Lawrence Erlbaum Associates.

    Google Scholar 

  • Green, A. (1998). Verbal protocol analysis in language testing research: A handbook. Cambridge: Cambridge University Press.

    Google Scholar 

  • Hama, M., & Leow, R. P. (2010). Learning without awareness revisited: Extending Williams (2005). Studies in Second Language Acquisition, 32(3), 465–491.

    Article  Google Scholar 

  • Hare, V. C. (1981). Readers’ problem identification and problem solving strategies for high- and low-knowledge articles. Journal of Reading Behavior, 13(4), 359–365.

    Article  Google Scholar 

  • Hartman, D. K. (1991). The intertextual links of eight able readers using multiple passages: A postmodern/semiotic/cognitive view of meaning making. In J. E. Zutell, & S. E. McCormick (Eds.), Learner factors/teacher factors: Issues in literacy research and instruction (pp. 49–66). Chicago: Literacy Research Association.

    Google Scholar 

  • Hartman, D. K. (1995). Eight readers reading: The intertextual links of proficient readers reading multiple passages. Reading Research Quarterly, 30(3), 520–561.

    Article  Google Scholar 

  • Huey, E. B. (1908). The psychology and pedagogy of reading. Cambridge: MIT Press.

    Google Scholar 

  • Khalifa, H., & Weir, C. J. (2009). Examining reading: Research and practice in assessing second language reading. Cambridge: Cambridge University Press.

    Google Scholar 

  • Langer, J. A. (1990). The process of understanding: Reading for literary and informative purposes. Research in the Teaching of English, 24(3), 229–260.

    Google Scholar 

  • Leighton, J. P. (2004). Avoiding misconception, misuse, and missed opportunities: The collection of verbal reports in educational achievement testing. Educational Measurement: Issues and Practice, 23(4), 6–15.

    Article  Google Scholar 

  • Leow, R. P. (1998). Toward operationalizing the process of attention in SLA: Evidence for Tomlin and Villa’s (1994) fine-grained analysis of attention. Applied Psycholinguistics, 19(1), 133–159.

    Article  Google Scholar 

  • Leow, R. P. (2000). A study of the role of awareness in foreign language behavior: Aware versus unaware learners. Studies in Second Language Acquisition, 22(4), 557–584.

    Article  Google Scholar 

  • Leow, R. P. (2001). Do learners notice enhanced forms while interacting with the L2?: An online and offline study of the role of written input enhancement in L2 reading. Hispania, 84(3), 496–509.

    Article  Google Scholar 

  • Leow, R. P., & Morgan-Short, K. (2004). To think aloud or not to think aloud: The issue of reactivity in SLA research methodology. Studies in Second Language Acquisition, 26(1), 35–57.

    Article  Google Scholar 

  • Leow, R. P., Hsieh, H. C., & Moreno, N. (2008). Attention to form and meaning revisited. Language Learning, 58(3), 665–695.

    Article  Google Scholar 

  • Leow, R. P., Grey, S., Marijuan, S., & Moorman, C. (2014). Concurrent data elicitation procedures, processes, and the early stages of L2 learning: A critical overview. Second Language Research, 30(2), 111–127.

    Article  Google Scholar 

  • Lumley, T. (2005). Assessing second language writing: The rater’s perspective. Frankfurt: Peter Lang.

    Google Scholar 

  • Magliano, J. P., Trabasso, T., & Graesser, A. C. (1999). Strategic processes during comprehension. Journal of Educational Psychology, 91(4), 615–629.

    Article  Google Scholar 

  • Mann, S. J. (1982). Verbal reports as data: A focus on retrospection. In S. S. Dingwall, S. Mann, & F. Katamba (Eds.), Methods and problems in doing applied linguistic research (pp. 87–104). Department of Linguistics and Modern English Language, University of Lancaster.

    Google Scholar 

  • Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). Thousand Oaks: Sage.

    Google Scholar 

  • Morgan-Short, K., Heil, J., Botero-Moriarty, A., & Ebert, S. (2012). Allocation of attention to second language form and meaning: Issues of think-alouds and depth of processing. Studies in Second Language Acquisition, 34(4), 659–685.

    Article  Google Scholar 

  • Myers, S. S. (1991). Performance in reading comprehension—product or process? Educational Review, 43(3), 257–272.

    Article  Google Scholar 

  • Nevo, N. (1989). Test-taking strategies on a multiple-choice test of reading comprehension. Language Testing, 6(2), 199–215.

    Article  Google Scholar 

  • Nisbett, R. E., & Wilson, T. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84(3), 231–259.

    Article  Google Scholar 

  • Olshavsky, J. E. (1977). Reading as problem solving: An investigation of strategies. Reading Research Quarterly, 12(4), 654–674.

    Article  Google Scholar 

  • Olson, G. M., Duffy, S. A., & Mack, R. L. (1984). Thinking-out-loud as a method for studying real-time comprehension processes. In D. E. Kieras, & M. A. Just (Eds.), New methods in reading comprehension research (pp. 253–286). Mahwah: Lawrence Erlbaum Associates.

    Google Scholar 

  • Perkins, K. (1992). The effect of passage and topical structure types on ESL reading comprehension difficulty. Language Testing, 9(2), 163–172.

    Article  Google Scholar 

  • Phakiti, A. (2003). A closer look at the relationship of cognitive and metacognitive strategy use to EFL reading achievement test performance. Language Testing, 20(1), 26–56.

    Article  Google Scholar 

  • Plakans, L. (2009). The role of reading strategies in integrated L2 writing tasks. Journal of English for Academic Purposes, 8(4), 252–266.

    Article  Google Scholar 

  • Pressley, M., & Afflerbach, P. (1995). Verbal protocols of reading: The nature of constructively responsive reading. Hillsdale: Lawrence Erlbaum Associates.

    Google Scholar 

  • Purpura, J. E. (1999). Learner strategy use and performance on language tests: A structural equation modeling approach. Cambridge: Cambridge University Press.

    Google Scholar 

  • Qi, D. S., & Lapkin, S. (2001). Exploring the role of noticing in a three-stage second language writing task. Journal of Second Language Writing, 10(4), 277–303.

    Article  Google Scholar 

  • Rosa, E. M., & Leow, R. P. (2004). Awareness, different learning conditions, and L2 development. Applied Psycholinguistics, 25(2), 269–292.

    Article  Google Scholar 

  • Someren, M. W. V., Barnard, Y. F., & Sandberg, J. A. (1994). The think aloud method: A practical guide to modelling cognitive processes. London: Academic Press.

    Google Scholar 

  • Sternberg, R. J. (1981). Intelligence as thinking and learning skills. Educational Leadership, 39(1), 18–20.

    Google Scholar 

  • Thorndike, E. L. (1917). Reading as reasoning: A study of mistakes in paragraph reading. Journal of Educational Psychology, 8(6), 323–332.

    Article  Google Scholar 

  • Trabasso, T., & Magliano, J. P. (1996). Conscious understanding during comprehension. Discourse Processes, 21(3), 255–287.

    Article  Google Scholar 

  • Waern, Y. (1980). Thinking aloud during reading: A descriptive model and its application. Scandinavian Journal of Psychology, 21(1), 123–132.

    Article  Google Scholar 

  • Weir, C. J., Yang, H., & Jin, Y. (2000). An empirical investigation of the componentiality of L2 reading in English for academic purposes. Cambridge: Cambridge University Press.

    Google Scholar 

  • Whitney, P., Ritchie, B. G., & Clark, M. B. (1991). Working-memory capacity and the use of elaborative inferences in text comprehension. Discourse Processes, 14(2), 133–145.

    Article  Google Scholar 

  • Yoshida, M. (2008). Think-aloud protocols and type of reading task: The issue of reactivity in L2 reading research. In M. Bowles, R. Foote, S. Perpinan, & R. Bhatt (Eds.), Selected proceedings of the 2007 second language research forum (pp. 199–209). MA: Cascadilla Proceedings Project.

    Google Scholar 

  • Zwaan, R. A., & Brown, C. M. (1996). The influence of language proficiency and comprehension skill on situation-model construction. Discourse Processes, 21(3), 289–327.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Zhejiang Normal University, Jinhua, China

    Jufang Kong

Authors
  1. Jufang Kong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jufang Kong .

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Kong, J. (2019). Employing TAPs to Explore Test Takers’ Cognitive Processes. In: Investigating the Role of Test Methods in Testing Reading Comprehension. Springer, Singapore. https://doi.org/10.1007/978-981-13-7021-2_7

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-7021-2_7

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-7020-5

  • Online ISBN: 978-981-13-7021-2

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics

Search

Navigation