Measuring Lexical Facility: The Timed Yes/No Test

  • Michael Harrington


This chapter describes the Timed Yes/No Test, the online assessment tool used to measure lexical facility in the studies reported in Part 2. It also describes test characteristics and features, and discusses challenges in measuring vocabulary size and processing skill in a single measure.


Vocabulary Size Online Assessment Tool Pseudowords Mean Recognition Time Vocabulary Knowledge 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. Akamatsu, N. (2008). The effects of training on automatization of word recognition in English as a foreign language. Applied Psycholinguistics, 29(02), 175–193. doi: 10.1017/S0142716408080089.CrossRefGoogle Scholar
  2. Anderson, R. C., & Freebody, P. (1981). Vocabulary knowledge. In J. T. Guthie (Ed.), Comprehension and teaching: Research reviews (pp. 77–117). Newark: International Reading Association.Google Scholar
  3. Anderson, R. C., & Freebody, P. (1983). Reading comprehension and the assessment and acquisition of word knowledge. In B. Huston (Ed.), Advances in reading/language research (Vol. 2, pp. 231–256). Greenwich: JAI Press.Google Scholar
  4. Beeckmans, R., Eyckmans, J., Janssens, V., Dufranne, M., & Van de Velde, H. (2001). Examining the yes/no vocabulary test: Some methodological issues in theory and practice. Language Testing, 18(3), 235–274.CrossRefGoogle Scholar
  5. Cameron, L. (2002). Measuring vocabulary size in English as an additional language. Language Teaching Research, 6(2), 145–173.CrossRefGoogle Scholar
  6. Davies, M. (2008). The corpus of contemporary American English: 450 million, 1990–present. Available online at
  7. Eyckmans, J. (2004). Learners’ response behavior in Yes/No vocabulary tests. In H. Daller, M. Milton, & J. Treffers-Daller (Eds.), Modelling and assessing vocabulary knowledge (pp. 59–76). Cambridge: Cambridge University Press.Google Scholar
  8. Fender, M. (2008). Spelling knowledge and reading development: Insights from Arab ESL learners. Reading in a Foreign Language, 20(1), 19–42.Google Scholar
  9. Green, D., & Swets, J. A. (1966). Signal detection theory and psychophysics. New York: Wiley.Google Scholar
  10. Harsch, C., & Hartig, J. (2015). Comparing C-tests and yes/no vocabulary size tests as predictors of receptive language skills. Language Testing, 33(4), 555–575.CrossRefGoogle Scholar
  11. Heitz, R. P. (2014). The speed-accuracy tradeoff: History, physiology, methodology, and behavior. Frontiers in Neuroscience, 8, 150.CrossRefGoogle Scholar
  12. Huibregtse, I., Admiraal, W., & Meara, P. (2002). Scores on a yes-no vocabulary test: Correction for guessing and response style. Language Testing, 19(3), 227–245.CrossRefGoogle Scholar
  13. Jiang, N. (2013). Conducting reaction time research in second language studies. London/New York: Routledge.Google Scholar
  14. Keuleers, E., & Brysbaert, M. (2010). Wuggy: A multilingual pseudoword generator. Behavior Research Methods, 42(3), 627–633. doi: 10.3758/BRM.42.3.627.CrossRefGoogle Scholar
  15. Koda, K. (2005). Insights into second language reading: A cross-linguistic approach. New York: Cambridge University Press.CrossRefGoogle Scholar
  16. Leech, G., Rayson, P., & Wilson, A. (2001). Word frequencies in spoken and written English. London: Longman.Google Scholar
  17. Luce, R. D. (1986). Response times. New York: Oxford University Press.Google Scholar
  18. McCarthy, M. (1998). Spoken language and applied linguistics. Cambridge: Cambridge University Press.Google Scholar
  19. Meara, P. (1989). Matrix models of vocabulary acquisition. AILA Review, 6, 66–74.Google Scholar
  20. Meara, P. (1996). The dimensions of lexical competence. In G. Brown, K. Malmkjaer, & J. Williams (Eds.), Performance and competence in second language acquisition (pp. 35–53). Cambridge: Cambridge University Press.Google Scholar
  21. Meara, P., & Buxton, B. (1987). An alternative to multiple choice vocabulary tests. Language Testing, 4(2), 142–145.CrossRefGoogle Scholar
  22. Meara, P. M., & Miralpeix, I. (2006). Y_Lex: The Swansea advanced vocabulary levels test. v2.05. Swansea: Lognostics.Google Scholar
  23. Mochida, A., & Harrington, M. (2006). The yes-no test as a measure of receptive vocabulary knowledge. Language Testing, 26(1), 73–98. doi: 10.1191/0265532206lt321oa.CrossRefGoogle Scholar
  24. Moses, T. (2013). Alternative smoothing and scaling strategies for weighted composite scores. Educational and Psychological Measurement, 74(3), 516–536.CrossRefGoogle Scholar
  25. Norris, D. (2013). Models of visual word recognition. Trends in Cognitive Sciences, 17(1), 517–524. doi: 10.1016/j.tics.2013.08.003.CrossRefGoogle Scholar
  26. Pellicer-Sánchez, A., & Schmitt, S. (2012). Scoring yes-no vocabulary tests: Reaction time vs. nonword approaches. Language Testing, 29(4), 489–509. doi: 10.1177/0265532212438053.CrossRefGoogle Scholar
  27. Read, J. (2000). Assessing vocabulary. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
  28. Sawaki, Y. (2007). Construct validation of analytic rating scales in a speaking assessment: Reporting a score profile and a composite. Language Testing, 24(3), 355–390. doi: 10.1177/0265532207077205.CrossRefGoogle Scholar
  29. Segalowitz, N., & Segalowitz, S. J. (1993). Skilled performance, practice and differentiation of speed-up from automatization effects: Evidence from second language word recognition. Applied PsychoLinguistics, 14(3), 369–385. doi: 10.1017/S0142716400010845.CrossRefGoogle Scholar
  30. Segalowitz, N., Watson, V., & Segalowitz, S. J. (1995). Vocabulary skill: Single case assessment of automaticity of word recognition in a timed lexical decision task. Second Language Research, 11(2), 121–136.CrossRefGoogle Scholar
  31. Segalowitz, N., Segalowitz, S. J., & Wood, A. G. (1998). Assessing the development of automaticity in second language word recognition. Applied PsychoLinguistics, 19(1), 53–67.CrossRefGoogle Scholar
  32. Siakaluk, P. D., Buchanan, L., & Westbury, C. (2003). The effect of semantic distance in yes/no and go/no-go semantic categorization tasks. Memory & Cognition, 31(1), 100–113.CrossRefGoogle Scholar
  33. Sternberg, S. (1998). Inferring mental operations from reaction time data: How we compare objects. In D. N. Osherson, D. Scarborough, & S. Sternberg (Eds.), An invitation to cognitive science, Methods, models, and conceptual issues (Vol. 4, pp. 436–440). Cambridge, MA: MIT Press.Google Scholar
  34. Thoma, D. (2009). Strategic attention in language testing. Metacognition in yes/no business English vocabulary test. Frankfurt: Peter Lang.Google Scholar
  35. Waters, G. S., & Caplan, D. (2003). The reliability and stability of verbal working memory measures. Behavior Research Methods, Instruments, and Computers, 35(4), 550–564. doi: 10.3758/BF03195534.CrossRefGoogle Scholar

Copyright information

© The Author(s) 2018

Authors and Affiliations

  • Michael Harrington
    • 1
  1. 1.University of QueenslandBrisbaneAustralia

Personalised recommendations