Skip to main content

Computer-Assisted Language Testing and Learner Behavior

  • Chapter
  • First Online:
Technology and the Psychology of Second Language Learners and Users

Part of the book series: New Language Learning and Teaching Environments ((NLLTE))

Abstract

This chapter reports on a survey of 304 Japanese university students who completed a range of formative computer-assisted tests while studying in an English as a foreign language (EFL) class. We consider students’ attitudes toward the use of computer-assisted language testing (CALT) for formative assessment tasks and, more importantly, whether automated feedback influenced their behavior and learning. In short, we discovered that students overwhelmingly (77.7%) prefer CALT (opposed to paper-based testing or homework), and if available, students generally retake the tests for revision purposes. The authors hope that this chapter can promote a more effective implementation of CALT for formative assessment, as well as provide practical insights into how language learners are interpreting and acting upon automated feedback.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Bracher, J. (2013). A survey of online teaching by native-speaker English instructors at Japanese universities. The JALT CALL Journal, 9(3), 221–239.

    Article  Google Scholar 

  • Brown, J. D. (2013). Research on computers in language testing: Past, present and future. In M. Thomas, H. Reinders, & M. Warschauer (Eds.), Contemporary computer-assisted language learning (pp. 73–94). London: Bloomsbury Academic.

    Google Scholar 

  • Chapelle, C. A., & Chung, Y. (2010). The promise of NLP and speech processing technologies in language assessment. Language Testing, 27(3), 301–315. https://doi.org/10.1177/0265532210364405

    Article  Google Scholar 

  • Chapelle, C. A., & Douglas, D. (2006). Assessing language through computer technology. Cambridge, UK: Cambridge University Press.

    Book  Google Scholar 

  • Chapelle, C. A., & Voss, E. (2016). 20 years of technology and language assessment in Language Learning & Technology. Language Learning & Technology, 20(2), 116–128. http://dx.doi.org/10125/44464

    Google Scholar 

  • Cote, T. J., & Milliner, B. (2017). Preparing Japanese students’ digital literacy for study-abroad: How much CALL training is needed? The JALT CALL Journal, 13(3), 187–197.

    Article  Google Scholar 

  • Ćukušić, M., GaraÄŤa, Z., & Jadrić, M. (2013). Online self-assessment and students’ success in higher education institutions. Computers & Education, 72, 100–109. https://doi.org/10.1016/j.compedu.2013.10.018

    Article  Google Scholar 

  • Douglas, D., & Hegelheimer, V. (2007). Assessing language using computer technology. Annual Review of Applied Linguistics, 27, 115–132. New York: Cambridge University Press. https://doi.org/10.1017/S0267190508070062

    Article  Google Scholar 

  • Fargeeh, A. I. (2015). EFL student and faculty perceptions of and attitudes towards online testing in the medium of Blackboard: Promises and challenges. The JALT CALL Journal, 11(1), 41–62.

    Article  Google Scholar 

  • Garcia Laborda, J. (2007). On the net: Introducing standardized ESL/EFL exams. Language Learning & Technology, 11(2), 3–9. http://dx.doi.org/10125/44097

    Google Scholar 

  • Gobel, P., & Kano, M. (2014). Mobile natives, Japanese university students’ use of digital technology. In J. B. Son (Ed.), Computer-assisted language learning: Learners, teachers and tools (pp. 21–46). Newcastle upon Tyne: Cambridge Scholars Publishing.

    Google Scholar 

  • Godwin-Jones, R. (2008). Web-writing 2.0: Enabling, documenting, and assessing writing online. Language Learning & Technology, 12(2), 7–13. https://dx.doi.org/10125/44138

    Google Scholar 

  • Kenyon, D. M., & Malabonga, V. (2001). Comparing examinee attitudes towards computer assisted and other oral proficiency assessments. Language Learning & Technology, 5(2), 60–83. https://dx.doi.org/10125/25128

    Google Scholar 

  • Milliner, B., & Cote, T. (2018). Faculty adoption, application, and perceptions of a CMS in a university English language program. In B. Zou & M. Thomas (Eds.), Integrating technology into contemporary language learning and teaching (pp. 161–175). Hershey PA: IGI Global.

    Google Scholar 

  • Murray, A., & Blyth, A. (2011). A survey of Japanese university students’ computer literacy levels. The JALT CALL Journal, 7(3), 307–318.

    Article  Google Scholar 

  • Noijons, J. (1994). Testing computer assisted language testing: Towards a checklist for CALT. CALICO Journal, 12(1), 37–58.

    Article  Google Scholar 

  • Paris, S. H., & Paris, A. H. (2001). Classroom applications of research on self-regulated learning. Educational Psychologist, 36(2), 89–101. https://doi.org/10.1207/S15326985EP3602_4

    Article  Google Scholar 

  • Reinders, H. (2018). Learning analytics for language learning and teaching. The JALT CALL Journal, 14(1), 77–86.

    Article  Google Scholar 

  • Roever, C. (2001). Web-based language testing. Language Learning & Technology, 5(2), 34–37. https://dx.doi.org/10125/25129

    Google Scholar 

  • Rubin, J. (1987). Learner strategies: Theoretical assumptions, research history and typology. In L. Wenden & J. Rubin (Eds.), Learner strategies in language learning (pp. 15–30). Englewood Cliffs, NJ: Prentice-Hall.

    Google Scholar 

  • Suvorov, R., & Hegelheimer, V. (2014). Computer assisted language testing. In J. Kunnan (Ed.), The companion to language assessment (pp. 593–613). Malden MA: Wiley-Blackwell. https://doi.org/10.1002/9781118411360.wbcla083

    Chapter  Google Scholar 

  • Teo, A. (2012). Promoting EFL students’ inferential reading skills through computerized dynamic assessment. Language Learning & Technology, 16(3), 10–20. https://dx.doi.org/10125/44292

  • Vanderkleij, F. M., Eggen, T. J. H. M., Timmers, C. F., & Veldkamp, C. (2011). Effects of feedback in a computer-based assessment for learning. Computers & Education, 58(1), 263–272. https://doi.org/10.1016/j.compedu.2011.07.020

    Article  Google Scholar 

  • Wang, T. (2014). Developing an assessment-centered e-Learning system for improving student learning effectiveness. Computers & Education, 73, 189–203. https://doi.org/10.1016/j.compedu.2013.12.002

    Article  Google Scholar 

  • Ware, P., & Kessler, G. (2013). CALL and digital feedback. In M. Thomas, H. Reinders, & M. Warschauer (Eds.), Contemporary computer-assisted language learning (pp. 323–339). London: Bloomsbury Academic.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Brett Milliner .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 The Author(s)

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Milliner, B., Barr, B. (2020). Computer-Assisted Language Testing and Learner Behavior. In: Freiermuth, M.R., Zarrinabadi, N. (eds) Technology and the Psychology of Second Language Learners and Users. New Language Learning and Teaching Environments. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-030-34212-8_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-34212-8_5

  • Published:

  • Publisher Name: Palgrave Macmillan, Cham

  • Print ISBN: 978-3-030-34211-1

  • Online ISBN: 978-3-030-34212-8

  • eBook Packages: Social SciencesSocial Sciences (R0)

Publish with us

Policies and ethics