Advertisement

eAssessment for 21st Century Learning and Skills

  • Christine Redecker
  • Yves Punie
  • Anusca Ferrari
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7563)

Abstract

In the past, eAssessment focused on increasing the efficiency and effectiveness of test administration; improving the validity and reliability of test scores; and making a greater range of test formats susceptible to automatic scoring. Despite the variety of computer-enhanced test formats, eAssessment strategies have been firmly grounded in a traditional paradigm, based on the explicit testing of knowledge. There is a growing awareness that this approach is less suited to capturing “Key Competences” and “21st century skills”. Based on a review of the literature, this paper argues that, though there are still technological challenges, the more pressing task is to transcend the testing paradigm and conceptually develop (e)Assessment strategies that foster the development of 21st century skills.

Keywords

eAssessment Computer-Based Assessment (CBA) competencebased assessment key competences 21st century skills 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Ferrari, A., Cachia, R., Punie, Y.: Innovation and Creativity in Education and Training in the EU Member States: Fostering Creative Learning and Supporting Innovative Teaching. In: JRC-IPTS (2009)Google Scholar
  2. 2.
    NACCCE: All Our Futures: Creativity, Culture and Education (1999)Google Scholar
  3. 3.
    Ellis, S., Barrs, M.: The Assessment of Creative Learning. In: Sefton-Green, J. (ed.) Creative Learning, pp. 73–89. Creative Partnerships, London (2008)Google Scholar
  4. 4.
    Cachia, R., Ferrari, A., Ala-Mutka, K., Punie, Y.: Creative Learning and Innovative Teaching: Final Report on the Study on Creativity and Innovation in Education in EU Member States. In: JRC-IPTS (2010)Google Scholar
  5. 5.
    Redecker, C., Leis, M., Leendertse, M., Punie, Y., Gijsbers, G., Kirschner, P., Stoyanov, S., Hoogveld, B.: The Future of Learning: Preparing for Change. In: JRC-IPTS (2010)Google Scholar
  6. 6.
    Binkley, M., Erstad, O., Herman, J., Raizen, S., Ripley, M., Rumble, M.: Defining 21st Century Skills. In: Griffin, P., McGaw, B., Care, E. (eds.) Assessment and Teaching of 21st Century Skills, pp. 17–66. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  7. 7.
    Council of the European Union: Recommendation of the European Parliament and the Council of 18 December 2006 on key competences for lifelong learning. (2006/962/EC). Official Journal of the European Union, L394/10 (2006)Google Scholar
  8. 8.
    Bunderson, V.C., Inouye, D.K., Olsen, J.B.: The four generations of computerized educational measurement. In: Linn, R.L. (ed.) Educational Measurement, pp. 367–407. Macmillan, New York (1989)Google Scholar
  9. 9.
    Martin, R.: New possibilities and challenges for assessment through the use of technology. In: Scheuermann, F., Pereira, A.G. (eds.) Towards a Research Agenda on Computer-Based Assessment. Office for Official Publications of the European Communities, Luxembourg (2008)Google Scholar
  10. 10.
    Bennett, R.E.: Technology for Large-Scale Assessment. In: Peterson, P., Baker, E., McGaw, B. (eds.) International Encyclopedia of Education, vol. 8, pp. 48–55. Elsevier, Oxford (2010)CrossRefGoogle Scholar
  11. 11.
    Johnson, L., Smith, R., Willis, H., Levine, A., Haywood, K.: The 2011 Horizon Report. The New Media Consortium (2011)Google Scholar
  12. 12.
    Pellegrino, J.W.: Technology and Learning - Assessment. In: Peterson, P., Baker, E., McGaw, B. (eds.) International Encyclopedia of Education, vol. 8, pp. 42–47. Elsevier, Oxford (2010)CrossRefGoogle Scholar
  13. 13.
    El-Alfy, E.S.M., Abdel-Aal, R.E.: Construction and analysis of educational tests using abductive machine learning. Computers and Education 51, 1–16 (2008)CrossRefGoogle Scholar
  14. 14.
    Csapó, B., Ainley, J., Bennett, R., Latour, T., Law, N.: Technological Issues for Computer-Based Assessment. The University of Melbourne, Australia (2010)Google Scholar
  15. 15.
    Moe, E.: Introducing Large-scale Computerised Assessment Lessons Learned and Future Challenges. In: Scheuermann, F., Björnsson, J. (eds.) The Transition to Computer-Based Assessment. Office for Official Publications of the European Communities, Luxembourg (2009)Google Scholar
  16. 16.
    Thompson, N.A., Weiss, D.J.: Computerized and Adaptive Testing in Educational Assessment. In: Scheuermann, F., Björnsson, J. (eds.) The Transition to Computer-Based Assessment. Office for Official Publications of the European Communities, Luxembourg (2009)Google Scholar
  17. 17.
    Bridgeman, B.: Experiences from Large-Scale Computer-Based Testing in the USA. In: Scheuermann, F., Björnsson, J. (eds.) The Transition to Computer-Based Assessment. Office for Official Publications of the European Communities, Luxembourg (2009)Google Scholar
  18. 18.
    Eggen, T.J.H.M., Straetmans, G.J.J.M.: Computerized Adaptive Testing of Arithmetic at the Entrance of Primary School Teacher Training College. In: Scheuermann, F., Björnsson, J. (eds.) The Transition to Computer-Based Assessment. Office for Official Publications of the European Communities, Luxembourg (2009)Google Scholar
  19. 19.
    Wandall, J.: National Tests in Denmark – CAT as a Pedagogic Tool. In: Scheuermann, F., Björnsson, J. (eds.) The Transition to Computer-Based Assessment. Office for Official Publications of the European Communities, Luxembourg (2009)Google Scholar
  20. 20.
    Ripley, M.: Transformational Computer-based Testing. In: Scheuermann, F., Björnsson, J. (eds.) The Transition to Computer-Based Assessment. Office for Official Publications of the European Communities, Luxembourg (2009)Google Scholar
  21. 21.
    Garrett, N., Thoms, B., Alrushiedat, N., Ryan, T.: Social ePortfolios as the new course management system. On the Horizon 17, 197–207 (2009)CrossRefGoogle Scholar
  22. 22.
    Park, J.: Constructive multiple-choice testing system. British Journal of Educational Technology 41, 1054–1064 (2010)CrossRefGoogle Scholar
  23. 23.
    Hardré, P.L., Crowson, H.M., Xie, K., Ly, C.: Testing differential effects of computer-based, web-based and paper-based administration of questionnaire research instruments. British Journal of Educational Technology 38, 5–22 (2007)CrossRefGoogle Scholar
  24. 24.
    Horkay, N., Bennett, R.E., Allen, N., Kaplan, B., Yan, F.: Does it Matter if I Take My Writing Test on Computer? An Empirical Study of Mode Effects in NAEP. Journal of Technology, Learning, and Assessment 5 (2006)Google Scholar
  25. 25.
    Frey, A., Seitz, N.N.: Multidimensional adaptive testing in educational and psychological measurement: Current state and future challenges. Studies in Educational Evaluation 35, 89–94 (2009)CrossRefGoogle Scholar
  26. 26.
    Hartig, J., Höhler, J.: Multidimensional IRT models for the assessment of competencies. Studies in Educational Evaluation 35, 57–63 (2009)CrossRefGoogle Scholar
  27. 27.
    Noorbehbahani, F., Kardan, A.A.: The automatic assessment of free text answers using a modified BLEU algorithm. Computers and Education 56, 337–345 (2011)CrossRefGoogle Scholar
  28. 28.
    He, Y., Hui, S.C., Quan, T.T.: Automatic summary assessment for intelligent tutoring systems. Computers and Education 53, 890–899 (2009)CrossRefGoogle Scholar
  29. 29.
    Weigle, S.C.: Validation of automated scores of TOEFL iBT tasks against non-test indicators of writing ability. Language Testing 27, 335–353 (2010)CrossRefGoogle Scholar
  30. 30.
    Amelung, M., Krieger, K., Rösner, D.: E-assessment as a service. IEEE Transactions on Learning Technologies 4, 162–174 (2011)CrossRefGoogle Scholar
  31. 31.
    Butcher, P.G., Jordan, S.E.: A comparison of human and computer marking of short free-text student responses. Computers and Education 55, 489–499 (2010)CrossRefGoogle Scholar
  32. 32.
    Ben-Simon, A., Bennett, R.E.: Toward a more substantively meaningful automated essay scoring. Journal of of Technology, Learning and Assessment 6 (2007)Google Scholar
  33. 33.
    Hutchison, D.: An evaluation of computerised essay marking for national curriculum assessment in the UK for 11-year-olds. British Journal of Educational Technology 38, 977–989 (2007)CrossRefGoogle Scholar
  34. 34.
    Jordan, S., Mitchell, T.: e-Assessment for learning? The potential of short-answer free-text questions with tailored feedback. British Journal of Educational Technology 40, 371–385 (2009)CrossRefGoogle Scholar
  35. 35.
    Florián, B.E., Baldiris, S.M., Fabregat, R., De La Hoz Manotas, A.: A set of software tools to build an author assessment package on Moodle: Implementing the AEEA proposal. In: 10th IEEE International Conference on Advanced Learning Technologies, ICALT, pp. 67–69 (2010)Google Scholar
  36. 36.
    Ridgway, J., McCusker, S.: Challenges for Research in e-Assessment. In: Scheuermann, F., Pereira, A.G. (eds.) Towards a Research Agenda on Computer-Based Assessment. Office for Official Publications of the European Communities, Luxembourg (2008)Google Scholar
  37. 37.
    Nunan, D.: Technology Supports for Second Language Learning. In: International Encyclopedia of Education, vol. 8, pp. 204–209. Elsevier, Oxford (2010)CrossRefGoogle Scholar
  38. 38.
    Ljungdahl, L., Prescott, A.: Teachers’ use of diagnostic testing to enhance students’ literacy and numeracy learning. International Journal of Learning 16, 461–476 (2009)Google Scholar
  39. 39.
    Looney, J.: Making it Happen: Formative Assessment and Educational Technologies. Promethean Thinking Deeper Research Papers 1 (2010)Google Scholar
  40. 40.
    Huang, C.J., Wang, Y.W., Huang, T.H., Chen, Y.C., Chen, H.M., Chang, S.C.: Performance evaluation of an online argumentation learning assistance agent. Computers and Education 57, 1270–1280 (2011)CrossRefGoogle Scholar
  41. 41.
    Olney, A.M.: GnuTutor: An open source intelligent tutoring system based on AutoTutor. Cognitive and Metacognitive Educational Systems: Papers from the AAAI Fall Symposium FS-09-02, 70–75 (2009)Google Scholar
  42. 42.
    Graesser, A.: Autotutor and the world of pedagogical agents: Intelligent tutoring systems with natural language dialogue. In: 22nd International Florida Artificial Intelligence Research Society Conference, FLAIRS-22, vol. 3 (2009)Google Scholar
  43. 43.
    D’Mello, S., Craig, S., Fike, K., Graesser, A.: Responding to Learners’ Cognitive-Affective States with Supportive and Shakeup Dialogues. In: Jacko, J.A. (ed.) HCI International 2009, Part III. LNCS, vol. 5612, pp. 595–604. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  44. 44.
    Ritter, S., Anderson, J.R., Koedinger, K.R., Corbett, A.: Cognitive tutor: Applied research in mathematics education. Psychonomic Bulletin and Review 14, 249–255 (2007)CrossRefGoogle Scholar
  45. 45.
    Graff, M., Mayer, P., Lebens, M.: Evaluating a web based intelligent tutoring system for mathematics at German lower secondary schools. Education and Information Technologies 13, 221–230 (2008)CrossRefGoogle Scholar
  46. 46.
    Means, B., Rochelle, J.: An Overview of Technology and Learning. In: Peterson, P., Baker, E., McGaw, B. (eds.) International Encyclopedia of Education, vol. 8, pp. 1–10. Elsevier, Oxford (2010)CrossRefGoogle Scholar
  47. 47.
    DeFrance, N., Khasnabis, D., Palincsar, A.S.: Reading and Technology. In: Peterson, P., Baker, E., McGaw, B. (eds.) International Encyclopedia of Education, vol. 8, pp. 150–157. Elsevier, Oxford (2010)CrossRefGoogle Scholar
  48. 48.
    Duchateau, J., Kong, Y.O., Cleuren, L., Latacz, L., Roelens, J., Samir, A., Demuynck, K., Ghesquière, P., Verhelst, W., Hamme, H.V.: Developing a reading tutor: Design and evaluation of dedicated speech recognition and synthesis modules. Speech Communication 51, 985–994 (2009)CrossRefGoogle Scholar
  49. 49.
    de Jong, T.: Technology Supports for Acquiring Inquiry Skills. In: Peterson, P., Baker, E., McGaw, B. (eds.) International Encyclopedia of Education, vol. 8, pp. 167–171. Elsevier, Oxford (2010)CrossRefGoogle Scholar
  50. 50.
    Barab, S.A., Scott, B., Siyahhan, S., Goldstone, R., Ingram-Goble, A., Zuiker, S.J., Warren, S.: Transformational play as a curricular scaffold: Using videogames to support science education. Journal of Science Education and Technology 18, 305–320 (2009)CrossRefGoogle Scholar
  51. 51.
    Bloomfield, P.R., Livingstone, D.: Multi-modal learning and assessment in Second Life with quizHUD. In: Conference in Games and Virtual Worlds for Serious Applications, pp. 217–218 (2009)Google Scholar
  52. 52.
    Herrenkohl, L.R., Tasker, T., White, B.: Pedagogical practices to support classroom cultures of scientific inquiry. Cognition and Instruction 29, 1–44 (2011)CrossRefGoogle Scholar
  53. 53.
    Delgado, C., Krajcik, J.: Technology and Learning - Supports for Subject Matter Learning. In: Peterson, P., Baker, E., McGaw, B. (eds.) International Encyclopedia of Education, vol. 8, pp. 197–203. Elsevier, Oxford (2010)CrossRefGoogle Scholar
  54. 54.
    Wallace, P., Graesser, A., Millis, K., Halpern, D., Cai, Z., Britt, M.A., Magliano, J., Wiemer, K.: Operation ARIES!: A computerized game for teaching scientific inquiry. Frontiers in Artificial Intelligence and Applications 200, 602–604 (2009)Google Scholar
  55. 55.
    Dede, C.: Technological Support for Acquiring Twenty-First -Century Skills. In: Peterson, P., Baker, E., McGaw, B. (eds.) International Encyclopedia of Education, vol. 8, pp. 158–166. Elsevier, Oxford (2010)CrossRefGoogle Scholar
  56. 56.
    Ripley, M.: Transformational Computer-based Testing. In: Scheuermann, F., Björnsson, J. (eds.) The Transition to Computer-Based Assessment. New Approaches to Skills Assessment and Implications for Large-scale Testing. Office for Official Publications of the European Communities, Luxembourg (2009)Google Scholar
  57. 57.
    MCEECDYA: National Assessment Program. ICT Literacy Years 6 and 10 Report 2008. Ministerial Council for Education, Early Childhood Development and Youth Affairs (MCEECDYA) (2008)Google Scholar
  58. 58.
    Glas, C.A.W., Geerlings, H.: Psychometric aspects of pupil monitoring systems. Studies in Educational Evaluation 35, 83–88 (2009)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Christine Redecker
    • 1
  • Yves Punie
    • 1
  • Anusca Ferrari
    • 1
  1. 1.Institute for Prospective Technological Studies (IPTS)European Commission, Joint Research CentreSevilleSpain

Personalised recommendations