Abstract
Computer games started to be integrated in the learning process in order to bridge the gap between the new learner generation and the traditional learning process. However, today’s game-based e-learning environments do not provide different types of adaptation, with learners receiving mostly “one size fits all” educational games despite the existing differences between them in terms of learner knowledge, motivation, etc. In this context, game-based e-learning can lead to demotivated learners. Therefore, there is a need for adaptation strategies. In order to make adaptation possible, real-time assessment of the game-play process as well as of the learning process is needed. Since learner motivation plays an important role in both the learning and the gaming process, and can easily change, new techniques for automated assessment of learner motivation are needed. This chapter presents current trends in game-based e-learning assessment in general focusing on the assessment of learner motivation in particular. Methods for gathering information on player/learner motivation are also presented. Information on learner motivation can be gathered (1) through dialog-based interaction, (2) through game-play-based interaction and/or (3) through additional equipment. This chapter also proposes four generic metrics for the measurement and analysis of motivation in game-based e-learning based on metrics that were used in e-learning. Each metric is presented and its usage and interpretation in gaming-based e-learning are discussed.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aleven, V., Myers, E., Easterday, M., & Ogan, A. (2010). Toward a framework for the analysis and design of educational games. In Proceeding of IEEE third international conference on digital game and intelligent toy enhanced learning (pp. 69–76), Los Alamitos, CA.
Arroyo, I., Ferguson, K., Johns, J., Dragon, T., Meheranian, H., Fisher, D., et al. (2007). Repairing disengagement with non-invasive interventions. In R. Luckin, K. R. Koedinger, & J. Greer (Eds.), Proceeding of the 2007 conference on artificial intelligence in education: Building technology rich learning contexts that work (pp. 195–202). Amsterdam, The Netherlands: IOS.
Baker, R. S. J. D., Mitrović, A., & Mathews, M. (2010). Detecting gaming the system in constraint-based tutors. In P. de Bra, A. Kobsa, & D. Chin (Eds.), User modeling, adaptation, and personalization, Proceedings of the 18th international conference, UMAP 2010. Notes in computer science, 6075/2010 (pp. 267–278). Berlin, Germany: Springer.
Bandura, A. (1994). Self-efficacy. In V. S. Ramachaudran (Ed.), Encyclopedia of human behaviour (pp. 71–81). New York, NY: Academic.
Bandura, A. (2006). Guide for constructing self-efficacy scales. In T. Urdan & F. Pojares (Eds.), Self-efficacy beliefs of adolescents (Vol. 5, pp. 307–337). Charlotte: Information Age Publishing.
Bernard, R. R. S., & Cannon, H. M. (2011). Exploring motivation: Using emoticons to map student motivation in a business game exercise. Developments in Business Simulation and Experiential Learning, 38, 229–240.
Bica, F., Verdin, R., & Vicari, R. M. (2006). Towards cognitive modeling of students’ self-efficacy. In Proceedings of 6th international conference on advanced learning technologies, ICALT2006 (pp. 1017–1021). Washington, DC: IEEE Computer Society.
Breuer, J. S., & Bente, G. (2010). Why so serious? On the relation of serious games and learning. Eludamos. Journal for Computer Game Culture, 4(1), 7–24.
Burgos, D., Moreno-Ger, P., Sierra, J. L., Fernández-Manjón, B., Specht, M., & Koper, R. (2008). Building adaptive game-based learning resources: The integration of IMS learning design and. Simulation & Gaming, 39(3), 414–431.
Chang, Y.-C., Chen, K.-T., Wu, C.-C., Ho, C.-J., & Lei, C.-L. (2010). Online game QoE evaluation using paired comparisons. Presented at the 2010 IEEE international workshop technical committee on communications quality and reliability (CQR 2010) (p. 6), Vancouver, BC.
Chen, Z.-H., & Chan, T.-W. (2008). Learning by substitutive competition: Nurturing my-pet for game competition based on open learner model. In Proceedings of the second IEEE international conference on digital games and intelligent (pp. 124–131), Big Island, HI.
Cocea, M., & Weibelzahl, S. (2009). Log file analysis for disengagement detection in e-learning environments. User Modelling and User-Adapted Interaction, 19(4), 341–385.
Cocea, M., & Weibelzahl, S. (2011). Disengagement detection in on-line learning: Validation studies and perspectives. IEEE Transactions on Learning Technologies, 4(2), 114–124.
Conati, C., & Maclaren, H. (2009). Modeling user affect from causes and effects. In G.-J. Houben, G. McCalla, F. Pianesi, & M. Zancanaro (Eds.), Proceedings of the 17th international conference on user modeling, adaptation, and personalization. Lectures notes in computer science (Vol. 5535, pp. 4–15). Berlin, Germany: Springer.
Conlan, O., Hampson, C., Peirce, N., & Kickmeier-Rust, M. (2009). Realtime knowledge space skill assessment for personalized digital educational games. In Proceedings of 2009 ninth IEEE international conference on advanced learning technologies (pp. 538–542), Riga, Latvia.
Connolly, T. M., & Stanfield, M. (2006). Using games-based eLearning technologies in overcoming difficulties in teaching information systems. Journal of Information Technology Education, 5, 459–476.
Connolly, T. M., & Stansfield, M. (2011). From E-learning to games-based E-learning. In Information Resources Management Association, USA (Ed.), Gaming and simulations: Concepts, methodologies, tools and applications (pp. 1763–1773). Hershey, PA: IGI Global.
Connolly, T. M., Stansfield, M., & Hainey, T. (2011). An alternate reality game for language learning: ARGuing for multimodal motivation. Computers & Education, 57(1), 1389–1415.
Costagliola, G., De Rosa, M., Fuccella, V., Capuano, N., & Ritrovato. P. (2010). A novel approach for attention management in e-learning systems. In proceedings of distributed multimedia systems (DMS) (pp. 222–227). Skokie, Illinois, USA: Knowledge Systems Institute, ISBN/ISSN: 1-891706-28-4.
de Freitas, S., & Oliver, M. (2006). How can exploratory learning with games and simulations within the curriculum be most effectively evaluated? Computers and Education, 46(3), 249–264.
de Freitas, S., Rebolledo-Mendez, G., Liarokapis, F., Magoulas, G., & Poulovassilis, A. (2010). Learning as immersive experiences: Using the four-dimensional framework for designing and evaluating immersive learning experiences in a virtual world. British Journal of Educational Technology, 4(1), 69–85.
de Vicente, A. (2003). Towards tutoring systems that detect students’ motivation: An investigation. Ph.D. thesis, University of Edinburg, Edinburg.
de Vicente, A., & Pain, H. (2002). Informing the detection of the students’ motivational state: An empirical study. In S. A. Cerri, G. Gouarderes, & F. Paraguacu (Eds.), Proceedings of the 6th international conference on intelligent tutoring systems (pp. 79–86). London: Springer.
Derbali, L., Chalfoun, P., & Frasson, C. (2011). A theoretical and empirical approach in assessing motivational factors: From serious games to an ITS. In R. C. Murray & P. M. McCarthy (Eds.), Proceedings of the twenty-fourth international Florida artificial intelligence research society conference 2011 (pp. 513–518). Palm Beach, FL: AAAI.
Derbali, L., & Frasson, C. (2010). Prediction of players motivational states using electrophysiological measures during serious game play. In Proceedings of 2010 IEEE 10th international conference on advanced learning technologies (ICALT) (pp. 498–502), Sousse, Tunisia.
Diah, N. M., Ismail, M., Ahmad, S., & Dahari, M. K. M. (2010). Usability testing for educational computer game using observation method. In 2010 international conference on information retrieval & knowledge management (CAMP) (pp. 157–161), Shah Alam, Selangor.
Fu, F.-L., Su, R.-C., & Yu, S.-C. (2009). EGameFlow: A scale to measure learners’ enjoyment of e-learning games. Computers & Education, 52(1), 101–112.
Garris, R., Ahlers, R., & Driskell, J. E. (2002). Games, motivation, and learning: A research and practice model. Simulation & Gaming, 33(4), 441–467.
Gee, J. P., & Shaffer, D. W. (2010). Looking where the light is bad: Video games and the future of assessment. EDge: The Latest Information for the Education Practitioner, 6(1), 1–27.
Ghergulescu, I., & Muntean, C. H. (2010). Assessment of motivation in games based e-learning. In Proceeding of IADIS international conference cognition and exploratory learning in digital age (pp. 71–78), Timisoara, Romania.
Hershkovitz, A., & Nachmias, R. (2008). Developing a log-based motivation measuring tool. Educational Data Mining, 2008(5), 226–233.
Hong, J.-C., Cheng, C.-L., Hwang, M.-Y., Lee, C.-K., & Chang, H.-Y. (2009). Assessing the educational values of digital games. Journal of Computer Assisted Learning, 25(5), 423–437.
Huang, W.-H., Huang, W.-Y., & Tschopp, J. (2010). Sustaining iterative game playing processes in DGBL: The relationship between motivational processing and outcome processing. Computers & Education, 55, 789–797.
Ifenthaler, D., Eseryel, D., & Ge, X. (2011). Origins of game-based assessment. In D. Ifenthaler, D. Eseryel, & X. Ge (Eds.), Assessment in game-based learning: Foundations, innovations, and perspectives. New York: Springer.
IMI. (2008). Retrieved Sept 15 2011, from http://www.psych.rochester.edu/SDT/measures/IMI_description.php.
Johns, J., & Woolf, B. (2006). A dynamic mixture model to detect student motivation and proficiency. In A. Cohn (Ed.), Proceeding of AAAI’06 21st national conference on artificial intelligence (pp. 163–168). Menlo Park, CA: AAAI Press.
Kebritchi, M., Hirumi, A., & Bai, H. (2010). The effects of modern mathematics computer games on mathematics achievement and class motivation. Computers & Education, 55(2), 427–443.
Keller, J. M. (1987). Development and use of the ARCS model of motivational design. Instructional Development, 10, 2–10.
Khan, F. A., Graf, S., Weippl, E. R., & Tjoa, A. M. (2009). An approach for identifying affective states through behavioral patterns in web-based learning management systems. In Proceedings of the 11th international conference on information integration and web-based applications & services, iiWAS’09 (pp. 431–435), Kuala Lumpur.
Khan, F. A., Graf, S., Weippl, E. R., & Tjoa, A. M. (2010). Implementation of affective states and learning styles tactics in web-based learning management systems. In Proceedings of the 2010 10th IEEE international conference on advanced learning technologies (pp. 734–735), Sousse, Tunisia.
Khan, F. A., Weippl, E. R., & Tjoa, A. M. (2009). Integrated approach for the detection of learning styles and affective states. In World conference on educational multimedia, hypermedia and telecommunications (Vol. 1, pp. 753–761) Chesapeake, VA: AACE.
Kim, Y. S., Cha, H. J., Cho, Y. R., Yoon, T. B., & Lee, J.-H. (2007). An intelligent tutoring system with motivation diagnosis and planning. In 15th international conference on computers in education, Hiroshima. Retrieved April 20, 2011, from http://credits.skku.edu/credits/publications/ICCE2007_Poster.pdf
Koidl, K., Mehm, F., Hampson, C., Conlan, O., & Göbel, S. (2010). Dynamically adjusting digital educational games towards learning objectives. In B. Meyer (Ed.), Proceedings 4th European conference on games based learning, Copenhagen, Denmark (pp. 177–185). Reading: Academic.
Kuipers, F., Kooij, R., De Vleeschauwer, D., & Brunnström, K. (2010). Techniques for measuring quality of experience. In Wired/wireless internet communications. Lecture notes in computer science (Vol. 6074, pp. 216–227). Berlin: Springer.
Levac, D., Pierrynowski, M. R., Canestraro, M., Gurr, L., Leonard, L., & Neeley, C. (2010). Exploring children’s movement characteristics during virtual reality video game play. Human Movement Science, 29(6), 1023–1038.
Lin, H.-H., Wang, C.-Y., & Wei, H.-Y. (2010). Improving online game performance over IEEE 802.11n networks. Presented at the 2010 9th annual workshop on network and systems support for games (NetGames) (p. 2), Taipei, Taiwan.
Liu, T.-Y., & Chu, Y.-L. (2010). Using ubiquitous games in an English listening and speaking course: Impact on learning outcomes and motivation. Computers & Education, 55(2), 630–643.
Mattheiss, E., Kickmeier-Rust, M. D., Steiner, C. M., & Albert, D. (2010). Approaches to detect discouraged learners: Assessment of motivation in educational computer games. In S. Hambach, A. Martens, D. Tavangarian, & B. Urban (Eds.), Proceedings of eLearning Baltics (eLBa) (p. 10). Rostock: Fraunhofer.
McQuiggan, S. W., Mott, B. W., & Lester, J. C. (2008). Modeling self-efficacy in intelligent tutoring systems: An inductive approach. User Modeling and User-Adapted Interaction, 18(1–2), 81–123.
McQuiggan, S. W., Robison, J. L., & Lester, J. C. (2010). Affective transitions in narrative-centered learning environments. Educational Technology & Society, 13(1), 40–53.
Miller, L. M., Chang, C.-I., Wang, S., Beier, M. E., & Klisch, Y. (2011). Learning and motivational impacts of a multimedia science game. Computers & Education, 57(1), 1425–1433.
Moreno-Ger, P., Torrente, J., Bustamante, J., Fernández-Galaz, C., Fernández-Manjón, B., & Comas-Rengifo, M. D. (2010). Application of a low-cost web-based simulation to improve students’ practical skills in medical education. International Journal of Medical Informatics, 79(6), 459–467.
Muñoz, K., Kevitt, P. M., Lunney, T., Noguez, J., & Neri, L. (2011). An emotional student model for game-play adaptation. Entertainment Computing, 2(2), 133–141.
Munoz-Organero, M., Munoz-Merino, P. J., & Kloos, C. D. (2010). Student behavior and interaction patterns with an LMS as motivation predictors in E-learning settings. IEEE Transactions on Education, 53(3), 463–470.
Papastergiou, M. (2009). Exploring the potential of computer and video games for health and physical education: A literature review. Computers & Education, 53, 603–622.
Prensky, M. (2001). The digital game-based learning revolution. In M. Prensky (Ed.), Digital game-based learning (1st ed.). New York: McGraw-Hill.
Qu, L., Wang, N., & Johnson, W. L. (2005). Using learner focus of attention to detect learner motivation factors. In L. Ardissono, P. Brna, A. Mitrovic (Eds.), Proceedings of the 10th international conference, user modelling 2005, Edinburgh, Scotland. Lectures notes in computer science (Vol. 3538, pp. 70–73). Berlin, Germany: Springer.
Rebolledo-Mendez, G., de Freitas, S., Rojano-Caceres, R., & Gaona-Garcia, A. R. (2010). An empirical examination of the relation between attention and motivation in computer-based education: A modeling approach. In H. W. Guesgen & R. C. Murray (Eds.), Proceedings of the twenty-third international Florida artificial intelligence research society conference 2010, Daytona Beach, FL, USA (pp. 74–79). Menlo Park, CA: AAAI.
Renshaw, T., Stevens, R., & Denton, P. (2009). Towards understanding engagement in games: An eye-tracking study. On the Horizon, 17(4), 408–420.
Ryan, R., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American psychologist, 55(1), 68–78.
Sancho, P., & Fernandez-Manjon, B. (2010). Experiences in using a MUVE for enhancing motivation in engineering education. In Proceedings of IEEE EDUCON 2010 conference (pp. 775–782), Madrid, Spain.
Shih, J.-L., Shih, B.-J., Shih, C.-C., Su, H.-Y., & Chuang, C.-W. (2010). The influence of collaboration styles to children’s cognitive performance in digital problem-solving game “William Adventure”: A comparative case study. Computers & Education, 55(3), 982–993.
Shute, V. J. (2009). Simply assessment. International Journal of Learning and Media, 1(2), 1–11.
Shute, V. J., Masduki, I., & Donmez, O. (2010). Conceptual framework for modeling, assessing, and supporting competencies within game environments. Technology, Instruction, Cognition, and Learning, 8(2), 137–161.
Shute, V. J., Ventura, M., Bauer, M., & Zapata-Rivera, D. (2009). Melding the power of serious games and embedded assessment to monitor and foster learning: Flow and grow. In U. Ritterfeld, M. J. Cody, & P. Vorderer (Eds.), Serious games: Mechanisms and effects (pp. 295–321). Mahwah, NJ: Routledge.
Steinkuehler, C., & King, E. (2009). Digital literacies for the disengaged: Creating after school contexts to support boys’ game-based literacy skills. On the Horizon, 17(1), 47–59.
Takatalo, J., Hakkinen, J., Kaistinen, J., & Nyman, G. (2007). Measuring user experience in digital gaming: Theoretical and methodological issues. In L. C. Cui & Y. Miyake (Eds.), Proceedings of SPIE: Image quality and system performance IV (Vol. 6494, pp. 1–13). San Jose, CA: SPIE.
Takatalo, J., Häkkinen, J., Kaistinen, J., & Nyman, G. (2010). Presence, involvement, and flow in digital games. In R. Bernhaupt (Ed.), Evaluating user experience in games (pp. 23–46). London: Springer.
Takatalo, J., Häkkinen, J., Kaistinen, J., & Nyman, G. (2011). User experience in digital games: Differences between laboratory and home. Simulation & Gaming, 42, 656–673.
Tang, S., Hanneghan, M., & El Rhalibi, A. (2009). Introduction to games-based learning. In T. Connolly, M. Stansfield, & L. Boyle (Eds.), Games-based learning advancements for multi-sensory human computer interfaces (pp. 1–17). Hershey, PA: IGI Global.
Tüzün, H., YIlmaz-Soylu, M., Karakus, T., Inal, Y., & KIzIlkaya, G. (2009). The effects of computer games on primary school students’ achievement and motivation in geography learning. Computers & Education, 52(1), 68–77.
Vos, N., van der Meijden, H., & Denessen, E. (2011). Effects of constructing versus playing an educational game on student motivation and deep learning strategy use. Computers & Education, 56(1), 127–137.
Wilson, K. A., Bedwell, W. L., Lazzara, E. H., Salas, E., Burke, C. S., Estock, J. L., et al. (2009). Relationships between game attributes and learning outcomes. Simulation & Gaming, 40(2), 217–266.
Woolf, B. P., Arroyo, I., Muldner, K., Burleson, W., Cooper, D. G., Dolan, R., et al. (2010). The effect of motivational learning companions on low achieving students and students with disabilities. In V. Aleven, J. Kay, & J. Mostow (Eds.), Proceeding of intelligent tutoring systems (pp. 327–337). Berlin: Springer.
Yue, W. S., & Zin, N. A. M. (2009). Usability evaluation for history educational games. In Proceedings of the 2nd international conference on interaction sciences: Information technology, culture and human, ICIS’09, Busan, Korea (pp. 1019–1025). New York, NY: ACM.
Acknowledgement
This research work is supported by IRCSET Embark Postgraduate Scholarship Scheme, Ireland.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer Science+Business Media New York
About this chapter
Cite this chapter
Ghergulescu, I., Muntean, C.H. (2012). Measurement and Analysis of Learner’s Motivation in Game-Based E-Learning. In: Ifenthaler, D., Eseryel, D., Ge, X. (eds) Assessment in Game-Based Learning. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-3546-4_18
Download citation
DOI: https://doi.org/10.1007/978-1-4614-3546-4_18
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-3545-7
Online ISBN: 978-1-4614-3546-4
eBook Packages: Humanities, Social Sciences and LawEducation (R0)