Abstract
Recent developments in serious games allow for in-game adaptations to enhance the learner´s current cognitive, motivational or emotional state. Providing suitable adaptations requires a valid assessment of the psycho-pedagogical constructs the game should adapt to. An explicit assessment, e.g. by questionnaires occurring repeatedly on the screen, would impair the learner´s game flow. Therefore, a non-invasive and implicit assessment procedure is required. In the course of the European research project TARGET, we established an assessment procedure which is based on the interpretation of the learner´s actions in the virtual environment, calledBehavioural Indicators (BIs). A set of 16 BIs has been formulated to assess the learner´s current emotional, motivational and clearness state. In this present work, we describe how these BIs can be validated and focus on the innovative elements of the methodological procedure, the material, experiential considerations and the statistical analysis to be applied in an empirical study.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Csikszentmihalyi, M.: Flow: The psychology of optimal experience. Harper & Collins, New York (1991)
Kopeinik, S., Bedek, M.A., Seitlinger, P.C., Albert, D.: The Artificial Mentor: An assessment based approach to adaptively enhance learning processes in virtual learning environments. In: Proceedings of the 19th International Conference on Computers in Education, pp. 106–110. Asia-Pacific Society for Computers in Education, Chiang Mai (2011)
Bedek, M.A., Seitlinger, P., Kopeinik, S., Albert, D.: Multivariate Assessment of Motivation and Emotion in Digital Educational Games. In: Proceedings of the 5th European Conference on Games-Based Learning, pp. 18–25. ACI, Athens (2011)
Atkinson, J.W.: Motivational determinants of risk-taking behavior. Psychological Review 64(6), 359–372 (1957)
Covington, M.V., Omelich, C.L.: Need achievement revisited: verification of Atkinson’s original 2 x 2 model. In: Spielberger, C.D., Sarason, I.G., Kulcsar, Z., Van Heck, G.L. (eds.) Stress and Emotion: Anxiety, Anger and Curiosity, pp. 85–105. Hemisphere, New York (1991)
Larsen, R.J., Diener, E.: Promises and problems with the circumplex model of emotion. In: Clark, M.S. (ed.) Review of Personality and Social Psychology: Emotion, pp. 25–29. Sage, Newbury Park (1992)
Insko, B.E.: Measuring Presence: Subjective, behavioral and physiological methods. In: Riva, G., Davide, F., Ijsselsteijn, W.A. (eds.) Being There: Concepts, Effects and Measurement of User Presence in Synthetic Environments, pp. 110–118. IOS Press, Amsterdam (2003)
Van Reekum, C.M., Johnstone, T., Banse, R., Etter, A., Wehrle, T., Scherer, K.R.: Psychophysiological responses to appraisal dimensions in a computer game. Cognition and Emotion 18(5), 663–688 (2004)
Cai, H., Lin, Y.: Modeling of operators’ emotion and task performance in a virtual driving environment. International Journal of Human-Computer Studies 69(9), 571–586 (2011)
Lang, P.J.: Behavioral treatment and bio-behavioral assessment: computer applications. In: Sidowski, J.B., Johnson, J.H., Williams, T.A. (eds.) Technology in Mental Health Care Delivery System, pp. 119–137. Ablex, Norwood (1980)
Rheinberg, F., Vollmeyer, R., Burns, B.D.: FAM: Ein Fragebogen zur Er-fassung aktueller Motivation in Lern- und Leistungssituationen. Diagnostica 2, 57–66 (2001)
Peter, C., Herbon, A.: Emotion representation and physiology assignments in digital systems. Interacting with Computers 18, 139–170 (2006)
Lane, R.D., Nadel, L.: Cognitive Neuroscience of Emotion. Oxford University Press, New York (2000)
Mehrabian, A., Russell, J.A.: An approach to environmental psychology. MIT Press, Cambridge (1974)
Bradley, M.M., Lang, P.J.: Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavioral Therapy & Experimental Psychiatry 25, 49–59 (1994)
Sokolowski, K., Schmalt, H.D., Langens, T.A., Puca, R.M.: Assessing Achievement, Affiliation, and Power Motives All at Once: The Multi-Motive Grid (MMG). Journal of Personality Assessment 74, 126–145 (2000)
Ziegler, M., Schmukle, S., Egloff, B., Bühner, M.: Investigating Measures of Achievement Motivation. Journal of Individual Differences 31, 15–21 (2007)
McClelland, D.C.: Biological aspects of human motivation. In: Halisch, F., Kulh, J. (eds.) Motivation, Intention, and Volition, pp. 11–19. Springer, Heidelberg (1987)
Spangler, W.D.: Validity of questionnaire and TAT measures of need for achievement: Two meta-analyses. Psychological Bulletin 112, 140–154 (1992)
Schmalt, H.D.: The measurement of the Achievement Motivation. Hogrefe, Göttingen (1976)
Puca, R.M., Schmalt, H.D.: Task enjoyment: A mediator between achievement motives and performance. Motivation and Emotion 23, 15–29 (1999)
Sokolowski, K., Kehr, H.: Zum differentiellen Einfluss von Motivation auf Führungstrainings (MbO). Zeitschrift für Differentielle und Diagnostische Psychologie 20, 192–202 (1999)
Schmalt, H.D., Langens, T.A.: Projective, semiprojective and self-report measures of human motivation predict private cognitive events: Strivings, memories and daydreams., University of Wuppertal (2001) (unpubl. manuscript)
Pretz, J.E., Naples, A.J., Sternberg, R.J.: Recognizing, Defining, and Repre-senting Problems. In: Davidson, J.E., Steinberg, R.J. (eds.) The Psychology of Problem Solving, pp. 3–31. Cambridge University Press, Cambridge (2003)
Pirolli, P., Card, S.K.: Information Foraging. Psychological Review 106, 643–675 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Seitlinger, P.C., Bedek, M.A., Kopeinik, S., Albert, D. (2012). Evaluating the Validity of a Non-invasive Assessment Procedure. In: Ma, M., Oliveira, M.F., Hauge, J.B., Duin, H., Thoben, KD. (eds) Serious Games Development and Applications. SGDA 2012. Lecture Notes in Computer Science, vol 7528. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33687-4_18
Download citation
DOI: https://doi.org/10.1007/978-3-642-33687-4_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33686-7
Online ISBN: 978-3-642-33687-4
eBook Packages: Computer ScienceComputer Science (R0)