Skip to main content
SpringerLink
Log in

Facial Expressions and Politeness Effect in Foreign Language Training System

  • Conference paper
Intelligent Tutoring Systems (ITS 2010)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 6094))

Included in the following conference series:

Abstract

Previous studies on the Politeness Effect show that using politeness strategies in tutorial feedback can have a positive impact on learning (McLaren et al. 2010; Wang and Johnson 2008; Wang et al. 2005). While prior research efforts tried to uncover the mechanism through which the politeness strategies impact the learner, the results were inconclusive. Further, it is unclear how the politeness strategies should adapt over time. In this paper, we analyze the video tapes of participants’ facial expression while interacting with a polite or direct tutor in a foreign language training system. The Facial Action Coding System was then used to analyze the facial expressions. Results show that as social distance decreases over time, polite feedback is received less favorably while the preference for direct feedback increases.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. McLaren, B.M., DeLeeuw, K.E., Mayer, R.E.: A Politeness Effect in Learning with Web-Based Intelligent Tutors. To be Presented at the 2010 American Educational Research Association (AERA) Annual Meeting, Denver, Colorado, April 30 - May 4 (2010)

    Google Scholar 

  2. Wang, N., Johnson, W.L.: The Politeness Effect in Intelligent Foreign Language Tutoring System. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds.) ITS 2008. LNCS, vol. 5091, pp. 270–280. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  3. Wang, N., Johnson, W.L., Mayer, R.E., Rizzo, R., Shaw, E., Collins, H.: The politeness effect: Pedagogical agents and learning gains. In: The 12th International Conference on Artificial Intelligence in Education (2005)

    Google Scholar 

  4. Atkinson, R.K.: Optimizing learning from examples using animated pedagogical agents. Journal of Educational Psychology 94, 416–427 (2002)

    Article  Google Scholar 

  5. Johnson, W.L., Rickel, J., Stiles, R., Munro, A.: Integrating pedagogical agents into virtual environments. Presence 7(5) (1998)

    Google Scholar 

  6. Lester, J., Towns, S.G., Callaway, C.B., Voerman, J.L., FitzGerald, P.J.: Deictic and Emotive Communication in Animated Pedagogical Agents. In: Cassell, J., Prevost, S., Sullivan, J., Churchill, E. (eds.) Embodied Conversational Agents, pp. 123–154. MIT Press, Cambridge (2000)

    Google Scholar 

  7. Moreno, R.: Multimedia Learning with Pedagogical Agents. In: Mayer, R.E. (Hrsg.) The Cambride Handbook of multimedia learning, pp. 507–523. Cambridge University Press, New York (2005)

    Google Scholar 

  8. Baylor, A.L.: The impact of pedagogical agents image on affective outcomes. In: Proc. of the International Conference on Intelligent User Interfaces (2005)

    Google Scholar 

  9. Baylor, A.L., Ryu, J.: Does the presence of image and animation enhance pedagogical agent persona? Journal of Educational Computing Research 28 (2003)

    Google Scholar 

  10. Graesser, A.C., Moreno, K., Marineau, J., Adcock, A., Olney, A., Person, N.: AutoTutor improves deep learning of computer literacy: Is it the dialog or the talking head? In: Hoppe, U., Verdejo, F., Kay, J. (eds.) Proceedings of Artificial Intelligence in Education, pp. 47–54. IOS Press, Amsterdam (2003)

    Google Scholar 

  11. Moreno, R., Mayer, R.E.: Meaningful design for meaningful learning: Applying cognitive theory to multimedia explanations. In: ED-MEDIA 2000 Proceedings, pp. 747–752. AACE Press, Charlottesville (2000)

    Google Scholar 

  12. Moreno, R., Mayer, R.E., Spires, H., Lester, J.: The case for social agency in computer-based teaching: Do students learn more deeply when they interact with animated pedagogical agents? Cognition and Instruction 19, 177–213 (2001)

    Article  Google Scholar 

  13. McLaren, B.M., Lim, S., Yaron, D., Koedinger, K.R.: Can a Polite Intelligent Tutoring System Lead to Improved Learning Outside of the Lab? In: Luckin, R., Koedinger, K.R., Greer, J. (eds.) Proceedings of the 13th International Conference on Artificial Intelligence in Education, pp. 433–440. IOS Press, Amsterdam (2007)

    Google Scholar 

  14. Brown, P., Levinson, S.C.: Politeness: Some universals in language use. Cambridge University Press, New York (1987)

    Google Scholar 

  15. Ekman, P.: Facial expression of emotion. American Psychologist 48, 384–392 (1993)

    Article  Google Scholar 

  16. Ekman, P., Friesen, W.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)

    Google Scholar 

  17. Ekman, P., Rosenberg, E.L. (eds.): What the face reveals: Basic and applied studies of spontaneous expression using the FACS. Oxford University Press, Oxford (2005)

    Google Scholar 

  18. Bartlett, M., Littlewort, G., Lainscsek, C., Fasel, I., Movellan, J.: Machine learning methods for fully automatic recognition of facial expressions and facial actions. In: IEEE International Conference on Systems, Man & Cybernetics, The Hague, Netherlands, pp. 592–597 (2004)

    Google Scholar 

  19. Bartlett, M.S., Littlewort, G.C., Frank, M.G., Lainscsek, C., Fasel, I., Movellan, J.R.: Automatic recognition of facial actions in spontaneous expressions. Journal of Multimedia 1(6), 22–35 (2006)

    Article  Google Scholar 

  20. Susskind, J.M., Littlewort, G.C., Bartlett, M.S., Movellan, J.R., Anderson, A.K.: Human and Computer Recognition of Facial Expressions of Emotion. Neuropsychologia 45(1), 152–162 (2007)

    Article  Google Scholar 

  21. McDaniel, B.T., D’Mello, S.K., King, B.G., Chipman, P., Tapp, K., Graesser, A.C.: Facial Features for Affective State Detection in Learning Environments. In: McNamara, D.S., Trafton, J.G. (eds.) Proceedings of the 29th Annual Meeting of the Cognitive Science Society, pp. 467–472. Cognitive Science Society, Austin (2007)

    Google Scholar 

  22. Johnson, W.L.: Serious use of a serious game for language learning. In: Luckin, R., et al. (eds.) Artificial Intelligence in Education, pp. 67–74. IOS Press, Amsterdam (2007)

    Google Scholar 

  23. Boekaerts, M.: The On-Line Motivation Questionnaire: A self-report instrument to assess students’ context sensitivity. In: Pintrich, P.R., Maehr, M.L. (eds.) New Directions in Measures and Methods, Series in Advances in Motivation and Achievement, vol. 12, pp. 77–120 (2002)

    Google Scholar 

  24. Littlewort, G., Bartlett, M.S., Lee, K.: Automated measurement of spontaneous facial expressions of genuine and posed pain. In: Proc. International Conference on Multimodal Interfaces (2007)

    Google Scholar 

  25. Wang, N., Gratch, J.: Can Virtual Human Build Rapport and Promote Learning? In: Proc. of The 14th International Conference on Artificial Intelligence in Education (2009)

    Google Scholar 

  26. Ekman, P., Davidson, R.J., Friesen, W.V.: The Duchenne smile: Emotional expression and brain psysiology II. Journal of Personality and Social Psychology 58, 342–353 (1990)

    Article  Google Scholar 

  27. D’Mello, S.K., Picard, R., Graesser, A.C.: Toward an affect-sensitive AutoTutor. IEEE Intelligent Systems 22(4), 53–61 (2007)

    Article  Google Scholar 

  28. Zeng, Z., Pantic, M., Roisman, G.I., Huang, T.S.: A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 31(1), 39–58 (2009)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. USC Institute for Creative Technologies, 13274 Fiji Way, Marina del Rey, CA, 90202, USA

    Ning Wang & Jonathan Gratch

  2. Alelo Inc., 12910 Culver Boulevard Suite J, Los Angeles, California, 90066, USA

    W. Lewis Johnson

Authors
  1. Ning Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. W. Lewis Johnson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jonathan Gratch
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Human-Computer Interaction Institute, Carnegie Mellon University, 5000 Forbes Avenue, 15213, Pittsburgh, PA, USA

    Vincent Aleven  & Jack Mostow  & 

  2. School of Information Technologies, University of Sydney, 1 Cleveland Street, 2006, Sydney, Australia

    Judy Kay

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Wang, N., Johnson, W.L., Gratch, J. (2010). Facial Expressions and Politeness Effect in Foreign Language Training System. In: Aleven, V., Kay, J., Mostow, J. (eds) Intelligent Tutoring Systems. ITS 2010. Lecture Notes in Computer Science, vol 6094. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13388-6_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-13388-6_21

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-13387-9

  • Online ISBN: 978-3-642-13388-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation