LIFEisGAME: A Facial Character Animation System to Help Recognize Facial Expressions
This article presents the LIFEisGAME project, a serious game that will help children with ASDs to recognize and express emotions through facial expressions. The game design tackles one of the main experiential learning cycle of emotion recognition: recognize and mimic (game mode: build a face). We describe the technology behind the game, which focus on a character animation pipeline and a sketching algorithm. We detailed the facial expression analyzer that is used to calculate the score in the game. We also present a study that analyzes what type of characters children prefer when playing a game. Last, we present a pilot study we have performed with kids with ASD.
Keywordsautism spectrum disorder emotions serious games facial animation emotion recognition HCI consumer health informatics
Unable to display preview. Download preview PDF.
- 1.Bal, E., Harden, E., Lamb, D., Van Hecke, A.V., Denver, J.W., Porges, S.W.: Emotion recognition in children with Autism Spectrum Disorders: Relations to eye gaze and autonomic state. Journal of Autism and Developmental Disorders 40, 358–370 (2009), doi:10.1007/510803-009-0884-3CrossRefGoogle Scholar
- 2.Tanaka, J.W., Wolf, J.M., Klaiman, C., Koenig, K., Cockburn, J., Herlihy, L., Schultz, R.T.: Using computerized games to teach face recognition skills to children with autism spectrum disorder: The Let’s Face It! program. Journal of Child Psychology and Psychiatry 2258, 1–12 (2010)Google Scholar
- 5.Wallace, S., Coleman, M., Bailey, A.: Face and object processing in autism spectrum disorders. Autism Research 51, 43–51, 299-316 (2008)Google Scholar
- 7.Golan, O., Baron-Cohen, S., Ashwin, E., Granader, Y., MacClintock, S., Day, K., et al.: Enhancing emotion recognition in children with autism spectrum conditions: An intervention using animated vehicles with real emotional faces. Journal of Autism and Developmental Disorders (in press)Google Scholar
- 9.Silver, M., Oakes, P.: Evaluation of a new computer intervention to teach people with autism or Asperger Syndrome to recognize and predict emotions in others. Autism, 5 (2001)Google Scholar
- 13.Falk, R., Minter, D., Vernon, C., Aretos, G., Modesto, L., Lamorlette, A., Walker, N., Cheung, T., Rentel-Lavin, J., Max, H.: Art-directed technology: anatomy of a Shrek2 sequence. In: Proc. of SIGGRAPH 2004: SIGGRAPH 2004 Course Notes, p. 13 (2004)Google Scholar
- 17.Miranda, J.C., Blanco, X.A., Sousa, A.A., Gutierrez, D., Orvalho, J., Orvalho, V.: Painting on canvas: a facial sketching control system. Poster/demo session at ACM SIGGRAPH/Eurographics Symp. on Computer Animation, New Orleans, LA (2010)Google Scholar
- 18.Human Emotion Detection from Image (2010), http://www.codeproject.com/KB/GDI-plus/HumanEmotionDetection.aspx
- 19.Kolb, D.A.: Experiential Learning. Prentice Hall, Englewood Cliffs (1984)Google Scholar
- 20.Abirached, B., Aggarwal, J., Costa, T., Fernandes, T., Orvalho, V., Tamersoy, B., Zhang, Y.: Improving Communication Skills of Children with Autism Spectrum Disorders (ASDs) through Interaction with Virtual Characters (2011)Google Scholar