Adequacy of Game Scenarios for an Object with Playware Technology to Promote Emotion Recognition in Children with Autism Spectrum Disorder

  • Vinicius SilvaEmail author
  • Filomena Soares
  • João Sena Esteves
  • Ana Paula Pereira
  • Demétrio Matos
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1026)


Every human interaction is emphasized by the participants’ emotional states and manifestations. Being unable to understand the emotional state of the others is a significant deficit for anyone. This is the situation children with Autism Spectrum Disorder (ASD) usually find themselves in. Thus, researchers are exploring different technologies, such as Objects based on Playware Technology and social robots, in order to improve the emotion recognition skills of individuals with ASD. Following this trend, an improved Object of Playware Technology to be used in a storytelling activity as an add-on to the human-robot interaction with children with ASD, is proposed in the present work. Additionally, an evaluation of the images developed for the game scenario was conducted through an online questionnaire. Overall, the storytelling scenarios were well interpreted by the participants, matching a mean accuracy of 90%.


Human-robot interaction Playware Tangible interfaces 



The authors would like to express their acknowledgments to COMPETE: POCI-01-0145-FEDER-007043 and FCT – Fundação para a Ciência e Tecnologia within the Project Scope: UID/CEC/00319/2019. Vinicius Silva also thanks FCT for the PhD scholarship SFRH/BD/SFRH/BD/133314/2017. The authors thank the teachers and students of the Elementary School of Gualtar (EB1/JI Gualtar) in Braga for the participation.


  1. 1.
    Lund, H.H., Dam Pedersen, M., Beck, R.: Modular robotic tiles: experiments for children with autism. Artif. Life Robot. 13(2), 394–400 (2009)CrossRefGoogle Scholar
  2. 2.
    Barajas, A.O., Al Osman, H., Shirmohammadi, S.: A serious game for children with autism spectrum disorder as a tool for play therapy. In: 2017 IEEE 5th International Conference on Serious Games and Applications for Health, SeGAH 2017 (2017)Google Scholar
  3. 3.
    Tapus, A., et al.: Children with autism social engagement in interaction with Nao, an imitative robot. Interact. Stud. 13, 315–347 (2012)Google Scholar
  4. 4.
    Kim, E., Paul, R., Shic, F., Scassellati, B.: Bridging the research gap: making HRI useful to individuals with autism. J. Hum.-Robot Interact. 1, 26–54 (2012)Google Scholar
  5. 5.
    Costa, S.: Affective Robotics for Socio-Emotional Skills Development in Children with Autism Spectrum Disorders. University of Minho (2014)Google Scholar
  6. 6.
    Silva, V., Soares, F., Esteves, J.S., Pereira, A.P.: PlayCube: designing a tangible playware module for human-robot interaction. In: Advances in Intelligent Systems and Computing (2019)Google Scholar
  7. 7.
    Silva, V., Soares, F., Esteves, J.S., Pereira, A.P.: Building a hybrid approach for a game scenario using a tangible interface in human robot interaction. In: Göbel, S. et al. (eds) Serious Games. JCSG 2018. LNCS. Springer, Cham (2018)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Vinicius Silva
    • 1
    Email author
  • Filomena Soares
    • 1
    • 2
  • João Sena Esteves
    • 1
    • 2
  • Ana Paula Pereira
    • 3
  • Demétrio Matos
    • 4
  1. 1.Algoritmi Research CentreUniversity of MinhoGuimarãesPortugal
  2. 2.Department of Industrial ElectronicsUniversity of MinhoGuimarãesPortugal
  3. 3.Research Centre on Education, Institute of EducationUniversity of MinhoBragaPortugal
  4. 4.ID+ – IPCA-ESDBarcelosPortugal

Personalised recommendations