Abstract
Profound social reciprocity deficits are a core feature of the autism spectrum disorders. Children with autism often lack appropriate social skills when they need to interact with other people. A social stories training is one type of children-specific intervention for teaching social skills. It helps learn social skills through combination of visual and verbal cues. We use augmented reality (AR) technologies to visually conceptualize the social stories. Interactive social stories are played using several tangible markers and AR technologies that overlays the markers with corresponding virtual images. The new way to interpret social stories demonstrates an improvement of attraction and enhances effects of social skills training. Finally, We have a prototype for the social skill—“greeting” and an initial pilot study to support the therapy of high-functioning autism children.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Weiss, M., Harris, S.: Teaching social skills to people with autism. Behav. Modif. 25, 785–802 (2001)
McConnell, S.: Interventions to facilitate social interaction for young children with autism: review of available research and recommendations for educational intervention and future research. J. Autism Dev. Disord. 351–373 (2002)
Cooper, M., Griffith, K., Filer, J.: School intervention for inclusion of students with and without disabilities. Focus Autism Other Dev. Disabil. 14, 110–115 (1999)
Shipley-Benamou, R., Lutzker, J., Taubman, M.: Teaching daily living skills to children with autism through instructional video modeling. J. Positive Behav. Interv. 4, 166–177 (2002)
Swaggart, B., Gagnon, E., Bock, S., Earles, T., Quinn, C., Myles, B., Simpson, R.: Using social stories to teach social and behavioral skills to children with autism. Focus Autism Other Dev. Disabil. 10, 1–16 (1995)
Palmer-Ormsby, J.: Proposal project to improve greeting skills of an adult with disabilities using social stories. All Graduate Plan B and other Reports. Paper 54, (2011)
Azuma, R.: A survey of augmented reality. Presence: teleoperators Virtual Environ. 6, 355–385 (1997)
Richard, E., Billaudeau, V., Richard, P., Gaudin, G.: Augmented reality for rehabilitation of cognitive disabled children: a preliminary study. In: Proceedings of Virtual Rehabilitation. 102–108 (2007)
Juan, M., Alcaniz, M., Monserrat, C., Botella, C., Banos, R., Guerrero, B.: Using augmented reality to treat phobias. IEEE Comput. Grap. Appl. 25, 31–37 (2005)
Putnam, C., Chong, L.: Software and technologies designed for people with autism: what do users want?. In: Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility, pp. 3–10. ACM (2008)
Bosseler, A., Massaro, D.: Development and evaluation of a computer-animated tutor for vocabulary and language learning in children with autism. J. Autism Dev. Disord. 33, 653–672 (2003)
Parsons, S., Leonard, A., Mitchell, P.: Virtual environments for social skills training: comments from two adolescents with autistic spectrum disorder. Comput. Educ. 47, 186–206 (2006)
Farr, W., Yuill, N., Hinske, S.: An augmented toy and social interaction in children with autism. Int. J. Arts Technol. 5, 104 (2012)
Bai, Z., Blackwell, A., Coulouris, G.: Using augmented reality to elicit pretend play for children with autism. IEEE Trans. Vis. Comput. Graph. 21, 598–610 (2015)
Escobedo, L., Nguyen, D., Boyd, L., Hirano, S., Rangel, A., Garcia-Rosas, D., Tentori, M., Hayes, G.: MOSOCO: a mobile assistive tool to support children with autism practicing social skills in real-life situations. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2589–2598. ACM (2012)
Alessandrini, A., Cappelletti, A., Zancanaro, M.: Audio-augmented paper for the therapy of low-functioning autism children. In: CHI ’13 Extended Abstracts on Human Factors in Computing Systems, pp. 505–510., Paris, France (2013)
Engage| Project Autism, http://projectautism.org/engage
Gray, C.: The new social story book. Future Horizons, Arlington, Tex (2010)
Chen, C., Lee, I., Lin, L.: Augmented reality-based self-facial modeling to promote the emotional expression and social skills of adolescents with autism spectrum disorders. Res. Dev. Disabil. 36, 396–403 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Appendix: Social Stories
Appendix: Social Stories
1.1 A.1 Greet with Mom
There are many ways to greet someone.
Sometimes I can say, “Hello!” or “Hi!” It’s a great way to start a conversation and a good way to make new friends. I love to greet people because it makes me happy; it also makes the other people happy. They smile and respond to the greeting. I can also use sign language to greet someone!
When I see Mommy I can say “Hello!” to her.
Sometimes I can kiss her forehead, or even give her a hug if I want.
Saying hi to Mom is fun and a short hug also means “Hello!” Mom likes it when I greet her.
Most of the time she will say hi or give me a hug back when I greet her, this is a friendly and loving thing.
1.2 A.2 Greet with Friends
There are many ways to greet someone.
Sometimes I can say, “Hello!” or “Hi!” It’s a great way to start a conversation and a good way to make new friends. I love to greet people because it makes me happy; it also makes the other people happy. They smile and respond to the greeting. I can also use sign language to greet someone!
When I see my friend I will try my best to wave or say hi. When I say hi I can wave or use my words. I can say hi and than the person’s name.
Sometimes it is hard to say hello to friends but I will try my best to look at my friend’s face and wave or say hi.
Saying hi to friends is fun! People like me when I say hello.
Most of the time my friends will say hi or wave to me when they see me. I can try to say hi and wave back when this happens. Everyone say hi to friends when they see them.
1.3 A.3 Greet with Strangers
There are many ways to greet someone.
Sometimes I can say, “Hello!” or “Hi!” It’s a great way to start a conversation and a good way to make new friends. I love to greet people because it makes me happy; it also makes the other people happy. They smile and respond to the greeting. I can also use sign language to greet someone!
When I see someone I do not know I could say “Nice to meet you.” or “Hello!” When I say hello to a new friend I will try and remember to ask them their names. I can also tell my new friend my name.
Sometimes I can shake their hands, or wave my hand to say hello. Sometimes I can just nod my head and say hi.
Saying hi to new friends is fun! People like me when I say hello.
Greeting can make people feel good.
Rights and permissions
Copyright information
© 2017 Springer International Publishing Switzerland
About this paper
Cite this paper
Chung, CH., Chen, CH. (2017). Augmented Reality Based Social Stories Training System for Promoting the Social Skills of Children with Autism. In: Soares, M., Falcão, C., Ahram, T. (eds) Advances in Ergonomics Modeling, Usability & Special Populations. Advances in Intelligent Systems and Computing, vol 486. Springer, Cham. https://doi.org/10.1007/978-3-319-41685-4_44
Download citation
DOI: https://doi.org/10.1007/978-3-319-41685-4_44
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-41684-7
Online ISBN: 978-3-319-41685-4
eBook Packages: EngineeringEngineering (R0)