Advertisement

Can autism be catered with artificial intelligence-assisted intervention technology? A comprehensive survey

  • Muhammad Shoaib Jaliaawala
  • Rizwan Ahmed KhanEmail author
Article
First Online:

Abstract

This article presents an extensive literature review of technology based intervention methodologies for individuals facing autism spectrum disorder (ASD). Reviewed methodologies include: contemporary computer aided systems, computer vision assisted technologies and virtual reality (VR) or artificial intelligence (AI)-assisted interventions. The research over the past decade has provided enough demonstrations that individuals with ASD have a strong interest in technology based interventions, which are useful in both, clinical settings as well as at home and classrooms. Despite showing great promise, research in developing an advanced technology based intervention that is clinically quantitative for ASD is minimal. Moreover, the clinicians are generally not convinced about the potential of the technology based interventions due to non-empirical nature of published results. A major reason behind this lack of acceptability is that a vast majority of studies on distinct intervention methodologies do not follow any specific standard or research design. We conclude from our findings that there remains a gap between the research community of computer science, psychology and neuroscience to develop an AI assisted intervention technology for individuals suffering from ASD. Following the development of a standardized AI based intervention technology, a database needs to be developed, to devise effective AI algorithms.

Keywords

Computer aided systems (CAS) Computer vision assisted technologies (CVAT) Autism spectrum disorder (ASD) Facial expression recognition Artificial intelligence Virtual reality 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgements

We would like to show our gratitude to Dr. Amna Hanif of Aga Khan University Hospital, Karachi, Pakistan (AKUH) for sharing her knowledge and insight during course of this research.

References

  1. Adolphs R, Sears L, Piven J (2001) Abnormal processing of social information from faces in autism. J Cognit Neurosci 13(2):232–240.  https://doi.org/10.1162/089892901564289 ISSN 0898-929XGoogle Scholar
  2. Aresti-Bartolome N, Garcia-Zapirain B (2014) Technologies as support tools for persons with autistic spectrum disorder: a systematic review. Int J Environ Res Public Health 11(8):7767–7802Google Scholar
  3. Association AP (2000) Diagnostic and statistical manual of mental disorders, 4th edn. diagnostic & statistical manual of mental disorders. American Psychiatric Association, Text revision (DSM-IV-TR). ISBN 9780890420621. https://books.google.com.pk/books?id=qRj7lwEACAAJ
  4. Baird G, Charman T, Baron-Cohen S, Cox A, Swettenham J, Wheelwright S, Drew A (2000) A screening instrument for autism at 18 months of age: a 6-year follow-up study. J Am Acad Child Adolesc Psychiatry 39(6):694–702Google Scholar
  5. Baron-Cohen S, Golan O, Wheelwright S, Hill JJ (2004) Mind reading: the interactive guide to emotions. Jessica Kingsley Ltd Google Scholar, LondonGoogle Scholar
  6. Baron-Cohen S (2009) Autism: the empathizing-systemizing (e-s) theory. Ann NY Acad Sci 1156(1):68–80Google Scholar
  7. Baron-Cohen S, Jolliffe T, Mortimore C, Robertson M (1997) Another advanced test of theory of mind: evidence from very high functioning adults with autism or asperger syndrome. J Child Psychol Psychiatry 38(7):813–822Google Scholar
  8. Bartlett M, Littlewort G, Wu T, Movellan J (2008) Computer expression recognition toolbox. In: 8th IEEE International Conference on Automatic Face and Gesture Recognition, FG’08. , IEEE, pp 1–2 2008Google Scholar
  9. Beaumont R, Sofronoff K (2008) A multi-component social skills intervention for children with asperger syndrome: the junior detective training program. J Child Psychol Psychiatry 49(7):743–753Google Scholar
  10. Begum M, Serna RW, Yanco HA (2016) Are robots ready to deliver autism interventions? A comprehensive review. Int J Soc Robot 8(2):157–181Google Scholar
  11. Bernard-Opitz V, Sriram N, Nakhoda-Sapuan S (2001) Enhancing social problem solving in children with autism and normal children through computer-assisted instruction. J Autism Dev Disord 31(4):377–384Google Scholar
  12. Bölte S, Feineis-Matthews S, Leber S, Dierks T, Hubl D, Poustka F (2002) The development and evaluation of a computer-based program to test and to teach the recognition of facial affect. Int J Circumpolar Health 61(sup2):61–68Google Scholar
  13. Bölte S, Hubl D, Feineis-Matthews S, Prvulovic D, Dierks T, Poustka F (2006) Facial affect recognition training in autism: can we animate the fusiform gyrus? Behav Neurosci 120(1):211Google Scholar
  14. Buescher AVS, Cidav Z, Knapp M, Mandell DS (2014) Costs of autism spectrum disorders in the united kingdom and the united states. JAMA pediatr 168(8):721–728Google Scholar
  15. Cassidy S, Ropar D, Mitchell P, Chapman P (2014) Can adults with autism spectrum disorders infer what happened to someone from their emotional response? Autism Res 7(1):112–123Google Scholar
  16. Cassidy S, Mitchell P, Chapman P, Ropar D (2015) Processing of spontaneous emotional responses in adolescents and adults with autism spectrum disorders: effect of stimulus type. Autism Res 8(5):534–544Google Scholar
  17. Chakrabarti S, Fombonne E (2001) Pervasive developmental disorders in preschool children. JAMA 285(24):3093–3099Google Scholar
  18. Chen SSA, Bernard-Opitz V (1993) Comparison of personal and computer-assisted instruction for children with autism. Ment Retard 31(6):368Google Scholar
  19. Clark RE, Choi S (2005) Five design principles for experiments on the effects of animated pedagogical agents. J Educ Comput Res 32(3):209–225Google Scholar
  20. Cockburn J, Bartlett M, Tanaka J, Movellan J, Pierce M, Schultz R (2008) Smilemaze: a tutoring system in real-time facial expression perception and production in children with autism spectrum disorder. In ECAG 2008 workshop facial and bodily expressions for control and adaptation of games, p 3Google Scholar
  21. Cohen H, Amerine-Dickens M, Smith T (2006) Early intensive behavioral treatment: replication of the ucla model in a community setting. J Dev Behav Pediatr 27(2):S145–S155Google Scholar
  22. Colby KM (1973) The rationale for computer-based treatment of language difficulties in nonspeaking autistic children. J Autism Dev Disord 3(3):254–260.  https://doi.org/10.21236/ad0759717 Google Scholar
  23. De Haan M, Belsky J, Reid V, Volein A, Johnson MH (2004) Maternal personality and infants neural and visual responsivity to facial expressions of emotion. J Child Psychol Psychiatry 45(7):1209–1218Google Scholar
  24. Dunn L, Dunn D (1997) Peabody picture vocabulary test circle pines: American Guidance Service, 1997Google Scholar
  25. Eisenberger NI, Cole SW (2012) Social neuroscience and health: neurophysiological mechanisms linking social ties with physical health. Nat Neurosci 15(5):669–674Google Scholar
  26. Ekman P (2003) Emotions revealed: understanding thoughts and feelings. Weidenfeld and Nicolson, LondonGoogle Scholar
  27. Ekman P, Friesen W (1978) Facial action coding system: a technique for the measurement of facial movement. Consulting Psychologists, Palo AltoGoogle Scholar
  28. Ekman P, Friesen WV (1971) Constants across cultures in the face and emotion. J Pers Soc Psychol 17(2):124Google Scholar
  29. Ekman P, Oster H (1979) Facial expressions of emotion. Annu Rev Psychol 30(1):527–554Google Scholar
  30. Ekman P, Rosenberg EL (1997) What the face reveals: basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS). Oxford University Press, OxfordGoogle Scholar
  31. Ekman P, Friesen WV, Ellsworth P (1972) Emotion in the Human Face: guide-lines for research and an integration of findings: guidelines for Research and an integration of findings. Pergamon,Google Scholar
  32. Fabri M, Elzouki SYA, Moore D (2007) Emotionally expressive avatars for chatting, learning and therapeutic intervention. In: International conference on human—computer interaction, Springer, pp 275–285Google Scholar
  33. Faja S, Aylward E, Bernier R, Dawson G (2007) Becoming a face expert: a computerized face-training program for high-functioning individuals with autism spectrum disorders. Dev Neuropsychol 33(1):1–24Google Scholar
  34. Faja S, Webb SJ, Jones E, Merkle K, Kamara D, Bavaro J, Aylward E, Dawson G (2012) The effects of face expertise training on the behavioral performance and brain activity of adults with high functioning autism spectrum disorders. J Autism Dev Disord 42(2):278–293Google Scholar
  35. Michael Dr Fitzgerald (2004) Autism and creativity : is there a link between autism in men and exceptional ability? Hove ; New York : Brunner-Routledge, ISBN 1583912134 (hbk.). Includes bibliographical references and index p 271–283Google Scholar
  36. Frank MC, Vul E, Johnson SP (2009) Development of infants attention to faces during the first year. Cognition 110(2):160–170Google Scholar
  37. Golan O, Baron-Cohen S (2006) Systemizing empathy: teaching adults with asperger syndrome or high-functioning autism to recognize complex emotions using interactive multimedia. Dev Psychopathol 18(2):591–617.  https://doi.org/10.1017/s0954579406060305 Google Scholar
  38. Golan O, Ashwin E, Granader Y, McClintock S, Day K, Leggett V, Baron-Cohen S (2009) Enhancing emotion recognition in children with autism spectrum conditions: an intervention using animated vehicles with real emotional faces. J Autism Dev Disord 40(3):269–279Google Scholar
  39. Govindan VK, Shivaprasad AP (1990) Character recognitiona review. Pattern Recognit 23(7):671–683Google Scholar
  40. Gross TF (2004) The perception of four basic emotions in human and nonhuman faces by children with autism and other developmental disabilities. J Abnorm Child Psychol 32(5):469–480.  https://doi.org/10.1023/B:JACP.0000037777.17698.01 ISSN 1573-2835Google Scholar
  41. Grynszpan O, Martin JC, Nadel J (2007) Exploring the influence of task assignment and output modalities on computerized training for autism. Interact Stud 8(2):241–266Google Scholar
  42. Grynszpan O, Martin JC, Nadel J (2008) Multimedia interfaces for users with high functioning autism: an empirical investigation. Int J Hum Comput Stud 66(8):628–639Google Scholar
  43. Grynszpan O, Weiss PL, Perez-Diaz F, Gal E (2014) Innovative technology-based interventions for autism spectrum disorders: a meta-analysis. Autism 18(4):346–361Google Scholar
  44. Herba C, Phillips M (2004) Annotation: development of facial expression recognition from childhood to adolescence: behavioural and neurological perspectives. J Child Psychol Psychiatry 45(7):1185–1198Google Scholar
  45. Higgins K, Boone R (1996) Creating individualized computer-assisted instruction for students with autism using multimedia authoring software. Focus Autism Other Dev Disabl 11(2):69–78Google Scholar
  46. Hill EL, Frith U (2003) Understanding autism: insights from mind and brain. Philos Trans R Soc Lond B Biol Sci 358(1430):281–289Google Scholar
  47. Holm S (1979) A simple sequentially rejective multiple test procedure. Scand J Stat 6:65–70MathSciNetzbMATHGoogle Scholar
  48. Hopkins IM, Gower MW, Perez TA, Smith DS, Amthor FR, Wimsatt FC, Biasini FJ (2011) Avatar assistant: improving social skills in students with an asd through a computer-based intervention. J Autism Dev Disord 41(11):1543–1555Google Scholar
  49. House JS, Landis KR, Umberson D (1988) Social relationships and health. Science 241(4865):540Google Scholar
  50. Howlin P, Baron-Cohen S, Hadwin J (1999) Teaching children with autism to mind-read: a practical guide for teachers and parents. Wiley, HobokenGoogle Scholar
  51. Jain S, Tamersoy B, Zhang Y, Aggarwal JK, Orvalho V (2012) An interactive game for teaching facial expressions to children with autism spectrum disorders. In: 2012 5th international symposium on communications control and signal processing (ISCCSP), pp 1–4. IEEEGoogle Scholar
  52. Jain S, Hu C, Aggarwal JK (2011) Facial expression recognition with temporal modeling of shapes. In: 2011 IEEE international conference on computer vision workshops (ICCV workshops), pp 1642–1649. IEEEGoogle Scholar
  53. Johnson MK, Farid H (2005) Exposing digital forgeries by detecting inconsistencies in lighting. In: proceedings of the 7th workshop on multimedia and security, pp 1–10. ACMGoogle Scholar
  54. Kagohara DM (2011) Three students with developmental disabilities learn to operate an ipod to access age-appropriate entertainment videos. J Behav Educ 20(1):33–43Google Scholar
  55. Kandalaft MR, Didehbani N, Krawczyk DC, Allen TT, Chapman SB (2013) Virtual reality social cognition training for young adults with high-functioning autism. J Autism Dev Disord 43(1):34–44Google Scholar
  56. Ke F, Im T (2013) Virtual-reality-based social interaction training for children with high-functioning autism. J Educ Res 106(6):441–461Google Scholar
  57. Khan RA, Meyer A, Konik H, Bouakaz S (2012a) Exploring human visual system: study to aid the development of automatic facial expression recognition framework. In: Conference on computer vision and pattern recognition (CVPR), Workshop on gesture recognition, pp 49–54Google Scholar
  58. Khan RA, Meyer A, Konik H, Bouakaz S (2012b) Human vision inspired framework for facial expressions recognition. In: 2012 19th IEEE international conference on image processing (ICIP), pp 2593–2596. IEEEGoogle Scholar
  59. Khan RA, Meyer A, Konik H, Bouakaz S (2013) Framework for reliable, real-time facial expression recognition for low resolution images. Pattern Recognit Lett 34(10):1159–1168Google Scholar
  60. Khenissi MA, Essalmi F, Jemni M (2013) A learning version of pacman game. In: 2013 fourth international conference on information and communication technology and accessibility (ICTA), pp 1–3. IEEEGoogle Scholar
  61. Kodak T, Fisher WW, Clements A, Bouxsein KJ (2011) Effects of computer-assisted instruction on correct responding and procedural integrity during early intensive behavioral intervention. Res Autism spectr Disord 5(1):640–647Google Scholar
  62. Lacava PG, Golan O, Baron-Cohen S, Smith Myles B (2007) Using assistive technology to teach emotion recognition to students with asperger syndrome: a pilot study. Remedial Spec Educ 28(3):174–181Google Scholar
  63. Lacava PG, Rankin A, Mahlios E, Cook K, Simpson RL (2010) A single case design evaluation of a software and tutor intervention addressing emotion recognition and social interaction in four boys with asd. Autism 14(3):161–178Google Scholar
  64. Lim S, Lee K, Byeon O, Kim T (2001) Efficient iris recognition through improvement of feature vector and classifier. ETRI J 23(2):61–70Google Scholar
  65. Loveland KA (2005) Social-emotional impairment and self-regulation in autism spectrum disorders. In: Nadel J, Muir D (eds) Emotional development: recent research advances. University Press, Oxford, pp 365–382Google Scholar
  66. Matson JL (1989) Chronic schizophrenia and adult autism: issues in diagnosis, assessment, and psychological treatment. Springer Pub Co, BerlinGoogle Scholar
  67. McInerney T, Terzopoulos D (1996) Deformable models in medical image analysis: a survey. Med Image Anal 1(2):91–108Google Scholar
  68. McIntosh DN, Reichmann-Decker A, Winkielman P, Wilbarger JL (2006) When the social mirror breaks: deficits in automatic, but not voluntary, mimicry of emotional facial expressions in autism. Dev Sci 9(3):295–302.  https://doi.org/10.1111/j.1467-7687.2006.00492.x ISSN 1467-7687Google Scholar
  69. McPartland J, Dawson G, Webb SJ, Panagiotides H, Carver LJ (2004) Event-related brain potentials reveal anomalies in temporal processing of faces in autism spectrum disorder. J Child Psychol Psychiatry 45(7):1235–1245.  https://doi.org/10.1111/j.1469-7610.2004.00318.x ISSN 1469-7610Google Scholar
  70. Mitchell P, Parsons S, Leonard A (2007) Using virtual environments for teaching social understanding to 6 adolescents with autistic spectrum disorders. J Autism Dev Disord 37(3):589–600Google Scholar
  71. Moore D, Cheng Y, McGrath P, Powell NJ (2005) Collaborative virtual environment technology for people with autism. Focus Autism Other Dev Disabl 20(4):231–243Google Scholar
  72. Nikopoulos CK, Keenan M (2007) Using video modeling to teach complex social sequences to children with autism. J Autism Dev Disord 37(4):678–693Google Scholar
  73. World Health Organization (1993) ICD-10 classification of mental and behavioural disorders (The): diagnostic criteria for research. ICD-10 classification of mental and behavioural disorders / World Health Organization. World Health Organization, ISBN 9789241544559. https://books.google.com.pk/books?id=HlnzVSbec18C
  74. Ospina MB, Seida JK, Clark B, Karkhaneh M, Hartling L, Tjosvold L, Vandermeer B, Smith V (2008) Behavioural and developmental interventions for autism spectrum disorder: a clinical systematic review. PloS One 3(11):e3755Google Scholar
  75. Ozonoff S, South M, Miller JN (2000) Dsm-iv-defined asperger syndrome: cognitive, behavioral and early history differentiation from high-functioning autism. Autism 4:29–46Google Scholar
  76. Parsons S, Mitchell P, Leonard A (2004) The use and understanding of virtual environments by adolescents with autistic spectrum disorders. J Autism Dev disord 34(4):449–466Google Scholar
  77. Parsons S, Leonard A, Mitchell P (2006) Virtual environments for social skills training: comments from two adolescents with autistic spectrum disorder. Comput Educ 47(2):186–206Google Scholar
  78. Pennington RC (2010) Computer-assisted instruction for teaching academic skills to students with autism spectrum disorders: a review of literature. Focus Autism Other Dev Disabl 25(4):239–248Google Scholar
  79. Plienis AJ, Romanczyk RG (1985) Analyses of performance, behavior, and predictors for severely disturbed children: a comparison of adult vs. computer instruction. Anal Interv Dev Disabl 5(4):345–356Google Scholar
  80. Ploog BO (2010) Stimulus overselectivity four decades later: a review of the literature and its implications for current research in autism spectrum disorder. J Autism Dev Disord 11(40):1332–1349Google Scholar
  81. Plutchik R (2001) The nature of emotions: human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. Am Sci 89(4):344–350Google Scholar
  82. Ramdoss S, Lang R, Mulloy A, Franco J, OReilly M, Didden R, Lancioni G (2011) Use of computer-based interventions to teach communication skills to children with autism spectrum disorders: a systematic review. J Behav Educ 20(1):55–76Google Scholar
  83. Rice C (2009) Prevalence of autism spectrum disorders—autism and developmental disabilities monitoring network, United States, 2006Google Scholar
  84. Richmond G (1983) Comparison of automated and human instruction for developmentally retarded preschool children. J Assoc Sev Handicaps 8(3):78–84Google Scholar
  85. Rogers SJ (1998) Empirically supported comprehensive treatments for young children with autism. J Clin Child Psychol 27(2):168–179Google Scholar
  86. Rossignol DA, Frye RE (2012) A review of research trends in physiological abnormalities in autism spectrum disorders: immune dysregulation, inflammation, oxidative stress, mitochondrial dysfunction and environmental toxicant exposures. Mol Psychiatry 17(4):389Google Scholar
  87. Rump KM, Giovannelli JL, Minshew NJ, Strauss MS (2009) The development of emotion recognition in individuals with autism. Child Dev 80(5):1434–1447.  https://doi.org/10.1111/j.1467-8624.2009.01343.x ISSN 1467-8624Google Scholar
  88. Russo DC, Koegei RL, Lovaas OI (1978) A comparison of human and automated instruction of autistic children. J Abnorm Child Psychol 6(2):189–201Google Scholar
  89. Sansosti FJ, Powell-Smith KA (2008) Using computer-presented social stories and video models to increase the social communication skills of children with high-functioning autism spectrum disorders. J Posit Behav Interv 10(3):162–178Google Scholar
  90. Serret S, Hun S, Iakimova G, Lozada J, Anastassova M, Santos A, Vesperini S, Askenazy F (2014) Facing the challenge of teaching emotions to individuals with low-and high-functioning autism using a new serious game: a pilot study. Mol Autism 5(1):37Google Scholar
  91. Silver M, Oakes P (2001) Evaluation of a new computer intervention to teach people with autism or asperger syndrome to recognize and predict emotions in others. Autism 5(3):299–316Google Scholar
  92. Simpson A, Langone J, Ayres KM (2004) Embedded video and computer based instruction to improve social skills for students with autism. Educ Train Dev Disabl 39(3):240–252Google Scholar
  93. Strickland DC, Coles CD, Southern LB (2013) Jobtips: a transition to employment program for individuals with autism spectrum disorders. J Autism Dev Disord 43(10):2472–2483Google Scholar
  94. Tanaka JW, Wolf JM, Klaiman C, Koenig K, Cockburn J, Herlihy L, Brown C, Stahl S, Kaiser MD, Schultz RT (2010) Using computerized games to teach face recognition skills to children with autism spectrum disorder: the lets face it! program. J Child Psychol Psychiatry 51(8):944–952Google Scholar
  95. Tarkan L (2002) Autism therapy is called effective, but rare. https://tinyurl.com/y8ew8ker
  96. Tsai TW, Lin MY (2011) An application of interactive game for facial expression of the autisms. Edutainment. Springer, Berlin, pp 204–211Google Scholar
  97. Wechsler D (1999) Manual for the wechsler abbreviated intelligence scale (wasi). The Psychological Corporation, San AntonioGoogle Scholar
  98. Werry I, Dautenhahn K, Harwin W (2001) Investigating a robot as a therapy partner for children with autism. In: Proceedings of AAATE 2001Google Scholar
  99. Whalen C, Liden L, Ingersoll B, Dallaire E, Liden S (2006) Positive behavioral changes associated with the use of computer-assisted instruction for young children. J Speech Lang Pathol Appl Behav Anal 1(1):11–26Google Scholar
  100. Whalen C, Moss D, Ilan AB, Vaupel M, Fielding P, Macdonald K, Cernich S, Symon J (2010) Efficacy of teachtown: Basics computer-assisted intervention for the intensive comprehensive autism program in los angeles unified school district. Autism 14(3):179–197.  https://doi.org/10.1177/1362361310363282 Google Scholar
  101. Wolf JM, Tanaka JW, Klaiman C, Cockburn J, Herlihy L, Brown C, South M, McPartland J, Kaiser MD, Phillips R et al (2008) Specific impairment of face-processing abilities in children with autism spectrum disorder using the let’s face it! skills battery. Autism Res 1(6):329–340Google Scholar
  102. Zendler A (1998) Multimedia Development Systems: with Methods for Modeling Multimedia Applications, vol 8. Tectum Verlag DEGoogle Scholar
  103. Zhang J, Quan H, Ng J, Stepanavage ME (1997) Some statistical methods for multiple endpoints in clinical trials. Control Clin Trials 18(3):204–221Google Scholar

Copyright information

© Springer Nature B.V. 2019

Authors and Affiliations

  1. 1.Faculty of ITBarrett Hodgson UniversityKarachiPakistan
  2. 2.Faculty of Engineering Sciences and TechnologyHamdard UniversityKarachiPakistan
  3. 3.LIRIS, Universite Claude Bernard Lyon1VilleurbanneFrance
  4. 4.National University of Computer and Emerging Sciences, FAST-NUKarachiPakistan

Personalised recommendations

Cite article

Buy options