Atypical Visual Processing but Comparable Levels of Emotion Recognition in Adults with Autism During the Processing of Social Scenes
Abstract
Understanding the underlying visual scanning patterns of individuals with autism spectrum disorder (ASD) during the processing of complex emotional scenes remains limited. This study compared the complex emotion recognition performance of adults with ASD (n = 23) and matched neurotypical participants (n = 25) using the Reading the Mind in Films Task. Behaviourally, both groups exhibited similar emotion recognition accuracy. Visual fixation time towards key social regions of each stimuli was examined via eye tracking. Individuals with ASD demonstrated significantly longer fixation time towards the non-social areas. No group differences were evident for the facial and body regions of all characters in the social scenes. The findings provide evidence of the heterogeneity associated with complex emotion processing in individuals with ASD.
Keywords
Autism Dynamic stimuli Eye tracking Naturalistic Social cognitionNotes
Acknowledgments
The researchers would like to extend our gratitude to the participants for the time and effort taken to participate in this study as well as Melissa Black, who assisted in data collection.
Author Contributions
JT conceptualised and designed the study, involved in data collection, analysed and interpreted the data, and contributed to drafting the article. NC conceptualised and designed the study, analysed and interpreted the data and critically revised the draft. MF conceptualised and designed the study, interpreted the data, and revised the draft. SB revised and critically contributed to the intellectual content of the article. SG conceptualised and designed the study, interpreted the data and critically revised the article. All authors contributed to and have approved the final manuscript.
Funding
This research is supported by the Cooperative Research Centre for Living with Autism (Autism CRC) [Project Number 3.032RS], established and supported under the Australian Government’s Cooperative Research Centres Program. JT is supported through an Australian Government Research Training Program Scholarship.
Compliance with Ethical Standards
Conflict of interest
The authors declare that they have no conflict of interest. SB reports no direct conflict of interest related to this article. SB discloses that he has in the last 5 years acted as an author, consultant or lecturer for Shire, Medice, Roche, Eli Lilly, Prima Psychiatry, GLGroup, System Analytic, Kompetento, Expo Medica, and Prophase. He receives royalties for text books and diagnostic tools from Huber/Hogrefe, Kohlhammer and UTB.
References
- Adolphs, R. (2001). The neurobiology of social cognition. Current Opinion in Neurobiology, 11(2), 231–239. https://doi.org/10.1016/S0959-4388(00)00202-6.CrossRefPubMedGoogle Scholar
- American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders. Washington, DC: American Psychiatric Association.Google Scholar
- American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: American Psychiatric Association.CrossRefGoogle Scholar
- Ashwin, C., Chapman, E., Colle, L., & Baron-Cohen, S. (2006). Impaired recognition of negative basic emotions in autism: A test of the amygdala theory. Social Neuroscience, 1(3–4), 349–363. https://doi.org/10.1080/17470910601040772.CrossRefPubMedGoogle Scholar
- Baron-Cohen, S. (2004). The cognitive neuroscience of autism. Journal of Neurology, Neurosurgery and Psychiatry, 75(7), 945–948. https://doi.org/10.1136/jnnp.2003.018713.CrossRefPubMedGoogle Scholar
- Berggren, S., Engstrom, A. C., & Bölte, S. (2016). Facial affect recognition in autism, ADHD and typical development. Cognitive Neuropsychiatry, 21(3), 213–227. https://doi.org/10.1080/13546805.2016.1171205.CrossRefPubMedGoogle Scholar
- Bird, G., Press, C., & Richardson, D. C. (2011). The role of alexithymia in reduced eye-fixation in autism spectrum conditions. Journal of Autism and Developmental Disorders, 41(11), 1556–1564. https://doi.org/10.1007/s10803-011-1183-3.CrossRefPubMedGoogle Scholar
- Black, M. H., Chen, N. T. M., Iyer, K. K., Lipp, O. V., Bölte, S., Falkmer, M., et al. (2017). Mechanisms of facial emotion recognition in autism spectrum disorders: Insights from eye tracking and electroencephalography. Neuroscience and Biobehavioral Reviews, 80, 488–515. https://doi.org/10.1016/j.neubiorev.2017.06.016.CrossRefPubMedGoogle Scholar
- Bölte, S., Poustka, F., & Constantino, J. N. (2008). Assessing autistic traits: Cross-cultural validation of the Social Responsiveness Scale (SRS). Autism Research, 1(6), 354–363. https://doi.org/10.1002/aur.49.CrossRefPubMedGoogle Scholar
- Borod, J. C., Pick, L. H., Hall, S., Sliwinski, M., Madigan, N., Obler, L. K., et al. (2000). Relationships among facial, prosodic, and lexical channels of emotional perceptual processing. Cognition and Emotion, 14(2), 193–211. https://doi.org/10.1080/026999300378932.CrossRefGoogle Scholar
- Bruni, T. P. (2014). Test review: Social responsiveness scale-second edition (SRS-2). Journal of Psychoeducational Assessment, 32(4), 365–369. https://doi.org/10.1177/0734282913517525.CrossRefGoogle Scholar
- Bӧlte, S., & Poustka, F. (2003). The recognition of facial affect in autistic and schizophrenic subjects and their first-degree relatives. Psychological Medicine, 33(5), 907–915. https://doi.org/10.1017/S0033291703007438.CrossRefGoogle Scholar
- Cassidy, S., Mitchell, P., Chapman, P., & Ropar, D. (2015). Processing of spontaneous emotional responses in adolescents and adults with autism spectrum disorders: Effect of stimulus type. Autism Research, 8(5), 534–544. https://doi.org/10.1002/aur.1468.CrossRefPubMedPubMedCentralGoogle Scholar
- Castelli, F. (2005). Understanding emotions from standardized facial expressions in autism and normal development. Autism, 9(4), 428–449. https://doi.org/10.1177/1362361305056082.CrossRefPubMedGoogle Scholar
- Chevallier, C., Parish-Morris, J., McVey, A., Rump, K. M., Sasson, N. J., Herrington, J. D., et al. (2015). Measuring social attention and motivation in autism spectrum disorder using eye-tracking: Stimulus type matters. Autism Research, 8(5), 620–628. https://doi.org/10.1002/aur.1479.CrossRefPubMedPubMedCentralGoogle Scholar
- Chita-Tegmark, M. (2016). Social attention in ASD: A review and meta-analysis of eye-tracking studies. Research in Developmental Disabilities, 48, 79–93. https://doi.org/10.1016/j.ridd.2015.10.011.CrossRefPubMedGoogle Scholar
- Clark, T. F., Winkielman, P., & McIntosh, D. N. (2008). Autism and the extraction of emotion from briefly presented facial expressions: Stumbling at the first step of empathy. Emotion, 8(6), 803–809. https://doi.org/10.1037/a0014124.CrossRefPubMedGoogle Scholar
- Constantino, J. N., & Gruber, C. P. (2011). Social Responsiveness Scale, second edition (SRS-2). Torrance: Western Psychological Services.Google Scholar
- Durand, K., Gallay, M., Seigneuric, A., Robichon, F., & Baudouin, J.-Y. (2007). The development of facial emotion recognition: The role of configural information. Journal of Experimental Child Psychology, 97(1), 14–27. https://doi.org/10.1016/j.jecp.2006.12.001.CrossRefPubMedGoogle Scholar
- Eack, S. M., Mazefsky, C. A., & Minshew, N. J. (2015). Misinterpretation of facial expressions of emotion in verbal adults with autism spectrum disorder. Autism, 19(3), 308–315. https://doi.org/10.1177/1362361314520755.CrossRefPubMedGoogle Scholar
- Falkmer, M., Bjällmark, A., Larsson, M., & Falkmer, T. (2011). Recognition of facially expressed emotions and visual search strategies in adults with Asperger syndrome. Research in Autism Spectrum Disorders, 5(1), 210–217. https://doi.org/10.1016/j.rasd.2010.03.013.CrossRefGoogle Scholar
- Falkmer, T., Dahlman, J., Dukic, T., Bjällmark, A., & Larsson, M. (2008). Fixation identification in centroid versus start-point modes using eye-tracking data. Perceptual and Motor Skills, 106(3), 710–724. https://doi.org/10.2466/pms.106.3.710-724.CrossRefPubMedGoogle Scholar
- Fridenson-Hayo, S., Berggren, S., Lassalle, A., Tal, S., Pigat, D., Bölte, S., et al. (2016). Basic and complex emotion recognition in children with autism: Cross-cultural findings. Molecular Autism, 7(1), 52. https://doi.org/10.1186/s13229-016-0113-9.CrossRefPubMedPubMedCentralGoogle Scholar
- Frith, U., & Blakemore, S. (2006). Social cognition. In L. Tarassenko & M. Kenward (Eds.), Cognitive systems—Information processing meets brain science (pp. 138–162). London: Academic Press.CrossRefGoogle Scholar
- Gepner, B., Deruelle, C., & Grynfeltt, S. (2001). Motion and emotion: A novel approach to the study of face processing by young autistic children. Journal of Autism and Developmental Disorders, 31(1), 37–45. https://doi.org/10.1023/A:1005609629218.CrossRefPubMedGoogle Scholar
- Golan, O., Baron-Cohen, S., & Golan, Y. (2008). The ‘Reading the Mind in Films’ task [child version]: Complex emotion and mental state recognition in children with and without autism spectrum conditions. Journal of Autism and Developmental Disorders, 38(8), 1534–1541. https://doi.org/10.1007/s10803-007-0533-7.CrossRefPubMedGoogle Scholar
- Golan, O., Baron-Cohen, S., & Hill, J. (2006a). The Cambridge Mindreading (CAM) Face-Voice Battery: Testing complex emotion recognition in adults with and without Asperger syndrome. Journal of Autism and Developmental Disorders, 36(2), 169–183. https://doi.org/10.1007/s10803-005-0057-y.CrossRefPubMedGoogle Scholar
- Golan, O., Baron-Cohen, S., Hill, J. J., & Golan, Y. (2006b). The “Reading the Mind in Films” task: Complex emotion recognition in adults with and without autism spectrum conditions. Social Neuroscience, 1(2), 111–123. https://doi.org/10.1080/17470910600980986.CrossRefPubMedGoogle Scholar
- Griffiths, S., Jarrold, C., Penton-Voak, I. S., Woods, A. T., Skinner, A. L., & Munafò, (2017). Impaired recognition of basic emotions from facial expressions in young people with autism spectrum disorder: Assessing the importance of expression intensity. Journal of Autism and Developmental Disorders. https://doi.org/10.1007/s10803-017-3091-7.CrossRefPubMedCentralGoogle Scholar
- Guillon, Q., Hadjikhani, N., Baduel, S., & Rogé, B. (2014). Visual social attention in autism spectrum disorder: Insights from eye tracking studies. Neuroscience and Biobehavioral Reviews, 42, 279–297. https://doi.org/10.1016/j.neubiorev.2014.03.013.CrossRefPubMedGoogle Scholar
- Harms, M. B., Martin, A., & Wallace, G. L. (2010). Facial emotion recognition in autism spectrum disorders: A review of behavioral and neuroimaging studies. Neuropsychology Review, 20(3), 290–322. https://doi.org/10.1007/s11065-010-9138-6.CrossRefPubMedGoogle Scholar
- Hillier, A., & Allinson, L. (2002). Understanding embarrassment among those with autism: Breaking down the complex emotion of embarrassment among those with autism. Journal of Autism and Developmental Disorders, 32(6), 583–592.CrossRefPubMedGoogle Scholar
- Joosten, A., Girdler, S., Albrecht, M. A., Horlin, C., Falkmer, M., Leung, D., et al. (2016). Gaze and visual search strategies of children with Asperger syndrome/high functioning autism viewing a magic trick. Developmental Neurorehabilitation, 19(2), 95–102. https://doi.org/10.3109/17518423.2014.913081.CrossRefPubMedGoogle Scholar
- Kliemann, D., Rosenblau, G., Bӧlte, S., Heekeren, H., & Dziobek, I. (2013). Face puzzle—Two new video-based tasks for measuring explicit and implicit aspects of facial emotion recognition. Frontiers in Psychology, 4, 376.CrossRefPubMedPubMedCentralGoogle Scholar
- Klin, A. (2000). Attributing social meaning to ambiguous visual stimuli in higher-functioning autism and Asperger syndrome: The social attribution task. Journal of Child Psychology and Psychiatry, 41(7), 831–846.CrossRefPubMedGoogle Scholar
- Klin, A., Jones, W., Schultz, R., Volkmar, F., & Cohen, D. (2002). Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Archives of General Psychiatry, 59(9), 809–816.CrossRefPubMedGoogle Scholar
- Kuhn, G., Kourkoulou, A., & Leekam, S. R. (2010). How magic changes our expectations about autism. Psychological Science, 21(10), 1487–1493. https://doi.org/10.1177/0956797610383435.CrossRefPubMedGoogle Scholar
- Leung, D., Ordqvist, A., Falkmer, T., Parsons, R., & Falkmer, M. (2013). Facial emotion recognition and visual search strategies of children with high functioning autism and Asperger syndrome. Research in Autism Spectrum Disorders, 7(7), 833–844. https://doi.org/10.1016/j.rasd.2013.03.009.CrossRefGoogle Scholar
- Lozier, L. M., Vanmeter, J. W., & Marsh, A. A. (2014). Impairments in facial affect recognition associated with autism spectrum disorders: A meta-analysis. Development and Psychopathology, 26(4), 933–945. https://doi.org/10.1017/S0954579414000479.CrossRefPubMedGoogle Scholar
- Magnée, M. J. C. M., de Gelder, B., van Engeland, H., & Kemner, C. (2011). Multisensory integration and attention in autism spectrum disorder: Evidence from event-related potentials. PLoS ONE, 6(8), e24196. https://doi.org/10.1371/journal.pone.0024196.CrossRefPubMedPubMedCentralGoogle Scholar
- Mathersul, D., McDonald, S., & Rushby, J. A. (2013). Understanding advanced theory of mind and empathy in high-functioning adults with autism spectrum disorder. Journal of Clinical and Experimental Neuropsychology, 35(6), 655–668. https://doi.org/10.1080/13803395.2013.809700.CrossRefPubMedGoogle Scholar
- McCabe, K. L., Melville, J. L., Rich, D., Strutt, P. A., Cooper, G., Loughland, C. M., et al. (2013). Divergent patterns of social cognition performance in autism and 22q11.2 deletion syndrome (22q11DS). Journal of Autism and Developmental Disorders, 43(8), 1926–1934.CrossRefPubMedGoogle Scholar
- McCrimmon, A. W., & Smith, A. D. (2012). Review of the Wechsler Abbreviated Scale of Intelligence, second edition (WASI-II). Journal of Psychoeducational Assessment, 31(3), 337–341.CrossRefGoogle Scholar
- Mondloch, C. J., Geldart, S., Maurer, D., & Grand, R. L. (2003). Developmental changes in face processing skills. Journal of Experimental Child Psychology, 86(1), 67–84. https://doi.org/10.1016/S0022-0965(03)00102-4.CrossRefPubMedGoogle Scholar
- Müller, N., Baumeister, S., Dziobek, I., Banaschewski, T., & Poustka, L. (2016). Validation of the Movie for the Assessment of Social Cognition in adolescents with ASD: Fixation duration and pupil dilation as predictors of performance. Journal of Autism and Developmental Disorders, 46(9), 2831–2844. https://doi.org/10.1007/s10803-016-2828-z.CrossRefPubMedGoogle Scholar
- Murray, K., Johnston, K., Cunnane, H., Kerr, C., Spain, D., Gillan, N., et al. (2017). A new test of advanced theory of mind: The “Strange Stories Film Task” captures social processing differences in adults with autism spectrum disorders. Autism Research, 10(6), 1120–1132. https://doi.org/10.1002/aur.1744.CrossRefPubMedGoogle Scholar
- Nakano, T., Tanaka, K., Endo, Y., Yamane, Y., Yamamoto, T., Nakano, Y., et al. (2010). Atypical gaze patterns in children and adults with autism spectrum disorders dissociated from developmental changes in gaze behaviour. Proceedings Biological Sciences, 277(1696), 2935–2943. https://doi.org/10.1098/rspb.2010.0587.CrossRefPubMedPubMedCentralGoogle Scholar
- Nuske, H. J., Vivanti, G., & Dissanayake, C. (2013). Are emotion impairments unique to, universal, or specific in autism spectrum disorder? A comprehensive review. Cognition and Emotion, 27(6), 1042–1061. https://doi.org/10.1080/02699931.2012.762900.CrossRefPubMedGoogle Scholar
- Pelphrey, K. A., Morris, J. P., McCarthy, G., & LaBar, K. S. (2007). Perception of dynamic changes in facial affect and identity in autism. Social Cognitive and Affective Neuroscience, 2(2), 140–149.CrossRefPubMedPubMedCentralGoogle Scholar
- Peterson, C. C., Slaughter, V., & Brownell, C. (2015). Children with autism spectrum disorder are skilled at reading emotion body language. Journal of Experimental Child Psychology, 139, 35–50. https://doi.org/10.1016/j.jecp.2015.04.012.CrossRefPubMedGoogle Scholar
- Rice, K., Moriuchi, J. M., Jones, W., & Klin, A. (2012). Parsing heterogeneity in autism spectrum disorders: Visual scanning of dynamic social scenes in school-aged children. Journal of the American Academy of Child and Adolescent Psychiatry, 51(3), 238–248. https://doi.org/10.1016/j.jaac.2011.12.017.CrossRefPubMedPubMedCentralGoogle Scholar
- Rosenblau, G., Kliemann, D., Heekeren, H. R., & Dziobek, I. (2015). Approximating implicit and explicit mentalizing with two naturalistic video-based tasks in typical development and autism spectrum disorder. Journal of Autism and Developmental Disorders, 45(4), 953–965. https://doi.org/10.1007/s10803-014-2249-9.CrossRefPubMedGoogle Scholar
- Sato, W., Sawada, R., Uono, S., Yoshimura, S., Kochiyama, T., Kubota, Y., et al. (2017). Impaired detection of happy facial expressions in autism. Scientific Reports, 7(13340), 1–12. https://doi.org/10.1038/s41598-017-11900-y.CrossRefGoogle Scholar
- Senju, A. (2013). Atypical development of spontaneous social cognition in autism spectrum disorders. Brain and Development, 35(2), 96–101. https://doi.org/10.1016/j.braindev.2012.08.002.CrossRefPubMedGoogle Scholar
- Spezio, M. L., Adolphs, R., Hurley, R. S. E., & Piven, J. (2007). Abnormal use of facial information in high-functioning autism. Journal of Autism and Developmental Disorders, 37(5), 929–939. https://doi.org/10.1007/s10803-006-0232-9.CrossRefPubMedGoogle Scholar
- Tardif, C., Lainé, F., Rodriguez, M., & Gepner, B. (2007). Slowing down presentation of facial movements and vocal sounds enhances facial expression recognition and induces facial–vocal imitation in children with autism. Journal of Autism and Developmental Disorders, 37(8), 1469–1484. https://doi.org/10.1007/s10803-006-0223-x.CrossRefPubMedGoogle Scholar
- Tracy, J. L., Robins, R. W., Schriber, R. A., & Solomon, M. (2011). Is emotion recognition impaired in individuals with autism spectrum disorders? Journal of Autism and Developmental Disorders, 41(1), 102–109. https://doi.org/10.1007/s10803-010-1030-y.CrossRefPubMedGoogle Scholar
- Uljarevic, M., & Hamilton, A. (2013). Recognition of emotions in autism: A formal meta-analysis. Journal of Autism and Developmental Disorders, 43(7), 1517–1526. https://doi.org/10.1007/s10803-012-1695-5.CrossRefPubMedGoogle Scholar
- Walker-Andrews, A. S. (1998). Emotions and social development: Infants’ recognition of emotions in others. Pediatrics 102(5), 1268–1271.PubMedGoogle Scholar
- Wechsler, D. (2011). Wechsler Abbreviated Scale of Intelligence-second edition (WASI-II). San Antonio: NCS Pearson.Google Scholar
- Whitehouse, A. J. O., Evans, K., Eapen, V., Prior, M., & Wray, J. (2018). A national guideline for the assessment and diagnosis of autism spectrum disorders in Australia. Cooperative Research Centre for Living with Autism (Autism CRC). Retrieved from https://www.autismcrc.com.au/knowledge-centre/resource/national-guideline?j=158619&sfmc_sub=27540273&l=103_HTML&u=2392185&mid=7286130&jb=1.
- Williams, B. T., & Gray, K. M. (2013). The relationship between emotion recognition ability and social skills in young children with autism. Autism, 17(6), 762–768. https://doi.org/10.1177/1362361312465355.CrossRefPubMedGoogle Scholar
- Young-Browne, G., Rosenfeld, H. M., & Horowitz, F. D. (1977). Infant discrimination of facial expressions. Child Development, 48(2), 555–562.CrossRefGoogle Scholar