Experimental Brain Research

, Volume 236, Issue 4, pp 973–984 | Cite as

Individual differences and the effect of face configuration information in the McGurk effect

Research Article

Abstract

The McGurk effect, which denotes the influence of visual information on audiovisual speech perception, is less frequently observed in individuals with autism spectrum disorder (ASD) compared to those without it; the reason for this remains unclear. Several studies have suggested that facial configuration context might play a role in this difference. More specifically, people with ASD show a local processing bias for faces—that is, they process global face information to a lesser extent. This study examined the role of facial configuration context in the McGurk effect in 46 healthy students. Adopting an analogue approach using the Autism-Spectrum Quotient (AQ), we sought to determine whether this facial configuration context is crucial to previously observed reductions in the McGurk effect in people with ASD. Lip-reading and audiovisual syllable identification tasks were assessed via presentation of upright normal, inverted normal, upright Thatcher-type, and inverted Thatcher-type faces. When the Thatcher-type face was presented, perceivers were found to be sensitive to the misoriented facial characteristics, causing them to perceive a weaker McGurk effect than when the normal face was presented (this is known as the McThatcher effect). Additionally, the McGurk effect was weaker in individuals with high AQ scores than in those with low AQ scores in the incongruent audiovisual condition, regardless of their ability to read lips or process facial configuration contexts. Our findings, therefore, do not support the assumption that individuals with ASD show a weaker McGurk effect due to a difficulty in processing facial configuration context.

Keywords

Autism spectrum quotient McGurk effect Thatcher illusion 

Notes

Acknowledgements

We would like to express our gratitude to Dr. I. Dan and M. K. Yamaguchi. We would also like to thank all of the students who participated in our experiments. This study was supported by a Grant-in-Aid for the Japan Society for the Promotion of Science Fellows (Grant No. 26-8144) and Grant-in-Aid for Research Activity Start-up (Grant No. 16H0720). The research results have been achieved by “Research and development of technology for enhancing functional recovery of elderly and disabled people based on non-invasive brain imaging and robotic assistive devices”, the Commissioned Research of National Institute of Information and Communications Technology (NICT), Japan.

Author contributions

All authors contributed to construction of the study design. Testing and data collection were performed by YU and data analysis and interpretation were performed by YU under the supervision of TA and AW, SH drafted the manuscript, and TA and AW provided critical revisions. All authors approved the final version of the manuscript for submission.

Compliance with ethical standards

Conflict of interest

The authors have no competing financial interests to declare.

References

  1. American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders, 5th edn. American Psychiatric Association, Washington, DCGoogle Scholar
  2. Austin EJ (2005) Personality correlates of the broader autism phenotype as assessed by the Autism Spectrum Quotient (AQ). Pers Individ Dif 38:451–460.  https://doi.org/10.1016/j.paid.2004.04.022 CrossRefGoogle Scholar
  3. Baron-Cohen S (1995) Mindblindness: an essay on autism and theory of mind. MIT Press, CambridgeGoogle Scholar
  4. Baron-Cohen S, Wheelwright S, Skinner R, Martin J, Clubley E (2001) The Autism-Spectrum Quotient (AQ): evidence from Asperger syndrome/high-functioning autism, males and females, scientists and mathematicians. J Autism Dev Disord 31:5–17.  https://doi.org/10.1023/A:1005653411471 CrossRefPubMedGoogle Scholar
  5. Baron-Cohen S, Scott J, Allison C, Williams J, Bolton P, Matthews FE, Brayne C (2009) Prevalence of autism-spectrum conditions: UK school-based population study. Br J Psychiatry 194:500–509.  https://doi.org/10.1192/bjp.bp.108.059345 CrossRefPubMedGoogle Scholar
  6. Bebko JM, Schroeder JH, Weiss JA (2014) The McGurk effect in children with autism and asperger syndrome. Autism Res 7:50–59.  https://doi.org/10.1002/aur.1343 CrossRefPubMedGoogle Scholar
  7. Bruce V, Young A (1986) Understanding face recognition. Br J Psychol 77:305–327.  https://doi.org/10.1111/j.2044-8295.1986.tb02199.x CrossRefPubMedGoogle Scholar
  8. Calvert GA, Campbell R, Brammer MJ (2000) Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr Biol 10(11):649–657.  https://doi.org/10.1016/s0960-9822(00)00513-3 CrossRefPubMedGoogle Scholar
  9. de Gelder BD, Bertelson P (2003) Multisensory integration, perception, and ecological validity. Trends Cogn Sci 7(10):460–467.  https://doi.org/10.1016/j.tics.2003.08.014 CrossRefPubMedGoogle Scholar
  10. de Gelder B, Vroomen J, van der Heide L (1991) Face recognition and lip-reading in autism. Eur J Cogn Psychol 3:69–86.  https://doi.org/10.1080/09541449108406220 CrossRefGoogle Scholar
  11. Deruelle C, Rondan C, Gepner B, Tardif C (2004) Spatial frequency and face processing in children with autism and Asperger syndrome. J Autism Dev Disord 34:199–210.  https://doi.org/10.1023/b:jadd.0000022610.09668.4c CrossRefPubMedGoogle Scholar
  12. Donohue SE, Darling EF, Mitroff SR (2012) Links between multisensory processing and autism. Exp Brain Res 222(4):377–387.  https://doi.org/10.1007/s00221-012-3223-4 CrossRefPubMedGoogle Scholar
  13. Eskelund K, MacDonald EN, Andersen TS (2015) Face configuration affects speech perception: evidence from a McGurk mismatch negativity study. Neuropsychologia 66:48–54.  https://doi.org/10.1016/j.neuropsychologia.2014.10.021 CrossRefPubMedGoogle Scholar
  14. Foxe JJ, Molholm S, Del Bene VA, Frey HP, Russo NN, Blanco D, Saint-Amour D, Ross LA (2015) Severe multisensory speech integration deficits in high-functioning school-aged children with autism spectrum disorder (ASD) and their resolution during early adolescence. Cereb Cortex 25:298–312.  https://doi.org/10.1093/cercor/bht213 CrossRefPubMedGoogle Scholar
  15. Frith U (1991) Autism and Asperger’s syndrome. Cambridge University Press, CambridgeCrossRefGoogle Scholar
  16. Happé F, Frith U (2006) The weak coherence account: detail-focused cognitive style in Autism spectrum disorders. J Autism Dev Disord 36(1):5–25CrossRefPubMedGoogle Scholar
  17. Hasegawa C, Kikuchi M, Yoshimura Y, Hiraishi H, Munesue T, Nakatani H, Higashida H, Asada M, Oi M, Minabe Y (2015) Broader autism phenotype in mothers predicts social responsiveness in young children with autism spectrum disorders. Psychiatry Clin Neurosci 69:136–144.  https://doi.org/10.1111/pcn.12210 CrossRefPubMedGoogle Scholar
  18. Hietanen JK, Manninen P, Sams M, Surakka V (2001) Does audiovisual speech perception use information about facial configuration? Eur J Cogn Psychol 13:395–407.  https://doi.org/10.1080/09541440042000025 CrossRefGoogle Scholar
  19. Hoekstra RA, Bartels M, Cath DC, Boomsma DI (2008) Factor structure, reliability and criterion validity of the Autism-Spectrum Quotient (AQ): a study in Dutch population and patient groups. J Autism Dev Disord 38:1555–1566.  https://doi.org/10.1007/s10803-008-0538-x CrossRefPubMedCentralPubMedGoogle Scholar
  20. Iarocci G, Rombough A, Yager J, Weeks D, Chua R (2010) Visual influences on speech perception in children with autism. Autism 14:305–320.  https://doi.org/10.1177/1362361309353615 CrossRefPubMedGoogle Scholar
  21. Jordan TR, Bevan K (1997) Seeing and hearing rotated faces: influences official orientation on visual and audiovisual speech recognition. J Exp Psychol Hum Percept Perform 23:388–403.  https://doi.org/10.1037//0096-1523.23.2.388 CrossRefPubMedGoogle Scholar
  22. Jordan TR, Thomas SM (2011) When half a face is as good as a whole: effects of simple substantial occlusion on visual and audiovisual speech perception. Atten Percept Psychophys 73:2270–2285.  https://doi.org/10.3758/s13414-011-0152-4 CrossRefPubMedGoogle Scholar
  23. Joseph RM, Tanaka J (2002) Holistic and part-based face recognition in children with autism. J Child Psychol Psychiatry 43:1–14CrossRefGoogle Scholar
  24. Joseph RM, Tanaka J (2003) Holistic and part-based face recognition in children with autism. J Child Psychol Psychiatry 44:529–542.  https://doi.org/10.1111/1469-7610.00142 CrossRefPubMedGoogle Scholar
  25. Kamio Y, Inada N, Moriwaki A, Kuroda M, Koyama T, Tsujii H, Kawakubo Y, Kuwabara H, Tsuchiya KJ, Uno Y, Constantino JN (2012) Quantitative autistic traits ascertained in a national survey of 22529 Japanese schoolchildren. Acta Psychiatr Scand 128:45–53.  https://doi.org/10.1111/acps.12034 CrossRefPubMedCentralPubMedGoogle Scholar
  26. Kätsyri J, Saalasti S, Tiippana K, von Wendt L, Sams M (2008) Impaired recognition of facial emotions from low-spatial frequencies in Asperger syndrome. Neuropsychologia 46:1888–1897.  https://doi.org/10.1016/j.neuropsychologia.2008.01.005 CrossRefPubMedGoogle Scholar
  27. Kikuchi Y, Senju A, Hasegawa T, Tojo Y, Osanai H (2013) The effect of spatial frequency and face inversion on facial expression processing in children with autism spectrum disorder. Jpn Psychol Res 55:118–130.  https://doi.org/10.1111/jpr.12000 CrossRefGoogle Scholar
  28. Kose S, Bora E, Erermiş S, Özbaran B, Bildik T, Aydın C (2013) Broader autistic phenotype in parents of children with autism: Autism Spectrum Quotient-Turkish version. Psychiatry Clin Neurosci 67:20–27.  https://doi.org/10.1111/pcn.12005 CrossRefPubMedGoogle Scholar
  29. Lau WYP, Kelly AB, Peterson CC (2013) Further evidence on the factorial structure of the autism spectrum quotient (AQ) for adults with and without a clinical diagnosis of autism. J Autism Dev Disord 43:2807–2815.  https://doi.org/10.1007/s10803-013-1827-6 CrossRefPubMedGoogle Scholar
  30. McGurk H, MacDonald JW (1976) Hearing lips and seeing voices. Nature 264:746–748.  https://doi.org/10.1038/264746a0 CrossRefPubMedGoogle Scholar
  31. Nath AR, Beauchamp MS (2011) Dynamic changes in superior temporal sulcus connectivity during perception of noisy audiovisual speech. J Neurosci 31:1704–1714CrossRefPubMedCentralPubMedGoogle Scholar
  32. Palmer CJ, Paton B, Hohwy J, Entricott PJ (2013) Movement under uncertainty: the effects of the rubber-hand illusion vary along the nonclinical autism spectrum. Neuropsychologia 51:1942–1951.  https://doi.org/10.1016/j.neuropsychologia.2013.06.020 CrossRefPubMedGoogle Scholar
  33. Paton B, Hohwy J, Entricott PJ (2012) The rubber hand illusion reveals proprioceptive and sensorimotor differences in autism spectrum disorders. J Autism Dev Disord 42:1870–1883.  https://doi.org/10.1007/s10803-011-1430-7 CrossRefPubMedGoogle Scholar
  34. Redcay E (2008) The superior temporal sulcus performs a common function for social and speech perception: implications for the emergence of autism. Neurosci Biobehav Rev 32(1):123–142CrossRefPubMedGoogle Scholar
  35. Reed P, Lowe C, Everett R (2011) Perceptual learning and perceptual search are altered in male university students with higher Autism Quotient scores. Pers Individ Dif 51:732–736.  https://doi.org/10.1016/j.paid.2011.06.016 CrossRefGoogle Scholar
  36. Rosenblum LD, Schmuckler MA, Johnson JA (1997) The McGurk effect in infants. Percep Psychophys 59(3):347–357.  https://doi.org/10.3758/bf03211902 CrossRefGoogle Scholar
  37. Rosenblum LD, Yakel DA, Green KG (2000) Face and mouth inversion effects on visual and audiovisual speech perception. J Exp Psychol Hum Percept Perform 26:806–819.  https://doi.org/10.1037//0096-1523.26.2.806 CrossRefPubMedGoogle Scholar
  38. Rosenblum LD, Yakel DA, Baseer N, Panchal A, Nodarse BC, Niehus RP (2002) Visual speech information for face recognition. Percept Psychophys 64:220–229.  https://doi.org/10.3758/bf03195788 CrossRefPubMedGoogle Scholar
  39. Rouse H, Donnelly N, Hadwin JA, Brown T (2004) Do children with autism perceive second-order relational features? The case of the Thatcher illusion. J Child Psychol Psychiatry 45:1246–1257.  https://doi.org/10.1111/j.1469-7610.2004.00317.x CrossRefPubMedGoogle Scholar
  40. Russell-Smith SN, Maybery MT, Bayliss DM, Sng AAH (2012) Support for a link between the local processing bias and social deficits in autism: an investigation of embedded figures test performance in non-clinical individuals. J Autism Dev Disord 42(11):2420–2430.  https://doi.org/10.1007/s10803-012-1506-z CrossRefPubMedGoogle Scholar
  41. Rutherford MD, Clements KA, Sekuler AB (2007) Differences in discrimination of eye and mouth displacement in autism spectrum disorders. Vis Res 47:2099–2110.  https://doi.org/10.1016/j.visres.2007.01.029 CrossRefPubMedGoogle Scholar
  42. Saalasti S, Tiippana K, Kätsyri J, Sams M (2011) The effect of visual spatial attention on audiovisual speech perception in adults with Asperger syndrome. Exp Brain Res 213:283–290.  https://doi.org/10.1007/s00221-012-3029-4 CrossRefPubMedGoogle Scholar
  43. Saalasti S, Kätsyri J, Tiippana K, Laine-Hernandez M, von Wendt L, Sams M (2012) Audiovisual speech perception and eye gaze behaviour of adults with Asperger syndrome. J Autism Dev Disord 42:1606–1615.  https://doi.org/10.1007/s10803-011-1400-0 CrossRefPubMedGoogle Scholar
  44. Sekiyama K (1994) Differences in auditory-visual speech perception between Japanese and Americans: McGurk effect as a function of incompatibility. J Acoust Soc Jpn 15:143–158.  https://doi.org/10.1250/ast.15.143 CrossRefGoogle Scholar
  45. Sekiyama K (1997) Cultural and linguistic factors in audiovisual speech processing: the McGurk effect in Chinese subjects. Percept Psychophys 59:73–80.  https://doi.org/10.3758/bf03206849 CrossRefPubMedGoogle Scholar
  46. Sekiyama K, Burnham D (2008) Impact of language on development of auditory-visual speech perception. Dev Sci 11:303–317.  https://doi.org/10.1111/j.1467-7687.2008.00677.x CrossRefGoogle Scholar
  47. Sekiyama K, Tohkura Y (1991) McGurk effect in non-English listeners: few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility. J Acoust Soc Am 90:1797–1805.  https://doi.org/10.1121/1.401660 CrossRefPubMedGoogle Scholar
  48. Smith EG, Bennetto L (2007) Audiovisual speech integration and lipreading in autism. J Child Psychol Psychiatr 48:813–821CrossRefGoogle Scholar
  49. Stevenson RA, Siemann JK, Woynaroski TG, Schneider BC, Eberly HE, Camarata SM, Wallace MT (2014a) Brief report: arrested development of audiovisual speech perception in autism spectrum disorders. J Autism Dev Disord 44:1470–1477.  https://doi.org/10.1007/s10803-013-1992-7 CrossRefPubMedCentralPubMedGoogle Scholar
  50. Stevenson RA, Siemann JK, Schneider BC, Eberly HE, Woynaroski TG, Camarata SM, Wallace MT (2014b) Multisensory temporal integration in autism spectrum disorders. J Neurosci 34:691–697.  https://doi.org/10.1523/jneurosci.3615-13.2014 CrossRefPubMedCentralPubMedGoogle Scholar
  51. Stewart ME, Ota M (2008) Lexical effects on speech perception in individuals with “autistic” traits. Cognition 109(1):157–162.  https://doi.org/10.1016/j.cognition.2008.07.010 CrossRefPubMedGoogle Scholar
  52. Suda M, Takei Y, Aoyama Y, Narita K, Sakurai N, Fukuda M, Mikuni M (2011) Autistic traits and brain activation during face-to-face conversations in typically developed adults. PloS One 6:e20021.  https://doi.org/10.1371/journal.pone.0020021 CrossRefPubMedCentralPubMedGoogle Scholar
  53. Sumby WH, Pollack I (1954) Visual contribution to speech intelligibility in noise. J Acoust Soc Am 26(2):212–215.  https://doi.org/10.1121/1.1907309 CrossRefGoogle Scholar
  54. Taylor N, Isaac C, Milne E (2010) A comparison of the development of audiovisual integration in children with autism spectrum disorders and typically developing children. J Autism Dev Disord 40:1403–1411.  https://doi.org/10.1007/s10803-010-1000-4 CrossRefPubMedGoogle Scholar
  55. Teunisse JP, de Gelder B (2003) Face processing in adolescents with autistic disorder: the inversion and composite effects. Brain Cogn 52:285–294.  https://doi.org/10.1016/s0278-2626(03)00042-3 CrossRefPubMedGoogle Scholar
  56. Thomas SM, Jordan TR (2004) Contributions of oral and extraoral facial movement to visual and audiovisual speech perception. J Exp Psychol Hum Percept Perform 30:873–888.  https://doi.org/10.1037/0096-1523.30.5.873 CrossRefPubMedGoogle Scholar
  57. Thompson P (1980) Margaret Thatcher: a new illusion. Perception 9:483–484CrossRefPubMedGoogle Scholar
  58. Ujiie Y, Wakabayashi A (2015) Psychometric properties and overlap of the GSQ and AQ among Japanese university students. Int J Psychol Stud 7(2):195–205.  https://doi.org/10.5539/ijps.v7n2p195 CrossRefGoogle Scholar
  59. Ujiie Y, Asai T, Tanaka A, Wakabayashi A (2015a) The McGurk effect and autistic traits: an analogue perspective. Lett Evol Behav Sci 6:9–12.  https://doi.org/10.5178/lebs.2015.34 CrossRefGoogle Scholar
  60. Ujiie Y, Asai T, Wakabayashi A (2015b) The relationship between level of autistic traits and local bias in the context of the McGurk effect. Front Psychol 6:891.  https://doi.org/10.3389/fpsyg.2015.00891 CrossRefPubMedCentralPubMedGoogle Scholar
  61. Wakabayashi A, Baron-Cohen S, Wheelwright S, Tojo Y (2006) The Autism-Spectrum Quotient (AQ) in Japan: a cross-cultural comparison. J Autism Dev Disord 36:263–270.  https://doi.org/10.1007/s10803-005-0061-2 CrossRefPubMedGoogle Scholar
  62. Williams JHG, Massaro DW, Peel NJ, Bosseler A, Suddendorf T (2004) Visual–auditory integration during speech imitation in autism. Res Dev Disabil 25:559–575.  https://doi.org/10.1016/j.ridd.2004.01.008 CrossRefPubMedGoogle Scholar
  63. Woynaroski TG, Kwakye LD, Foss-Feig JH, Stevenson RA, Stone WL, Wallace MT (2013) Multisensory speech perception in children with autism spectrum disorders. J Autism Dev Disord 43:2891–2902.  https://doi.org/10.1007/s10803-013-1836-5 CrossRefPubMedCentralPubMedGoogle Scholar
  64. Zilbovicius M, Meresse I, Chabane N, Brunelle F, Samson Y, Boddaert N (2006) Autism, the superior temporal sulcus and social perception. Trends Neurosci 29(7):359–366CrossRefPubMedGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Research and Development InitiativeChuo UniversityBunkyoJapan
  2. 2.Graduate School of Advanced Integration ScienceChiba UniversityChibaJapan
  3. 3.Cognitive Mechanisms LaboratoriesAdvanced Telecommunications Research Institute International (ATR)Keihanna ScienceJapan
  4. 4.Faculty of LettersChiba UniversityChibaJapan

Personalised recommendations