Experimental Brain Research

, Volume 236, Issue 4, pp 1161–1179 | Cite as

Does hearing aid use affect audiovisual integration in mild hearing impairment?

  • Anja Gieseler
  • Maike A. S. Tahden
  • Christiane M. Thiel
  • Hans Colonius
Research Article

Abstract

There is converging evidence for altered audiovisual integration abilities in hearing-impaired individuals and those with profound hearing loss who are provided with cochlear implants, compared to normal-hearing adults. Still, little is known on the effects of hearing aid use on audiovisual integration in mild hearing loss, although this constitutes one of the most prevalent conditions in the elderly and, yet, often remains untreated in its early stages. This study investigated differences in the strength of audiovisual integration between elderly hearing aid users and those with the same degree of mild hearing loss who were not using hearing aids, the non-users, by measuring their susceptibility to the sound-induced flash illusion. We also explored the corresponding window of integration by varying the stimulus onset asynchronies. To examine general group differences that are not attributable to specific hearing aid settings but rather reflect overall changes associated with habitual hearing aid use, the group of hearing aid users was tested unaided while individually controlling for audibility. We found greater audiovisual integration together with a wider window of integration in hearing aid users compared to their age-matched untreated peers. Signal detection analyses indicate that a change in perceptual sensitivity as well as in bias may underlie the observed effects. Our results and comparisons with other studies in normal-hearing older adults suggest that both mild hearing impairment and hearing aid use seem to affect audiovisual integration, possibly in the sense that hearing aid use may reverse the effects of hearing loss on audiovisual integration. We suggest that these findings may be particularly important for auditory rehabilitation and call for a longitudinal study.

Keywords

Flash illusion Fission Window of integration Multisensory integration Hearing loss Aging 

Notes

Acknowledgements

The authors would like to thank the Hörzentrum Oldenburg GmbH for data acquisition. Particularly, we acknowledge Kirsten C. Wagener, Matthias Vormann, Michael Schulte, and Niklas Grunewald for their support and helpful comments. We also thank Ladan Shams for the suggestions regarding the signal detection theory analysis. Furthermore, we would like to thank the reviewers for their valuable comments, effort, and time.

Author contributions

AG and MT prepared the study. Data acquisition was conducted by the Hörzentrum Oldenburg GmbH. AG conceptualized the research question, analyzed the data, interpreted the results, wrote the manuscript, and prepared the figures and tables. CT and HC supervised the work. MT, CT, and HC critically reviewed and significantly contributed to the manuscript. All authors approved the final version of the manuscript for publication. All authors agree to be accountable for all aspects of the work and in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Compliance with ethical standards

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

All procedures performed in this study were approved by the institutional review board of the University of Oldenburg and in accordance with the ethical standards of with the Declaration of Helsinki.

Informed consent

All participants gave their written informed consent prior to the study.

Supplementary material

221_2018_5206_MOESM1_ESM.docx (18 kb)
Supplementary material 1 (DOCX 18 KB)

References

  1. Akeroyd MA (2008) Are individual differences in speech reception related to individual differences in cognitive ability? A survey of twenty experimental studies with normal and hearing-impaired adults. Int J Audiol 47(Suppl 2):S53-71.  https://doi.org/10.1080/14992020802301142 PubMedGoogle Scholar
  2. Alais D, Burr D (2004) The ventriloquist effect results from near-optimal bimodal integration. Curr Biol 14:257–262.  https://doi.org/10.1016/j.cub.2004.01.029 PubMedCrossRefGoogle Scholar
  3. Andersen GJ (2012) Aging and vision: changes in function and performance from optics to perception. Wiley Interdiscip Rev Cogn Sci 3:403–410.  https://doi.org/10.1002/wcs.1167 PubMedPubMedCentralCrossRefGoogle Scholar
  4. Andersen TS, Tiippana K, Sams M (2004) Factors influencing audiovisual fission and fusion illusions. Brain Res Cogn Brain Res 21:301–308.  https://doi.org/10.1016/j.cogbrainres.2004.06.004 PubMedCrossRefGoogle Scholar
  5. Anderson CA, Lazard DS, Hartley DE (2017) Plasticity in bilateral superior temporal cortex: effects of deafness and cochlear implantation on auditory and visual speech processing. Hear Res 343:138–149.  https://doi.org/10.1016/j.heares.2016.07.013 PubMedCrossRefGoogle Scholar
  6. Apthorp D, Alais D, Boenke LT (2013) Flash illusions induced by visual, auditory, and audiovisual stimuli. J Vis.  https://doi.org/10.1167/13.5.3 PubMedGoogle Scholar
  7. Barone P, Deguine O (2012) Multisensory Processing in Cochlear Implant Listeners. In: Zeng F-G, Popper AN, Fay RR (eds) Auditory prostheses: new horizons. Springer, New York, NY, pp 365–381Google Scholar
  8. Baskent D, Bazo D (2011) Audiovisual asynchrony detection and speech intelligibility in noise with moderate to severe sensorineural hearing impairment. Ear Hear 32:582–592.  https://doi.org/10.1097/AUD.0b013e31820fca23 PubMedCrossRefGoogle Scholar
  9. Bernstein JG, Grant KW (2009) Auditory and auditory-visual intelligibility of speech in fluctuating maskers for normal-hearing and hearing-impaired listeners. J Acoust Soc Am 125:3358–3372.  https://doi.org/10.1121/1.3110132 PubMedCrossRefGoogle Scholar
  10. Bernstein LE, Auer ET, Takayanagi S (2004) Auditory speech detection in noise enhanced by lipreading. Speech Commun 44:5–18.  https://doi.org/10.1016/j.specom.2004.10.011 CrossRefGoogle Scholar
  11. Bidelman GM (2016) Musicians have enhanced audiovisual multisensory binding: experience-dependent effects in the double-flash illusion. Exp Brain Res 234:3037–3047.  https://doi.org/10.1007/s00221-016-4705-6 PubMedCrossRefGoogle Scholar
  12. Bishop CW, Miller LM (2009) A multisensory cortical network for understanding speech in noise. J Cogn Neurosci 21:1790–1805.  https://doi.org/10.1162/jocn.2009.21118 PubMedPubMedCentralCrossRefGoogle Scholar
  13. Bizley JK, Maddox RK, Lee AK (2016) Defining auditory-visual objects: behavioral tests and physiological mechanisms. Trends Neurosci 39:74–85.  https://doi.org/10.1016/j.tins.2015.12.007 PubMedPubMedCentralCrossRefGoogle Scholar
  14. Bolognini N, Rossetti A, Casati C, Mancini F, Vallar G (2011) Neuromodulation of multisensory perception: a tDCS study of the sound-induced flash illusion. Neuropsychologia 49:231–237.  https://doi.org/10.1016/j.neuropsychologia.2010.11.015 PubMedCrossRefGoogle Scholar
  15. Bolognini N, Convento S, Casati C, Mancini F, Brighina F, Vallar G (2016) Multisensory integration in hemianopia and unilateral spatial neglect: Evidence from the sound induced flash illusion. Neuropsychologia 87:134–143.  https://doi.org/10.1016/j.neuropsychologia.2016.05.015 PubMedCrossRefGoogle Scholar
  16. Brighina F, Bolognini N, Cosentino G et al (2015) Visual cortex hyperexcitability in migraine in response to sound-induced flash illusions. Neurology 84:2057–2061.  https://doi.org/10.1212/WNL.0000000000001584 PubMedCrossRefGoogle Scholar
  17. Calvert G, Spence C, Stein BE (2004) The handbook of multisensory processes. MIT Press, CambridgeGoogle Scholar
  18. Campbell J, Sharma A (2014) Cross-modal re-organization in adults with early stage hearing loss. PLoS One 9:e90594.  https://doi.org/10.1371/journal.pone.0090594 PubMedPubMedCentralCrossRefGoogle Scholar
  19. Carroll R, Meis M, Schulte M, Vormann M, Kiessling J, Meister H (2015) Development of a German reading span test with dual task design for application in cognitive hearing research. Int J Audiol 54:136–141.  https://doi.org/10.3109/14992027.2014.952458 PubMedCrossRefGoogle Scholar
  20. Chan JS, Kaiser J, Brandl M, Matura S, Prvulovic D, Hogan MJ, Naumer MJ (2015) Expanded temporal binding windows in people with mild cognitive impairment. Curr Alzheimer Res 12:61–68.  https://doi.org/10.2174/1567205012666141218124744 PubMedCrossRefGoogle Scholar
  21. Chan JS, Langer A, Kaiser J (2016) Temporal integration of multisensory stimuli in autism spectrum disorder: a predictive coding perspective. J Neural Transm (Vienna) 123:917–923.  https://doi.org/10.1007/s00702-016-1587-5 CrossRefGoogle Scholar
  22. Chien W, Lin FR (2012) Prevalence of hearing aid use among older adults in the United States. Arch Intern Med 172:292–293.  https://doi.org/10.1001/archinternmed.2011.1408 PubMedPubMedCentralCrossRefGoogle Scholar
  23. Colonius H, Diederich A (2004) Multisensory interaction in saccadic reaction time: a time-window-of-integration model. J Cogn Neurosci 16:1000–1009.  https://doi.org/10.1162/0898929041502733 PubMedCrossRefGoogle Scholar
  24. Colonius H, Diederich A (2011) Computing an optimal time window of audiovisual integration in focused attention tasks: illustrated by studies on effect of age and prior knowledge. Exp Brain Res 212:327–337.  https://doi.org/10.1007/s00221-011-2732-x PubMedCrossRefGoogle Scholar
  25. Colonius H, Diederich A (2018) Formal models and quantitative measures of multisensory integration: a selective overview. Eur J Neurosci.  https://doi.org/10.1111/ejn.13813 Google Scholar
  26. Cuppini C, Magosso E, Bolognini N, Vallar G, Ursino M (2014) A neurocomputational analysis of the sound-induced flash illusion. Neuroimage 92:248–266.  https://doi.org/10.1016/j.neuroimage.2014.02.001 PubMedCrossRefGoogle Scholar
  27. de Haas B, Kanai R, Jalkanen L, Rees G (2012) Grey matter volume in early human visual cortex predicts proneness to the sound-induced flash illusion. Proc Biol Sci 279:4955–4961.  https://doi.org/10.1098/rspb.2012.2132 PubMedPubMedCentralCrossRefGoogle Scholar
  28. de Dieuleveult AL, Siemonsma PC, van Erp JB, Brouwer AM (2017) Effects of aging in multisensory integration: a systematic review. Front Aging Neurosci 9:80.  https://doi.org/10.3389/fnagi.2017.00080 PubMedPubMedCentralCrossRefGoogle Scholar
  29. DeLoss DJ, Pierce RS, Andersen GJ (2013) Multisensory integration, aging, and the sound-induced flash illusion. Psychol Aging 28:802–812.  https://doi.org/10.1037/a0033289 PubMedPubMedCentralCrossRefGoogle Scholar
  30. Diederich A, Colonius H (2004) Bimodal and trimodal multisensory enhancement: effects of stimulus onset and intensity on reaction time. Percept Psychophys 66:1388–1404.  https://doi.org/10.3758/BF03195006 PubMedCrossRefGoogle Scholar
  31. Diederich A, Colonius H, Schomburg A (2008) Assessing age-related multisensory enhancement with the time-window-of-integration model. Neuropsychologia 46:2556–2562.  https://doi.org/10.1016/j.neuropsychologia.2008.03.026 PubMedCrossRefGoogle Scholar
  32. Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415:429–433.  https://doi.org/10.1038/415429a PubMedCrossRefGoogle Scholar
  33. Ernst MO, Bulthoff HH (2004) Merging the senses into a robust percept. Trends Cogn Sci 8:162–169.  https://doi.org/10.1016/j.tics.2004.02.002 PubMedCrossRefGoogle Scholar
  34. Fischer ME, Cruickshanks KJ, Wiley TL, Klein BE, Klein R, Tweed TS (2011) Determinants of hearing aid acquisition in older adults. Am J Public Health 101:1449–1455.  https://doi.org/10.2105/AJPH.2010.300078 PubMedPubMedCentralCrossRefGoogle Scholar
  35. Forster B, Cavina-Pratesi C, Aglioti SM, Berlucchi G (2002) Redundant target effect and intersensory facilitation from visual-tactile interactions in simple reaction time. Exp Brain Res 143:480–487.  https://doi.org/10.1007/s00221-002-1017-9 PubMedCrossRefGoogle Scholar
  36. Foss-Feig JH, Kwakye LD, Cascio CJ, Burnette CP, Kadivar H, Stone WL, Wallace MT (2010) An extended multisensory temporal binding window in autism spectrum disorders. Exp Brain Res 203:381–389.  https://doi.org/10.1007/s00221-010-2240-4 PubMedPubMedCentralCrossRefGoogle Scholar
  37. Gieseler A, Tahden MA, Thiel CM, Wagener KC, Meis M, Colonius H (2017) Auditory and non-auditory contributions for unaided speech recognition in noise as a function of hearing aid use. Front Psychol 8:219.  https://doi.org/10.3389/fpsyg.2017.00219 PubMedPubMedCentralCrossRefGoogle Scholar
  38. Glick H, Sharma A (2017) Cross-modal plasticity in developmental and age-related hearing loss: clinical implications. Hear Res 343:191–201.  https://doi.org/10.1016/j.heares.2016.08.012 PubMedCrossRefGoogle Scholar
  39. Gondan M, Niederhaus B, Rosler F, Roder B (2005) Multisensory processing in the redundant-target effect: a behavioral and event-related potential study. Percept Psychophys 67:713–726.  https://doi.org/10.3758/BF03193527 PubMedCrossRefGoogle Scholar
  40. Grant KW, Walden BE, Seitz PF (1998) Auditory-visual speech recognition by hearing-impaired subjects: consonant recognition, sentence recognition, and auditory-visual integration. J Acoust Soc Am 103:2677–2690.  https://doi.org/10.1121/1.422788 PubMedCrossRefGoogle Scholar
  41. Haase W, Hohmann A (1982) Ein neuer Test (C-Test) zur quantitativen Prüfung der Trennschwierigkeiten (“crowding”)—Ergebnisse bei Amblyopie und Ametropie. Klinische Monatsblätter für Augenheilkunde 180:210–215.  https://doi.org/10.1055/s-2008-1055051 PubMedCrossRefGoogle Scholar
  42. Hamilton RH, Wiener M, Drebing DE, Coslett HB (2013) Gone in a flash: manipulation of audiovisual temporal integration using transcranial magnetic stimulation. Front Psychol 4:571.  https://doi.org/10.3389/fpsyg.2013.00571 PubMedPubMedCentralCrossRefGoogle Scholar
  43. Helbig HB, Ernst MO (2007) Optimal integration of shape information from vision and touch. Exp Brain Res 179:595–606.  https://doi.org/10.1007/s00221-006-0814-y PubMedCrossRefGoogle Scholar
  44. Herbig R, Chalupper J (2010) acceptable processing delay in digital hearing aids. Hearing Review 17:28–31Google Scholar
  45. Hillock AR, Powers AR, Wallace MT (2011) Binding of sights and sounds: age-related changes in multisensory temporal processing. Neuropsychologia 49:461–467.  https://doi.org/10.1016/j.neuropsychologia.2010.11.041 PubMedCrossRefGoogle Scholar
  46. Houtgast T, Festen JM (2008) On the auditory and cognitive functions that may explain an individual’s elevation of the speech reception threshold in noise. Int J Audiol 47:287–295.  https://doi.org/10.1080/14992020802127109 PubMedCrossRefGoogle Scholar
  47. Humes LE (2003) Modeling and predicting hearing aid outcome. Trends Amplif 7:41–75.  https://doi.org/10.1177/108471380300700202 PubMedPubMedCentralCrossRefGoogle Scholar
  48. Huyse A, Leybaert J, Berthommier F (2014) Effects of aging on audio-visual speech integration. J Acoust Soc Am 136:1918–1931.  https://doi.org/10.1121/1.4894685 PubMedCrossRefGoogle Scholar
  49. Kalbe E, Kessler J, Calabrese P, Smith R, Passmore AP, Brand M, Bullock R (2004) DemTect: a new, sensitive cognitive screening test to support the diagnosis of mild cognitive impairment and early dementia. Int J Geriatr Psychiatry 19:136–143.  https://doi.org/10.1002/gps.1042 PubMedCrossRefGoogle Scholar
  50. Kalluri S, Humes LE (2012) Hearing technology and cognition. Am J Audiol 21:338–343.  https://doi.org/10.1044/1059-0889(2012/12-0026) PubMedCrossRefGoogle Scholar
  51. Kumpik DP, Roberts HE, King AJ, Bizley JK (2014) Visual sensitivity is a stronger determinant of illusory processes than auditory cue parameters in the sound-induced flash illusion. J Vis.  https://doi.org/10.1167/14.7.12 PubMedPubMedCentralGoogle Scholar
  52. Kwakye LD, Foss-Feig JH, Cascio CJ, Stone WL, Wallace MT (2011) Altered auditory and multisensory temporal processing in autism spectrum disorders. Front Integr Neurosci 4:129.  https://doi.org/10.3389/fnint.2010.00129 PubMedPubMedCentralCrossRefGoogle Scholar
  53. Laurienti PJ, Burdette JH, Maldjian JA, Wallace MT (2006) Enhanced multisensory integration in older adults. Neurobiol Aging 27:1155–1163.  https://doi.org/10.1016/j.neurobiolaging.2005.05.024 PubMedCrossRefGoogle Scholar
  54. Lin FR, Thorpe R, Gordon-Salant S, Ferrucci L (2011) Hearing loss prevalence and risk factors among older adults in the United States. J Gerontol A Biol Sci Med Sci 66:582–590.  https://doi.org/10.1093/gerona/glr002 PubMedCrossRefGoogle Scholar
  55. Lovelace CT, Stein BE, Wallace MT (2003) An irrelevant light enhances auditory detection in humans: a psychophysical analysis of multisensory integration in stimulus detection. Brain Res Cogn Brain Res 17:447–453.  https://doi.org/10.1016/S0926-6410(03)00160-5 PubMedCrossRefGoogle Scholar
  56. Lunner T (2003) Cognitive function in relation to hearing aid use. Int J Audiol 42(Suppl 1):S49-58PubMedGoogle Scholar
  57. MacMillan NA, Creelman CD (2004) Detection theory: a user’s guide. Psychology Press, MahwahGoogle Scholar
  58. Mahoney JR, Li PC, Oh-Park M, Verghese J, Holtzer R (2011) Multisensory integration across the senses in young and old adults. Brain Res 1426:43–53.  https://doi.org/10.1016/j.brainres.2011.09.017 PubMedPubMedCentralCrossRefGoogle Scholar
  59. McCormick D, Mamassian P (2008) What does the illusory-flash look like? Vision Res 48:63–69.  https://doi.org/10.1016/j.visres.2007.10.010 PubMedCrossRefGoogle Scholar
  60. McGovern DP, Roudaia E, Stapleton J, McGinnity TM, Newell FN (2014) The sound-induced flash illusion reveals dissociable age-related effects in multisensory integration. Front Aging Neurosci 6:250.  https://doi.org/10.3389/fnagi.2014.00250 PubMedPubMedCentralCrossRefGoogle Scholar
  61. McGurk H, MacDonald J (1976) Hearing lips and seeing voices. Nature 264:746–748PubMedCrossRefGoogle Scholar
  62. Meister H, Rahlmann S, Walger M, Margolf-Hackl S, Kiessling J (2015) Hearing aid fitting in older persons with hearing impairment: the influence of cognitive function, age, and hearing loss on hearing aid benefit. Clin Interv Aging 10:435–443.  https://doi.org/10.2147/CIA.S77096 PubMedPubMedCentralCrossRefGoogle Scholar
  63. Meredith MA, Stein BE (1986) Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. J Neurophysiol 56:640–662PubMedCrossRefGoogle Scholar
  64. Miller LM, D’Esposito M (2005) Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. J Neurosci 25:5884–5893.  https://doi.org/10.1523/JNEUROSCI.0896-05.2005 PubMedCrossRefGoogle Scholar
  65. Mishra J, Martinez A, Sejnowski TJ, Hillyard SA (2007) Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion. J Neurosci 27:4120–4131.  https://doi.org/10.1523/JNEUROSCI.4912-06.2007 PubMedPubMedCentralCrossRefGoogle Scholar
  66. Mishra J, Martinez A, Hillyard SA (2013) Audition influences color processing in the sound-induced visual flash illusion. Vision Res 93:74–79.  https://doi.org/10.1016/j.visres.2013.10.013 PubMedCrossRefGoogle Scholar
  67. Moradi S, Lidestam B, Ronnberg J (2016) Comparison of gated audiovisual speech identification in elderly hearing aid users and elderly normal-hearing individuals: effects of adding visual cues to auditory speech stimuli. Trends Hear 20.  https://doi.org/10.1177/2331216516653355
  68. Mozolic JL, Hugenschmidt CE, Peiffer AM, Laurienti PJ (2012) Multisensory integration and aging. In: Murray MM, Wallace MT (eds) The neural bases of multisensory processes, CRC Press, Boca Raton (FL), Chap. 20. https://www.ncbi.nlm.nih.gov/books/NBK92841/
  69. Musacchia G, Arum L, Nicol T, Garstecki D, Kraus N (2009) Audiovisual deficits in older adults with hearing loss: biological evidence. Ear Hear 30:505–514.  https://doi.org/10.1097/AUD.0b013e3181a7f5b7 PubMedCrossRefGoogle Scholar
  70. Narinesingh C, Goltz HC, Wong AM (2017) Temporal binding window of the sound-induced flash illusion in amblyopia. Invest Ophthalmol Vis Sci 58:1442–1448.  https://doi.org/10.1167/iovs.16-21258 PubMedCrossRefGoogle Scholar
  71. Navarra J, Vatakis A, Zampini M, Soto-Faraco S, Humphreys W, Spence C (2005) Exposure to asynchronous audiovisual speech extends the temporal window for audiovisual integration. Brain Res Cogn Brain Res 25:499–507.  https://doi.org/10.1016/j.cogbrainres.2005.07.009 PubMedCrossRefGoogle Scholar
  72. Nelson WT, Hettinger LJ, Cunningham JA, Brickman BJ, Haas MW, McKinley RL (1998) Effects of localized auditory information on visual target detection performance using a helmet-mounted display. Hum Factors 40:452–460.  https://doi.org/10.1518/001872098779591304 PubMedCrossRefGoogle Scholar
  73. Neufeld J, Sinke C, Zedler M, Emrich HM, Szycik GR (2012) Reduced audio-visual integration in synaesthetes indicated by the double-flash illusion. Brain Res 1473:78–86.  https://doi.org/10.1016/j.brainres.2012.07.011 PubMedCrossRefGoogle Scholar
  74. Peiffer AM, Mozolic JL, Hugenschmidt CE, Laurienti PJ (2007) Age-related multisensory enhancement in a simple audiovisual detection task. Neuroreport 18:1077–1081.  https://doi.org/10.1097/WNR.0b013e3281e72ae7 PubMedCrossRefGoogle Scholar
  75. Perez-Bellido A, Ernst MO, Soto-Faraco S, Lopez-Moliner J (2015) Visual limitations shape audio-visual integration. J Vis 15:5.  https://doi.org/10.1167/15.14.5 PubMedCrossRefGoogle Scholar
  76. Podsiadlo D, Richardson S (1991) The timed “Up and Go”: a test of basic functional mobility for frail elderly persons. J Am Geriatr Soc 39:142–148PubMedCrossRefGoogle Scholar
  77. Poliakoff E, Ashworth S, Lowe C, Spence C (2006) Vision and touch in ageing: crossmodal selective attention and visuotactile spatial interactions. Neuropsychologia 44:507–517.  https://doi.org/10.1016/j.neuropsychologia.2005.07.004 PubMedCrossRefGoogle Scholar
  78. Powers AR, 3rd, Hillock AR, Wallace MT (2009) Perceptual training narrows the temporal window of multisensory binding. J Neurosci 29:3.  https://doi.org/10.1523/JNEUROSCI.3501-09.2009 12265–12274CrossRefGoogle Scholar
  79. Puschmann S, Thiel CM (2017) Changed crossmodal functional connectivity in older adults with hearing loss. Cortex 86:109–122.  https://doi.org/10.1016/j.cortex.2016.10.014 PubMedCrossRefGoogle Scholar
  80. Puschmann S, Sandmann P, Bendixen A, Thiel CM (2014) Age-related hearing loss increases cross-modal distractibility. Hear Res 316:28–36.  https://doi.org/10.1016/j.heares.2014.07.005 PubMedCrossRefGoogle Scholar
  81. Rosenthal O, Shimojo S, Shams L (2009) Sound-induced flash illusion is resistant to feedback training. Brain Topogr 21:185–192.  https://doi.org/10.1007/s10548-009-0090-9 PubMedPubMedCentralCrossRefGoogle Scholar
  82. Roudaia E, Sekuler AB, Bennett PJ, Sekuler R (2013) Aging and audio-visual and multi-cue integration in motion. Front Psychol 4:267.  https://doi.org/10.3389/fpsyg.2013.00267 PubMedPubMedCentralGoogle Scholar
  83. Rouger J, Lagleyre S, Fraysse B, Deneve S, Deguine O, Barone P (2007) Evidence that cochlear-implanted deaf patients are better multisensory integrators. Proc Natl Acad Sci USA 104:7295–7300.  https://doi.org/10.1073/pnas.0609419104 PubMedPubMedCentralCrossRefGoogle Scholar
  84. Sandmann P, Dillier N, Eichele T et al (2012) Visual activation of auditory cortex reflects maladaptive plasticity in cochlear implant users. Brain 135:555–568.  https://doi.org/10.1093/brain/awr329 PubMedCrossRefGoogle Scholar
  85. Schierholz I, Finke M, Schulte S et al (2015) Enhanced audio-visual interactions in the auditory cortex of elderly cochlear-implant users. Hear Res 328:133–147.  https://doi.org/10.1016/j.heares.2015.08.009 PubMedCrossRefGoogle Scholar
  86. Schmidt K-H, Metzler P (1992) Wortschatztest: WST. BeltzGoogle Scholar
  87. Schneider BA, Daneman M, Pichora-Fuller MK (2002) Listening in aging adults: from discourse comprehension to psychoacoustics. Can J Exp Psychol 56:139–152.  https://doi.org/10.1037/h0087392 PubMedCrossRefGoogle Scholar
  88. Setti A, Burke KE, Kenny RA, Newell FN (2011) Is inefficient multisensory processing associated with falls in older people? Exp Brain Res 209:375–384.  https://doi.org/10.1007/s00221-011-2560-z PubMedCrossRefGoogle Scholar
  89. Setti A, Stapleton J, Leahy D, Walsh C, Kenny RA, Newell FN (2014) Improving the efficiency of multisensory integration in older adults: audio-visual temporal discrimination training reduces susceptibility to the sound-induced flash illusion. Neuropsychologia 61:259–268.  https://doi.org/10.1016/j.neuropsychologia.2014.06.027 PubMedCrossRefGoogle Scholar
  90. Shams L, Kamitani Y, Shimojo S (2000) Illusions. What you see is what you hear. Nature 408:788.  https://doi.org/10.1038/35048669 PubMedCrossRefGoogle Scholar
  91. Shams L, Kamitani Y, Thompson S, Shimojo S (2001) Sound alters visual evoked potentials in humans. Neuroreport 12:3849–3852PubMedCrossRefGoogle Scholar
  92. Shams L, Kamitani Y, Shimojo S (2002) Visual illusion induced by sound. Brain Res Cogn Brain Res 14:147–152.  https://doi.org/10.1016/S0926-6410(02)00069-1 PubMedCrossRefGoogle Scholar
  93. Shams L, Iwaki S, Chawla A, Bhattacharya J (2005a) Early modulation of visual cortex by sound: an MEG study. Neurosci Lett 378:76–81.  https://doi.org/10.1016/j.neulet.2004.12.035 PubMedCrossRefGoogle Scholar
  94. Shams L, Ma WJ, Beierholm U (2005b) Sound-induced flash illusion as an optimal percept. Neuroreport 16:1923–1927PubMedCrossRefGoogle Scholar
  95. Sharma A, Glick H (2016) Cross-modal re-organization in clinical populations with hearing loss. Brain Sci.  https://doi.org/10.3390/brainsci6010004 PubMedPubMedCentralGoogle Scholar
  96. Slutsky DA, Recanzone GH (2001) Temporal and spatial dependency of the ventriloquism effect. Neuroreport 12:7–10PubMedCrossRefGoogle Scholar
  97. Spence C, Squire S (2003) Multisensory integration: maintaining the perception of synchrony. Curr Biol 13:R519-521.  https://doi.org/10.1016/S0960-9822(03)00445-7 CrossRefGoogle Scholar
  98. Stapleton J, Setti A, Doheny EP, Kenny RA, Newell FN (2014) A standing posture is associated with increased susceptibility to the sound-induced flash illusion in fall-prone older adults. Exp Brain Res 232:423–434.  https://doi.org/10.1007/s00221-013-3750-7 PubMedCrossRefGoogle Scholar
  99. Stein BE, Meredith MA (1990) Multisensory integration. Neural and behavioral solutions for dealing with stimuli from different sensory modalities. Ann N Y Acad Sci 608:51–65 (discussion 65–70) PubMedCrossRefGoogle Scholar
  100. Stein BE, London N, Wilkinson LK, Price DD (1996) Enhancement of perceived visual intensity by auditory stimuli: a psychophysical analysis. J Cogn Neurosci 8:497–506.  https://doi.org/10.1162/jocn.1996.8.6.497 PubMedCrossRefGoogle Scholar
  101. Stevenson RA, Wallace MT (2013) Multisensory temporal integration: task and stimulus dependencies. Exp Brain Res 227:249–261.  https://doi.org/10.1007/s00221-013-3507-3 PubMedPubMedCentralCrossRefGoogle Scholar
  102. Stevenson RA, Zemtsov RK, Wallace MT (2012) Individual differences in the multisensory temporal binding window predict susceptibility to audiovisual illusions. J Exp Psychol Hum Percept Perform 38:1517–1529.  https://doi.org/10.1037/a0027339 PubMedPubMedCentralCrossRefGoogle Scholar
  103. Stevenson RA, Wilson MM, Powers AR, Wallace MT (2013) The effects of visual training on multisensory temporal processing. Exp Brain Res 225:479–489.  https://doi.org/10.1007/s00221-012-3387-y PubMedPubMedCentralCrossRefGoogle Scholar
  104. Stevenson RA, Siemann JK, Woynaroski TG, Schneider BC, Eberly HE, Camarata SM, Wallace MT (2014) Evidence for diminished multisensory integration in autism spectrum disorders. J Autism Dev Disord 44:3161–3167.  https://doi.org/10.1007/s10803-014-2179-6 PubMedPubMedCentralCrossRefGoogle Scholar
  105. Stevenson RA, Sheffield SW, Butera IM, Gifford RH, Wallace MT (2017) Multisensory integration in cochlear implant recipients. Ear Hear.  https://doi.org/10.1097/AUD.0000000000000435 Google Scholar
  106. Stone MA, Moore BC, Meisenbacher K, Derleth RP (2008) Tolerable hearing aid delays. V. Estimation of limits for open canal fittings. Ear Hear 29:601–617.  https://doi.org/10.1097/AUD.0b013e3181734ef2 PubMedCrossRefGoogle Scholar
  107. Strelnikov K, Rouger J, Lagleyre S, Fraysse B, Demonet JF, Deguine O, Barone P (2015) Increased audiovisual integration in cochlear-implanted deaf patients: independent components analysis of longitudinal positron emission tomography data. Eur J Neurosci 41:677–685.  https://doi.org/10.1111/ejn.12827 PubMedCrossRefGoogle Scholar
  108. Stropahl M, Plotz K, Schonfeld R et al (2015) Cross-modal reorganization in cochlear implant users: auditory cortex contributes to visual face processing. Neuroimage 121:159–170.  https://doi.org/10.1016/j.neuroimage.2015.07.062 PubMedCrossRefGoogle Scholar
  109. Summerfield Q (1992) Lipreading and audio-visual speech perception. Philos Trans R Soc Lond B Biol Sci 335:71–78.  https://doi.org/10.1098/rstb.1992.0009 PubMedCrossRefGoogle Scholar
  110. Thai-Van H, Veuillet E, Norena A, Guiraud J, Collet L (2010) Plasticity of tonotopic maps in humans: influence of hearing loss, hearing aids and cochlear implants. Acta Otolaryngol 130:333–337.  https://doi.org/10.3109/00016480903258024 PubMedCrossRefGoogle Scholar
  111. Tillberg I, Ronnberg J, Svard I, Ahlner B (1996) Audio-visual speechreading in a group of hearing aid users. The effects of onset age, handicap age, and degree of hearing loss. Scand Audiol 25:267–272.  https://doi.org/10.3109/01050399609074966 PubMedCrossRefGoogle Scholar
  112. Tye-Murray N, Sommers MS, Spehar B (2007) Audiovisual integration and lipreading abilities of older adults with normal and impaired hearing. Ear Hear 28:656–668.  https://doi.org/10.1097/AUD.0b013e31812f7185 PubMedCrossRefGoogle Scholar
  113. Tye-Murray N, Sommers M, Spehar B, Myerson J, Hale S (2010) Aging, audiovisual integration, and the principle of inverse effectiveness. Ear Hear 31:636–644.  https://doi.org/10.1097/AUD.0b013e3181ddf7ff PubMedPubMedCentralGoogle Scholar
  114. van Wassenhove V, Grant KW, Poeppel D (2007) Temporal window of integration in auditory-visual speech perception. Neuropsychologia 45:598–607.  https://doi.org/10.1016/j.neuropsychologia.2006.01.001 PubMedCrossRefGoogle Scholar
  115. Vanes LD, White TP, Wigton RL, Joyce D, Collier T, Shergill SS (2016) Reduced susceptibility to the sound-induced flash fusion illusion in schizophrenia. Psychiatry Res 245:58–65.  https://doi.org/10.1016/j.psychres.2016.08.016 PubMedCrossRefGoogle Scholar
  116. Wada Y, Kitagawa N, Noguchi K (2003) Audio-visual integration in temporal perception. Int J Psychophysiol 50:117–124.  https://doi.org/10.1016/S0167-8760(03)00128-4 PubMedCrossRefGoogle Scholar
  117. Walden BE, Grant KW, Cord MT (2001) Effects of amplification and speechreading on consonant recognition by persons with impaired hearing. Ear Hear 22:333–341PubMedCrossRefGoogle Scholar
  118. Wallace MT, Stevenson RA (2014) The construct of the multisensory temporal binding window and its dysregulation in developmental disabilities. Neuropsychologia 64:105–123.  https://doi.org/10.1016/j.neuropsychologia.2014.08.005 PubMedPubMedCentralCrossRefGoogle Scholar
  119. Watkins S, Shams L, Tanaka S, Haynes JD, Rees G (2006) Sound alters activity in human V1 in association with illusory visual perception. Neuroimage 31:1247–1256.  https://doi.org/10.1016/j.neuroimage.2006.01.016 PubMedCrossRefGoogle Scholar
  120. Watkins S, Shams L, Josephs O, Rees G (2007) Activity in human V1 follows multisensory perception. Neuroimage 37:572–578.  https://doi.org/10.1016/j.neuroimage.2007.05.027 PubMedCrossRefGoogle Scholar
  121. Welch RB, Warren DH (1980) Immediate perceptual response to intersensory discrepancy. Psychol Bull 88:638–667PubMedCrossRefGoogle Scholar
  122. Whittingham KM, McDonald JS, Clifford CW (2014) Synesthetes show normal sound-induced flash fission and fusion illusions. Vision Res 105:1–9.  https://doi.org/10.1016/j.visres.2014.08.010 PubMedCrossRefGoogle Scholar
  123. WHO Prevention of Blindness and Deafness (PBD) Programme. Prevention of deafness. Grades of hearing impairment. http://www.who.int/pbd/deafness/hearing_impairment_grades/en. Accessed 14 March 2016
  124. Witt JK, Taylor JE, Sugovic M, Wixted JT (2015) Signal detection measures cannot distinguish perceptual biases from response biases. Perception 44:289–300.  https://doi.org/10.1068/p7908 PubMedCrossRefGoogle Scholar
  125. Witt JK, Taylor JE, Sugovic M, Wixted JT (2016) Further clarifying signal detection theoretic interpretations of the Muller–Lyer and sound-induced flash illusions. J Vis 16:19.  https://doi.org/10.1167/16.11.19 PubMedCrossRefGoogle Scholar
  126. Zampini M, Shore DI, Spence C (2003) Audiovisual temporal order judgments. Exp Brain Res 152:198–210.  https://doi.org/10.1007/s00221-003-1536-z PubMedCrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Cluster of Excellence ‘Hearing4all’University of OldenburgOldenburgGermany
  2. 2.Cognitive Psychology Lab, Department of PsychologyUniversity of OldenburgOldenburgGermany
  3. 3.Biological Psychology Lab, Department of PsychologyUniversity of OldenburgOldenburgGermany

Personalised recommendations