Attention Allocation with Overlapping Sound, Image, and Text

  • Géry d’Ydewalle
  • Ingrid Gielen
Part of the Springer Series in Neuropsychology book series (SSNEUROPSYCHOL)


In daily life people are often confronted with more than one source of information at a time, as, for example, when watching television. A television program has at least two channels of information: a visual one (the image) and an auditory one (the sound). In some countries most of the television programs are imported from abroad and subtitled in the native language. The subtitles, then, are a third source of information. Characteristically, each of these three sources of information are partly redundant: they do not contradict but rather supplement one another, or express the same content in a different form.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Baker, R.G. (1981). Guidelines for the subtitling of television programmes for the deaf and hard of hearing. Southampton, UK: Southampton University.Google Scholar
  2. Broadbent, D.E. (1958). Perception and communication. Oxford: Pergamon Press.CrossRefGoogle Scholar
  3. Craik, F.I.M., & Rabinowitz, J.C. (1984). Age differences in the use and acquisition of visual information: A tutorial review. In H. Bouma & D.G. Bouwhuis (Eds.), Attention and performance. Vol. X: Control of language processes (pp. 471–499). London: Erlbaum.Google Scholar
  4. D’Ydewalle, G., Praet, C., Verfaillie, K., & Van Rensbergen, J. (1991). Choosing between redundant information channels: Speech and text. Communication Research, 18, 650–666.CrossRefGoogle Scholar
  5. D’Ydewalle, G., & Van Rensbergen, J. (1989). Developmental studies of text-picture interaction in the perception of animated cartoons with text. In H. Mandl & J.R. Levin (Eds.), Knowledge acquisition from text and pictures (pp. 223–248). Amsterdam: Elsevier Science Publishers B.V. (North-Holland). Google Scholar
  6. D’Ydewalle, G., Van Rensbergen, J., & Pollet, J. (1987). Reading a message when the same message is available auditorily in another language: The case of subtitling. In J.K. O’Regan & A. Lévy-Schoen (Eds.), Eye movements: From physiology to cognition (pp. 313–321). Amsterdam: Elsevier Science Publishers B.V. (North-Holland). Google Scholar
  7. D’Ydewalle, G., Warlop, L., & Van Rensbergen, J. (1989). Differences between young and older adults in the division of attention over different sources of TV information. Medienpsychologie: Zeitschrift für Individual- und Massenkommunikation, 1, 42–57.Google Scholar
  8. Gielen, I. (1988). Het verwerken van ondertitels in functie van de taalkennis van de klankband en typen van informatie in het beeld [The processing of subtitles in function of the knowledge of the language used in the soundtrack and types of information on the screen]. Unpublished thesis, University of Leuven, Leuven.Google Scholar
  9. Gielen, M. (1988). Perceptie en ondertitels: De parafoveale en perifere informatieverwerking van ondertitels [Perception and subtitles: Parafoveal and peripheral processing of subtitles]. Unpublished thesis, University of Leuven, Leuven.Google Scholar
  10. McConkie, G.W., & Rayner, K. (1975). The span of effective stimulus during a fixation in reading. Perception & Psychophysics, 17, 578–586.CrossRefGoogle Scholar
  11. Muylaert, W., Nootens, J., Poesmans, D., & Pugh, A.K. (1983). Design and utilisation of subtitles on foreign language television programmes. In P.H. Neide (Ed.), Theorie, Methoden und Modelle der Kontaktlinguistik (pp. 201–214). Bonn: Dummler.Google Scholar
  12. Nederlandse Omroep Stichting (1977). De behoeften van doven en slechthorenden aan ondertiteling van Nederlandstalige televisieprogramma’s [The need of deaf and hard of hearing people for subtitled Dutch television programs]. (Research Rep. No. R77.194). Hilversum, the Netherlands.Google Scholar
  13. Praet, C, Verfaillie, K., De Graef, P., Van Rensbergen, J., & d’Ydewalle, G. (1990). A one line text is not half a two line text. In R. Groner, G. d’Ydewalle, & R. Parham (Eds.), From eye to mind: Information acquisition in perception, search, and reading (pp. 205–213). Amsterdam: Elsevier Science Publishers B.V. (North-Holland).Google Scholar
  14. Rayner, K., & Pollatsek, A. (1989). The psychology of reading. Englewood Cliffs, NJ: Prentice-Hall.Google Scholar
  15. Sohl, G. (1989). Het verwerken van de vreemdtalige gesproken tekst in een ondertiteld TV-programma [Processing a foreign spoken text in a subtitled television program]. Unpublished thesis, University of Leuven, Leuven.Google Scholar
  16. Tonla Briquet, G. (1979). Investigation into the subtitling of film and TV. Unpublished thesis, Brussels: Higher Governments Institute for translators and interpreters.Google Scholar
  17. Treisman, A. (1968). Strategies and models of selective attention. Psychological Review, 84, 127–190.Google Scholar
  18. Verfaillie, K., & d’Ydewalle, G. (1987). Modality preference and message comprehension in deaf youngsters watching TV. (Psychological Reports No. 70). Leuven: University of Leuven, Laboratory of Experimental Psychology. Google Scholar

Copyright information

© Springer-Verlag New York Inc. 1992

Authors and Affiliations

  • Géry d’Ydewalle
  • Ingrid Gielen

There are no affiliations available

Personalised recommendations