Improving Communication of Visual Signals by Text-to-Speech Software

  • Robert F. LorchJr.
  • Julie Lemarié
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8011)


Printed signals are well-documented aids to reading and memory for expository text. Despite their usefulness, many TTS applications fail to adequately communicate signaling. A theoretical framework called “SARA” provides an analysis of printed signals that identifies what specific information should be rendered in order to preserve the signaling function. Further, SARA identifies two important criteria – the availability criterion and the accessibility criterion – that should help guide the evaluation of alternative auditory renderings of signals.


Visual Signal Information Function Text Processing Verbal Label Expository Text 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Fellbaum, K., Kouroupetroglou, G.: Principles of electronic speech processing with applications for people with disabilities. Technology and Disability 20, 55–85 (2008)Google Scholar
  2. 2.
    Schröder, M.: Expressive speech synthesis: Past, present and possible futures. In: Tao, J., Tan, T. (eds.) Affective Information Processing, pp. 111–126. Springer, London (2009)CrossRefGoogle Scholar
  3. 3.
    Spiliotopoulos, D., Xydas, G., Kouroupetroglou, G., Argyropoulos, V.: Experimentation on spoken format of tables in auditory user interfaces. In: Proceedings of the 11th International Conference on Human-Computer Interaction (HCII 2005), pp. 361–370 (2005)Google Scholar
  4. 4.
    Spiliotopoulos, D., Xydas, G., Kouroupetroglou, G., Argyropoulos, V., Ikospentaki, K.: Auditory universal accessibility of data tables using naturally derived prosody specification. Universal Access in the Information Society 9, 169–183 (2010)CrossRefGoogle Scholar
  5. 5.
    Lorch Jr., R.F., Chen, H.-T., Lemarié, J.: Communicating headings and preview sentences in text and speech. Journal of Experimental Psychology: Applied 18(3), 265–276 (2012)CrossRefGoogle Scholar
  6. 6.
    Meyer, B.J.F.: The organization of prose and its effects on memory. North-Holland, Amsterdam (1975)Google Scholar
  7. 7.
    Lorch Jr., R.F.: Text signaling devices and their effects on reading and memory processes. Educational Psychology Review 1, 209–234 (1989)CrossRefGoogle Scholar
  8. 8.
    Lorch Jr., R.F., Lorch, E.P., Klusewitz, M.A.: Effects of typographical cues on reading and recall of text. Contemporary Educational Psychology 20, 51–64 (1995)CrossRefGoogle Scholar
  9. 9.
    Crouse, J.H., Idstein, P.: Effects of encoding cues on prose learning. Journal of Educational Psychology 63, 309–313 (1972)CrossRefGoogle Scholar
  10. 10.
    Fowler, R., Barker, A.: Effectiveness of highlighting for retention of text material. Journal of Applied Psychology 59, 358–364 (1974)CrossRefGoogle Scholar
  11. 11.
    Lorch Jr., R.F., Chen, A.H.: Effects of number signals on reading and recall. Journal of Educational Psychology 78, 263–270 (1986)CrossRefGoogle Scholar
  12. 12.
    Lorch Jr., R.F., Lorch, E.P., Matthews, P.D.: On-line processing of the topic structure of a text. Journal of Memory and Language 24, 350–362 (1985)CrossRefGoogle Scholar
  13. 13.
    Murray, J.D., McGlone, C.: Topic overviews and processing of topic structure. Journal of Educational Psychology 89, 251–261 (1997)CrossRefGoogle Scholar
  14. 14.
    Glynn, S.M., DiVesta, F.J.: Outline and hierarchical organization for study and retrieval. Journal of Educational Psychology 69, 69–95 (1997)Google Scholar
  15. 15.
    Lorch Jr., R.F., Lorch, E.P.: Topic structure representation and text recall. Journal of Educational Psychology 77, 137–148 (1985)CrossRefGoogle Scholar
  16. 16.
    Lorch Jr., R.F., Lorch, E.P.: Effects of organizational signals on text processing strategies. Journal of Educational Psychology 87, 537–544 (1995)CrossRefGoogle Scholar
  17. 17.
    Glover, J.A., Dinnel, D.L., Halpain, D.R., McKee, T.K., Corkill, A.J., Wise, S.L.: The effects of across-chapter signals on recall of text. Journal of Educational Psychology 80, 3–15 (1988)CrossRefGoogle Scholar
  18. 18.
    Cauchard, F., Eyrolle, H., Cellier, J.-M., Hyönä, J.: Vertical perceptual span and the processing of visual signals in reading. International Journal of Psychology 45, 40–47 (2010)CrossRefGoogle Scholar
  19. 19.
    Cauchard, F., Eyrolle, H., Cellier, J.-M., Hyönä, J.: Visual signals vertically extend the perceptual span in searching a text: A gaze-contingent window study. Discourse Processes 47, 617–640 (2010)CrossRefGoogle Scholar
  20. 20.
    Klusewitz, M.A., Lorch Jr., R.F.: Effects of headings and familiarity with a text on strategies for searching a text. Memory & Cognition 28, 667–676 (2000)CrossRefGoogle Scholar
  21. 21.
    Lorch Jr., R.F., Lemarié, J., Grant, R.A.: Signaling hierarchical and sequential organization in expository text. Scientific Studies of Reading 15, 267–284 (2011)CrossRefGoogle Scholar
  22. 22.
    Lorch Jr., R.F., Lemarié, J., Grant, R.A.: Three information functions of headings: A test of the SARA theory of signaling. Discourse Processes 48, 139–160 (2011)CrossRefGoogle Scholar
  23. 23.
    Hyönä, J., Lorch Jr., R.F.: Effects of topic headings on text processing: Evidence from adult readers’ eye fixation patterns. Learning and Instruction 14, 131–152 (2004)CrossRefGoogle Scholar
  24. 24.
    Hyönä, J., Lorch Jr., R.F., Kaakinen, J.: Individual differences in reading to summarize expository text: Evidence from eye fixation patterns. Journal of Educational Psychology 94, 44–55 (2002)CrossRefGoogle Scholar
  25. 25.
    Sanchez, R.P., Lorch, E.P., Lorch Jr., R.F.: Effects of headings on text processing strategies. Contemporary Educational Psychology 26, 418–428 (2001)CrossRefGoogle Scholar
  26. 26.
    Lorch Jr., R.F., Lorch, E.P.: Effects of organizational signals on free recall of expository text. Journal of Educational Psychology 88, 38–48 (1996)CrossRefGoogle Scholar
  27. 27.
    Mayer, R.E., Dyck, J.L., Cook, L.K.: Techniques that help readers build mental models from scientific text: Definitions pretraining and signaling. Journal of Educational Psychology 76, 1089–1105 (1984)CrossRefGoogle Scholar
  28. 28.
    Lorch Jr., R.F., Lorch, E.P., Inman, W.E.: Effects of signaling topic structure on text recall. Journal of Educational Psychology 85, 281–290 (1993)CrossRefGoogle Scholar
  29. 29.
    Surber, J.R., Schroeder, M.: Effect of prior domain knowledge and headings on processing of informative text. Contemporary Educational Psychology 32, 485–498 (2007)CrossRefGoogle Scholar
  30. 30.
    Dee-Lucas, D., Larkin, J.H.: Novice strategies for processing scientific texts. Discourse Processes 9, 329–354 (1986)CrossRefGoogle Scholar
  31. 31.
    Dee-Lucas, D., Larkin, J.H.: Novice rules for assessing importance in science texts. Journal of Memory and Language 27, 288–308 (1988)CrossRefGoogle Scholar
  32. 32.
    Meyer, B.J.F., Brandt, D.M., Bluth, G.J.: Use of top-level structure in text: Key for reading comprehension of ninth grade students. Reading Research Quarterly 16, 72–103 (1980)CrossRefGoogle Scholar
  33. 33.
    Lemarié, J., Lorch, R.F., Eyrolle, H., Virbel, J.: SARA: A Text-Based and Reader-Based Theory of Text Signaling. Educational Psychologist 43(1), 27–48 (2008)CrossRefGoogle Scholar
  34. 34.
    Lemarié, J., Eyrolle, H., Cellier, J.-M.: Visual signals in text comprehension: How to restore them when oralizing a text via speech synthesis. Computers in Human Behavior 22, 1096–1115 (2006)CrossRefGoogle Scholar
  35. 35.
    Maurel, F.: De l’écrit à l’oral: analyses et générations. In: Actes de la 11ème Conférence sur le Traitement Automatique des Langues Naturelles (TALN 2004), Fès, Maroc, pp. 289–298 (Avril 2004)Google Scholar
  36. 36.
    Maurel, F., Lemarié, J., Vigouroux, N.: Oralisation de structures visuelles: de la lexico-syntaxe à la prosodie. In: Actes du colloque national Interface Prosodique (IP 2003), Nantes, France, Mars 27-29, pp. 137–142 (2003)Google Scholar
  37. 37.
    Tsonos, D., Xydas, G., Kouroupetroglou, G.: Auditory accessibility of metadata in books: A design for all approach. In: Stephanidis, C. (ed.) HCI 2007. LNCS, vol. 4556, pp. 436–445. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  38. 38.
    McGookin, D.K., Brewster, S.A.: Understanding concurrent earcons: Applying auditory scene analysis principles to concurrent earcon recognition. ACM Transactions on Applied Perceptions 1, 130–155 (2004)CrossRefGoogle Scholar
  39. 39.
    Giraud, S., Thérouanne, P.: Role of lexico-syntactic and prosodic cues in spoken comprehension of enumeration in sighted and blind adults. Presented at Multidisciplinary Approaches to Discourse, Moissac, France (2010)Google Scholar
  40. 40.
    Giraud, S., Uzan, G., Thérouanne, P.: L’accessibilité des interfaces informatiques pour les déficients visuels. In: Dinet, J., Bastien, C. (eds.) L’ergonomie Des Objets et Environnements Physiques et Numériques, Hermes - Sciences Lavoisier, Paris (2011)Google Scholar
  41. 41.
    Argyropoulos, V.S., Sideridis, G.D., Kouroupetroglou, G., Xydas, G.: Auditory discriminations of typographic attributes of documents by students with blindness. British Journal of Visual Impairment 27, 183–203 (2009)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Robert F. LorchJr.
    • 1
  • Julie Lemarié
    • 2
  1. 1.University of KentuckyLexingtonUSA
  2. 2.CLLE-CNRSUniversité de Toulouse - Le MirailToulouseFrance

Personalised recommendations