Skip to main content
SpringerLink
Log in
Book cover

ERCIM Workshop on User Interfaces for All

UI4ALL 2002: Universal Access Theoretical Perspectives, Practice, and Experience pp 508–523Cite as

Evaluating Sonified Rapid Serial Visual Presentation: An Immersive Reading Experience on a Mobile Device

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2615))

Abstract

Can the addition of sound enhance the reading experience on small screens when using Rapid Serial Visual Presentation (RSVP) for dynamic text presentation? In this paper we introduce Sonified RSVP and report findings from a usability evaluation where the experience of reading texts enhanced with nomic auditory icons was evaluated. At a comfortable pace 12 subjects read long Swedish texts of equal difficulty with and without the addition of sound on a handheld device. Reading speed (M≈217 wpm) and comprehension (M≈58% correct) did not differ significantly between the two conditions. The evaluation revealed a rather high task load for both conditions but no significant differences. However, the subjective rating of Immersion was rated significantly higher for the Sonified condition. Causes, implications and directions for further work are discussed based on these findings.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Back, M., Cohen, J., Gold, R., Harrison, S. and Minneman, S. (2001). Listen reader: an electronically augmented paper-based book. Proceedings of the SIG-CHI on Human Factors in Computing Systems 2001, 23–29, Seattle, WA, USA, ACM Press.

    Google Scholar 

  2. Björnsson, C. H. (1968). Läsbarhet, Stockholm, Liber (in Swedish).

    Google Scholar 

  3. Brewster, S., Raty V. P., and Kortekangas, A. (1996). Earcons as a method of providing navigational cues in a menu hierarchy. Proceeding of Human-Computer Interaction’96 by M. A. Sasse, R. J. Cunningham and R. L. Winder (Eds.), People and Computers.

    Google Scholar 

  4. Brewster, S. (1998). Using non speech sounds to provide navigation cues. ACM Transactions on Computer Human Interaction, 5(3), 224–259.

    Article  MathSciNet  Google Scholar 

  5. Bruijn, O. and Spence, R. (2000). Rapid Serial Visual Presentation: A space-time tradeoff in information presentation. In Proceedings of Advanced Visual Interfaces, AVI’2000.

    Google Scholar 

  6. Castelhano, M. S. and Muter, P. (2001). Optimizing the reading of electronic text using rapid serial visual presentation. Behaviour & Information Technology, 20(4), 237–247.

    Article  Google Scholar 

  7. Chen, H.C. and Chan, K.T. (1990). Reading computer-displayed moving text with and without self-control over the display rate. Behaviour & Information Technology, 9, 467–477.

    Article  Google Scholar 

  8. Duchnicky, R. L. and Kolers, P. A. (1983). Readability of text scrolled on visual display terminals as a function of window size. Human Factors, 25, 683–692.

    Google Scholar 

  9. Ericsson, T., Chincholle, D. and Goldstein, M. (2001). Both the device and the service influence WAP usability, IHM-HCI2001, Volume II, Usability in Practice by J. Vanderdonckt, A. Blandford and A. Derycke (Eds.), Short paper, 10–14 September, Lille, France, 79–85.

    Google Scholar 

  10. Forster, K. I. (1970). Visual perception of rapidly presented word sequences of varying complexity. Percep. Psychophys. 8, 215–221.

    Google Scholar 

  11. Gaver, W. (1986). Auditory icons: Using sound in computer interfaces. Human-Computer Interaction, 2, 167–177, Lawrence Erlbaum Associates, Inc.

    Article  Google Scholar 

  12. Gaver, W. (1998). Auditory interfaces. In Handbook of Human-Computer Interaction, 2nd ed., 1003–1041.

    Google Scholar 

  13. Gilbert, L. C. (1959). Speed of processing verbal stimuli and its relation to reading. J Educ Psychol, 58, 8–14.

    Article  Google Scholar 

  14. Goldstein, M., Anneroth, M., Sicheritz, K. and Lundberg, T. (2000). Enhancing the reading experience: Sonified on-line reading from a small PDA screen using RSVP. Fourth Swedish Symposium on Multimodal Communication, SsoMC.

    Google Scholar 

  15. Goldstein, M., Sicheritz, K. and Anneroth, M. (2001). Reading from a small display using the RSVP technique. Nordic Radio Symposium, NRS01.

    Google Scholar 

  16. Goldstein, M., Öquist, G., Bayat-M, M., Ljungstrand, P. and BjÖrk, S. (2001). Enhancing the reading experience: Using adaptive and sonified RSVP for reading on small displays. Proceedings of Workshop on Mobile Devices at IHM-HCI 2001, Lille, September 10–14.

    Google Scholar 

  17. Hart, S. G. and Staveland, L. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Human Mental Workload, by P. A. Hancock and N. Meshkati (Eds.). Elsevier Science Publishers, B.V. North-Holland.

    Google Scholar 

  18. Hearst, M. A. (1997). Dissonance on audio interfaces. IEEE Expert, 12, 5, 10–16, IEEE Computer Press.

    Article  Google Scholar 

  19. Huey, E. B. (1968). The Psychology and Pedagogy of Reading. Massachusetts: MIT Press. (Originally published 1908).

    Google Scholar 

  20. Joula, J. F., Ward, N. J. and MacNamara, T. (1982). Visual search and reading of rapid serial presentations of letter strings, words and text. J. Exper. Psychol.: General, 111, 208–227.

    Article  Google Scholar 

  21. Juola, J. F., Tiritoglu, A., and Pleunis, J. (1995). Reading text presented on a small display. Applied Ergonomics, 26, 227–229.

    Article  Google Scholar 

  22. Just, M. A., and Carpenter, P. A. (1980). A theory of reading: From eye fixations to comprehension. Psychological Review, 87(4), 329–354.

    Article  Google Scholar 

  23. Kang, T. J., and Muter, P. (1989). Reading Dynamically Displayed Text. Behaviour & Information Technology, 8(1), 33–42.

    Article  Google Scholar 

  24. Kalyuga, S. (2000). When using sound with a text or picture is not beneficial for learning. Australian Journal of Educational Technology, 16(2), 161–172.

    Google Scholar 

  25. Kump, P. (1999). Break-trough rapid reading. New Jersey: Prentice-Hall Press.

    Google Scholar 

  26. Masson, M. E. J. (1983). Conceptual processing of text during skimming and rapid sequential reading. Memory & Cognition, 11(3), 262–274.

    Google Scholar 

  27. Mills, C. B. and Weldon, L. J. (1987). Reading text from computer screens. ACM Computing Surveys, 19(4), ACM Press.

    Google Scholar 

  28. Muter, P. (1996). Interface Design and Optimization of Reading of Continuous Text. In Cognitive aspects of electronic text processing. H. van Oostendorp and S. de Mul (Eds.). Norwood, N.J.:Ablex.

    Google Scholar 

  29. Muter, P., Kruk, R. S., Buttigieg, M. A., and Kang, T. J. (1988). Reader controlled computerized presentation of text. Human Factors, 30, 473–486.

    Google Scholar 

  30. Muter, P. and Maurutto, P. (1991). Reading and skimming from computer screens and books: The paperless office revisited? Behavior & Information Technology, 10, 257–266.

    Article  Google Scholar 

  31. Najjar, L. J. (1996). Multimedia information and learning. Journal of Educational Multimedia and Hypermedia, 5, 129–150.

    Google Scholar 

  32. Norman, D. A. (1988). The Psychology of Everyday Things. Doubleday, NY, USA.

    Google Scholar 

  33. Paivio, A. (1971). Imagery and Verbal Processes. New York: Holt, Rinehart & Winston, Inc.

    Google Scholar 

  34. Paivio, A. (1986). Mental Representations. New York: Oxford University Press.

    Google Scholar 

  35. Potter, M. C. (1984). Rapid Serial Visual Presentation (RSVP): A method for studying language processing. In New Methods in Reading Comprehension Research. Kieras, D. E. and Just, M. A. (Eds.). Hillsdale, N.J.: Erlbaum.

    Google Scholar 

  36. Rahman, T. and Muter, P. (1999). Designing an interface to optimize reading with small display windows. Human Factors, 1(1), 106–117, Human Factors and Ergonomics Society.

    Article  Google Scholar 

  37. Robeck, M. C. and Wallace, R. R. (1990). The Psychology of Reading: An Interdisciplinary Approach, Lawrence Erlbaum Associates, Hillsdale, New Jersey, 2nd edition.

    Google Scholar 

  38. Rubin, G. S. and K. Turano. (1992). Reading without saccadic eye movements. Vision Research, 32(5), 895–902.

    Article  Google Scholar 

  39. The Bailando prototype web page. A tool for research on small screen readability, available at: http://stp.ling.uu.se/~gustav/bailando/ (June 2002).

  40. Tekfi, C. (1987). Readability formulas: An overview. Journal of Documentation, 43(3), 261–273.

    Article  Google Scholar 

  41. Wickens, C. D. (1992). Engineering psychology and human performance, 2nd edition, Chapter 8, HarperCollins Publishers Inc., New York.

    Google Scholar 

  42. Williams, J. R. (1998). Guidelines for the use of multimedia in instruction. Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting, 1447–1451.

    Google Scholar 

  43. Öquist, G. (2001). Adaptive Rapid Serial Visual Presentation. Master’s Thesis, Department of Linguistics, Uppsala University, Sweden.

    Google Scholar 

  44. Öquist, G. and Goldstein, M. (2002). Towards an improved readability on mobile devices: Evaluating Adaptive Rapid Serial Visual Presentation. Proceedings of Mobile HCI’2002, 19–20 September 2002, Pisa, Italy, Springer Verlag.

    Google Scholar 

  45. Öquist, G., Björk, S. and Goldstein, M. (2002). Utilizing gaze detection to simulate the affordances of paper in the Rapid Serial Visual Presentation format. Proceedings of Mobile HCI’2002, 19–20 September 2002, Pisa, Italy, Springer Verlag.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Ericsson Research, Usability & Interaction Lab, Torshamnsgatan 23, 164 80, Kista, Sweden

    Mikael Goldstein

  2. Department of Linguistics, Uppsala University, PO Box 527, 751 20, Uppsala, Sweden

    Gustav Öquist

  3. Interactive Institute, PLAY Studio, PO Box 620, 405 30, Göteborg, Sweden

    Staffan Björk

Authors
  1. Mikael Goldstein
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gustav Öquist
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Staffan Björk
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. LORIA, UMR CNRS & INRIA, Université Henri Poincare, Nancy 1, Campus Scientifique, BP 239, 54506, Vandoeuvre-les-Nancy Cedex, France

    Noëlle Carbonell

  2. Institute of Computer Science Foundation for Research and Technology - Hellas, Science & Technology Park of Crete, Heraklion, 71110, Crete, Greece

    Constantine Stephanidis

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Goldstein, M., Öquist, G., Björk, S. (2003). Evaluating Sonified Rapid Serial Visual Presentation: An Immersive Reading Experience on a Mobile Device. In: Carbonell, N., Stephanidis, C. (eds) Universal Access Theoretical Perspectives, Practice, and Experience. UI4ALL 2002. Lecture Notes in Computer Science, vol 2615. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36572-9_39

Download citation

  • DOI: https://doi.org/10.1007/3-540-36572-9_39

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-00855-2

  • Online ISBN: 978-3-540-36572-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation