Building a Programmable Architecture for Non-visual Navigation of Mathematics: Using Rules for Guiding Presentation and Switching between Modalities

  • Iyad Abu Doush
  • Enrico Pontelli
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5616)


This paper presents a new implementation framework for exploring different non-visual modalities of presentation and navigation of mathematical content. The objective is to create a framework to facilitate the investigation of different presentation modalities, and to sustain the development of solutions that could fit a broad range of visual disabilities. The increased flexibility and the ability to customize the presentation scheme have the potential to provide a better fit for the needs of the user and enhance accessibility of complex mathematical content. The proposed approach relies on two principles. The first principle is a separation of concerns: instead of freezing the modality of presentation in the navigation system, we introduce the notion of rendering rule. The second feature of the proposed navigation system is the ability to switch on demand between interactive navigation and prosody-based presentation. This work is implemented as an extension to the Firefox web browser. New functionalities for reading MathML contents in a web page are added to the open source screen reader FireVox.


Rule-based Systems Math Accessibility Prosody Navigation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Lighthouse Int. Prevalence of Vision Impairment (2009),
  2. 2.
    Pontelli, E., Karshmer, A.I., Gupta, G.: Mathematics and Accessibility: a Survey. In: The Universal Access Handbook. Taylor & Francis, Abington (to appear) Google Scholar
  3. 3.
    Stevens, R.D., et al.: Access to mathematics for visually disabled students through multi-modal interaction. In: Human-Computer Interaction (1997)Google Scholar
  4. 4.
    Fitzpatrick, D.: Speaking Technical Documents: Using Prosody to Convey Textual and Mathematical Material. In: Miesenberger, K., Klaus, J., Zagler, W.L. (eds.) ICCHP 2002. LNCS, vol. 2398, p. 494. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  5. 5.
    Fitzpatrick, D.: Mathematics: How and What to Speak. In: International Conference on Computers Helping People with Special Needs (2006)Google Scholar
  6. 6.
    Ferreira, H., Freitas, D.: Enhancing the Accessibility of Mathematics for Blind People: the AudioMath Project. In: Miesenberger, K., Klaus, J., Zagler, W.L., Burger, D. (eds.) ICCHP 2004. LNCS, vol. 3118, pp. 678–685. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  7. 7.
    Ferreira, H., Freitas, D.: AudioMath: Towards Automatic Readings of Mathematical Expressions. In: Human Computer Interaction International (2005)Google Scholar
  8. 8.
    Gaura, P.: REMathEx - reader and editor of the mathematical expressions for blind students. In: Miesenberger, K., Klaus, J., Zagler, W.L. (eds.) ICCHP 2002. LNCS, vol. 2398, p. 486. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  9. 9.
    Karshmer, A.I., et al.: Helping visually impaired students in the study of mathematics. In: IEEE Frontiers in Education Conference (1999)Google Scholar
  10. 10.
    Awde, A., et al.: Complexity of Mathematical Expressions in Adaptive Multimodal Multimedia System. Int. Journal Computer & Info. Science and Eng. (2008)Google Scholar
  11. 11.
    FireVox: A Screen Reading Extension for FireFox (2009),
  12. 12.
    Raman, T.V.: Audio Systems for Technical Reading, in Computer Science. Cornell University, New York (1994)Google Scholar
  13. 13.
    Reddy, H., et al.: Listener-Controlled Dynamic Navigation of VoiceXML Documents. In: Miesenberger, K., Klaus, J., Zagler, W.L., Burger, D. (eds.) ICCHP 2004. LNCS, vol. 3118, pp. 347–354. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  14. 14.
    Soiffer, N.: Advances in Accessible Web-based Mathematics. In: CSUN International Conference on Technology and Persons with Disabilities (2005)Google Scholar
  15. 15.
    Gillan, D.J., et al.: Cognitive analysis of equation readings: application to the development of the MathGenie. In: Miesenberger, K., Klaus, J., Zagler, W.L., Burger, D. (eds.) ICCHP 2004. LNCS, vol. 3118, pp. 630–637. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  16. 16.
    Barraza, P., et al.: A cognitive analysis of equation reading applied to the development of assistive technology for visually-impaired students. In: Human Factors and Ergonomics Society Annual Meeting (2004)Google Scholar
  17. 17.
    Web Content Accessibility Guidelines (WCAG) 2.0 (2009),

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Iyad Abu Doush
    • 1
  • Enrico Pontelli
    • 1
  1. 1.Department of Computer ScienceNew Mexico State UniversityLas CrucesUSA

Personalised recommendations