Developing a Verbal Assistance System for Line Graph Comprehension

  • Cengiz Acartürk
  • Özge Alaçam
  • Christopher Habel
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8518)


Statistical graphs have been designed for accessible use by visually impaired users. Haptic devices provide an appropriate interface for haptic exploration of statistical graphs. However, haptic exploration of statistical graphs reveals a more local and sequential inspection pattern compared to visual exploration. This difference between haptic exploration and visual exploration is usually attributed to different characteristics of the exploration processes, such as bandwidth of information extraction. To facilitate information extraction from statistical graphs, alternative sensory modalities have been employed. In particular, line graphs have been represented by sound, thus leading to sonified graphs. Despite their demonstrated facilitating effects, sonified graphs have limitations under complex line representations. One method of overcoming those difficulties is to develop a verbal assistance system for haptic line graph comprehension. In the present article, we summarize our studies on designing and developing a verbal assistance system for haptic line graph comprehension. We present the findings in a set of studies conducted with blindfolded and visually impaired participants.


Haptic Graph Comprehension Verbal Assistance 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kosslyn, S.M.: Understanding Charts and Graphs. Applied Cognitive Psychology 3, 185–226 (1989)CrossRefGoogle Scholar
  2. 2.
    Acartürk, C.: Towards a systematic understanding of graphical cues in communication through statistical graphs. Journal of Visual Languages and Computing (2014), doi:10.1016/j.jvlc.2013.11.006Google Scholar
  3. 3.
    Zacks, J., Levy, E., Tversky, B., Schiano, D.: Graphs in Print. In: Anderson, M., Meyer, B., Olivier, P. (eds.) Diagrammatic Representation and Reasoning, pp. 187–206. Springer, London (2002)CrossRefGoogle Scholar
  4. 4.
    Abu Doush, I., Pontelli, E., Simon, D., Son, T.C., Ma, O.: Making Microsoft ExcelTM Accessible: Multimodal Presentation of Charts. In: Proceedings Eleventh International ACM SIGACCESS Conference on Computers and Accessibility, Pittsburg, PA, USA, pp. 147–154 (2009)Google Scholar
  5. 5.
    Habel, C., Acartürk, C.: Towards Comprehension of Haptic Multiple-line Graphs. In: Goncu, C., Marriott, K. (eds.) Proceedings of the Diagrams Workshop on Accessible Graphics: Graphics for Vision Impaired People. Kent, UK (2012)Google Scholar
  6. 6.
    Yu, W., Brewster, S.A.: Evaluation of Multimodal Graphs for Blind People. Journal of Universal Access in the Information Society 2, 105–124 (2003)CrossRefGoogle Scholar
  7. 7.
    Pinker, S.: A theory of graph comprehension. Artificial Intelligence and the Future of Testing, 73–126 (1990)Google Scholar
  8. 8.
    Acarturk, C., Habel, C., Cagiltay, K., Alacam, O.: Multimodal Comprehension of Language and Graphics: Graphs with and without Annotations. Journal of Eye Movement Research 1, 2 (2008)Google Scholar
  9. 9.
    Alaçam, Ö., Habel, C., Acartürk, C.: Towards designing audio assistance for comprehending haptic graphs: A Multimodal Perspective. In: Stephanidis, C., Antona, M. (eds.) UAHCI/HCII 2013, Part I. LNCS, vol. 8009, pp. 409–418. Springer, Heidelberg (2013a)Google Scholar
  10. 10.
    Alaçam, Ö., Habel, C., Acartürk, C.: Investigation of Haptic Line-Graph Comprehension Through Co-Production of Gesture and Language. Tilburg Gesture Research Meeting, Tilburg (2013b)Google Scholar
  11. 11.
    Habel, C., Acartürk, C.: On Reciprocal Improvement in Multimodal Generation: Co-reference by Text and Information Graphics. In: van der Sluis, I., Theune, M., Reiter, E., Krahmer, E. (eds.) Proceedings of the Workshop on Multimodal Output Generation, MOG 2007, pp. 69–80 (2007)Google Scholar
  12. 12.
    Habel, C., Acartürk, C.: Eye-tracking Evidence for Multimodal Language-graphics Comprehension: The Role of Integrated Conceptual Representations. In: Proceedings of NODALIDA 2009: The Workshop on Multimodal Communication - From Human Behavior to Computational Models, vol. 6 (2009)Google Scholar
  13. 13.
    Habel, C., Alaçam, Ö., Acartürk, C.: Verbally assisted comprehension of haptic line-graphs: referring expressions in a collaborative activity. In: Proceedings of the CogSci 2013 Workshop on Production of Referring Expressions, Berlin (2013)Google Scholar
  14. 14.
    Alaçam, Ö., Habel, C., Acartürk, C.: The role of shape in comprehending haptic line graphs (Submitted-a)Google Scholar
  15. 15.
    Alaçam, Ö., Habel, C., Acartürk, C.: Verbally Assisted Haptic Graph Comprehension: The Role of Taking Initiative in a Joint Activity (Submitted-b)Google Scholar
  16. 16.
    Vecchi, T., Cattaneo, Z.: Blind Vision: The Neuroscience of Visual Impairment. MIT Press (2011)Google Scholar
  17. 17.
    PRBO. Waterbird Census at Bolinas Lagoon, MarinCounty, CA. Public report by Wetlands Ecology Division, Point Reyes Bird Observatory (PRBO) Conservation Science (2012), (retrieved on January 29, 2012)

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Cengiz Acartürk
    • 1
  • Özge Alaçam
    • 2
  • Christopher Habel
    • 2
  1. 1.Informatics InstituteMiddle East Technical UniversityAnkaraTurkey
  2. 2.Department of InformaticsUniversity of HamburgHamburgGermany

Personalised recommendations