Skip to main content

Word-Sized Eye-Tracking Visualizations

  • Conference paper
  • First Online:
Eye Tracking and Visualization (ETVIS 2015)

Part of the book series: Mathematics and Visualization ((MATHVISUAL))

Included in the following conference series:

Abstract

In user studies, eye tracking is often used in combination with other recordings, such as think-aloud protocols. However, it is difficult to analyze the eye-tracking data and transcribed recordings together because of missing data alignment and integration. We suggest the use of word-sized eye-tracking visualizations to augment the transcript with important events that occurred concurrently to the transcribed activities. We explore the design space of such graphics by discussing how existing eye-tracking visualizations can be scaled down to word size. The suggested visualizations can optionally be combined with other event-based data such as interaction logs. We demonstrate our concept by a prototypical analysis tool.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Baldauf, M., Fröhlich, P., Hutter, S.: KIBITZER: a wearable system for eye-gaze-based mobile urban exploration. In: Proceedings of the 1st Augmented Human International Conference, AH, pp. 9:1–9:5 (2010)

    Google Scholar 

  2. Beck, F., Dit, B., Velasco-Madden, J., Weiskopf, D., Poshyvanyk, D.: Rethinking user interfaces for feature location. In: Proceedings of the 23rd IEEE International Conference on Program Comprehension, ICPC, pp. 151–162. IEEE (2015)

    Google Scholar 

  3. Beck, F., Koch, S., Weiskopf, D.: Visual analysis and dissemination of scientific literature collections with SurVis. IEEE Trans. Vis. Comput. Graph. 22 (1), 180–189 (2016)

    Article  Google Scholar 

  4. Beck, F., Moseler, O., Diehl, S., Rey, G.D.: In situ understanding of performance bottlenecks through visually augmented code. In: Proceedings of the 21st IEEE International Conference on Program Comprehension, ICPC, pp. 63–72 (2013)

    Google Scholar 

  5. Beymer, D., Russell, D.M.: WebGazeAnalyzer: a system for capturing and analyzing web reading behavior using eye gaze. In: CHI ’05 Extended Abstracts on Human Factors in Computing Systems, CHI EA, pp. 1913–1916 (2005)

    Google Scholar 

  6. Blascheck, T., John, M., Kurzhals, K., Koch, S., Ertl, T.: VA2: a visual analytics approach for evaluating visual analytics applications. IEEE Trans. Vis. Comput. Graph. 22 (1), 61–70 (2016)

    Article  Google Scholar 

  7. Blascheck, T., Kurzhals, K., Raschke, M., Burch, M., Weiskopf, D., Ertl, T.: State-of-the-art of visualization for eye tracking data. In: EuroVis – STARs, pp. 63–82 (2014)

    Google Scholar 

  8. Blascheck, T., Raschke, M., Ertl, T.: Circular heat map transition diagram. In: Proceedings of the 2013 Conference on Eye Tracking South Africa, ETSA, pp. 58–61 (2013)

    Google Scholar 

  9. Brandes, U., Nick, B.: Asymmetric relations in longitudinal social networks. IEEE Trans. Vis. Comput. Graph. 17 (12), 2283–2290 (2011)

    Article  Google Scholar 

  10. Brewer, C.A., Harrower, M.: ColorBrewer 2.0. http://www.colorbrewer.org

  11. Brugman, H., Russel, A.: Annotating multimedia/multi-modal resources with ELAN. In: Proceedings of the Fourth International Conference on Language Resources and Evaluation, LREC, pp. 2065–2068 (2004)

    Google Scholar 

  12. Burch, M., Beck, F., Raschke, M., Blascheck, T., Weiskopf, D.: A dynamic graph visualization perspective on eye movement data. In: Proceedings of the 2014 Symposium on Eye Tracking Research & Applications, ETRA, pp. 151–158 (2014)

    Google Scholar 

  13. Burch, M., Schmauder, H., Raschke, M., Weiskopf, D.: Saccade plots. In: Proceedings of the 2014 Symposium on Eye Tracking Research & Applications, ETRA, pp. 307–310 (2014)

    Google Scholar 

  14. Burch, M., Vehlow, C., Beck, F., Diehl, S., Weiskopf, D.: Parallel Edge Splatting for scalable dynamic graph visualization. IEEE Trans. Vis. Comput. Graph. 17 (12), 2344–2353 (2011)

    Article  Google Scholar 

  15. Crowe, E.C., Narayanan, N.H.: Comparing interfaces based on what users watch and do. In: Proceedings of the 2000 Symposium on Eye Tracking Research & Applications, ETRA, pp. 29–36 (2000)

    Google Scholar 

  16. Dorr, M., Jarodzka, H., Barth, E.: Space-variant spatio-temporal filtering of video for gaze visualization and perceptual learning. In: Proceedings of the 2010 Symposium on Eye Tracking Research & Applications, ETRA, pp. 307–314 (2010)

    Google Scholar 

  17. Dou, W., Jeong, D.H., Stukes, F., Ribarsky, W., Lipford, H., Chang, R.: Recovering reasoning processes from user interactions. IEEE Comput. Graph. Appl. 29 (3), 52–61 (2009)

    Article  Google Scholar 

  18. Duchowski, A., Medlin, E., Courina, N., Gramopadhye, A., Melloy, B., Nair, S.: 3D eye movement analysis for VR visual inspection training. In: Proceedings of the 2002 Symposium on Eye Tracking Research & Applications, ETRA, pp. 103–155 (2002)

    Google Scholar 

  19. Franchak, J.M., Kretch, K.S., Soska, K.C., Babcock, J.S., Adolph, K.E.: Head-mounted eye-tracking of infants’ natural interactions: a new method. In: Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, ETRA, pp. 21–27 (2010)

    Google Scholar 

  20. Goffin, P., Willett, W., Fekete, J.D., Isenberg, P.: Exploring the placement and design of word-scale visualizations. IEEE Trans. Vis. Comput. Graph. 20 (12), 2291–2300 (2014)

    Article  Google Scholar 

  21. Goldberg, J.H., Helfman, J.I.: Visual scanpath representation. In: Proceedings of the 2010 Symposium on Eye Tracking Research & Applications, ETRA, pp. 203–210 (2010)

    Google Scholar 

  22. Goldberg, J.H., Kotval, X.P.: Computer interface evaluation using eye movements: methods and constructs. Int. J. Ind. Ergon. 24, 631–645 (1999)

    Article  Google Scholar 

  23. Hlawatsch, M., Burch, M., Beck, F., Freire, J., Silva, C.T., Weiskopf, D.: Visualizing the evolution of module workflows. In: Proceedings of the International Conference on Information Visualisation, IV, pp. 40–49 (2015)

    Google Scholar 

  24. Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Van de Weijer, J.: Eye Tracking: A Comprehensive Guide to Methods and Measures, 1st edn. Oxford University Press, Oxford (2011)

    Google Scholar 

  25. Holsanova, J.: Picture viewing and picture description: two windows on the mind. Ph.D. thesis, Lund University (2001)

    Google Scholar 

  26. Holsanova, J.: Dynamics of picture viewing and picture description. Adv. Conscious. Res. 67, 235–256 (2006)

    Article  Google Scholar 

  27. Hurter, C., Ersoy, O., Fabrikant, S., Klein, T., Telea, A.: Bundled visualization of dynamic graph and trail data. IEEE Trans. Vis. Comput. Graph. 20 (8), 1141–1157 (2014)

    Article  Google Scholar 

  28. Itoh, K., Tanaka, H., Seki, M.: Eye-movement analysis of track monitoring patterns of night train operators: effects of geographic knowledge and fatigue. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 44, pp. 360–363 (2000)

    Google Scholar 

  29. Kipp, M.: ANVIL – a generic annotation tool for multimodal dialogue. In: Proceedings of the 7th European Conference on Speech Communication and Technology, Eurospeech, pp. 1367–1370 (2001)

    Google Scholar 

  30. Kipp, M.: Spatiotemporal coding in ANVIL. In: Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC, pp. 2042–2045 (2008)

    Google Scholar 

  31. Kipp, M.: ANVIL: The video annotation research tool. In: Jacques Durand, U.G., Kristoffersen, G. (eds.) The Oxford Handbook of Corpus Phonology, chap. 21, pp. 420–436. Oxford University Press, Oxford (2014)

    Google Scholar 

  32. Lankford, C.: Gazetracker: software designed to facilitate eye movement analysis. In: Proceedings of the 2000 Symposium on Eye Tracking Research & Applications, ETRA, pp. 51–55 (2000)

    Google Scholar 

  33. Lee, B., Henry Riche, N., Karlson, A.K., Carpendale, S.: SparkClouds: visualizing trends in tag clouds. IEEE Trans. Vis. Comput. Graph. 16 (6), 1182–1189 (2010)

    Article  Google Scholar 

  34. Lipford, H.R., Stukes, F., Dou, W., Hawkins, M.E., Chang, R.: Helping users recall their reasoning process. In: Proceedings of the 2010 IEEE Symposium on Visual Analytics Science and Technology, VAST, pp. 187–194 (2010)

    Google Scholar 

  35. Mackworth, J.F., Mackworth, N.H.: Eye fixations recorded on changing visual scenes by the television eye-marker. J. Opt. Soc. Am. 48 (7), 439–444 (1958)

    Article  Google Scholar 

  36. Minelli, R., Mocci, A., Lanza, M., Baracchi, L.: Visualizing developer interactions. In: Proceedings of the Second IEEE Working Conference on Software Visualization, VISSOFT, pp. 147–156 (2014)

    Google Scholar 

  37. Neumann, P., Schlechtweg, S., Carpendale, S.: ArcTrees: Visualizing relations in hierarchical data. In: Proceedings of the 7th Joint Eurographics/IEEE VGTC Conference on Visualization, EuroVis, pp. 53–60 (2005)

    Google Scholar 

  38. Noton, D., Stark, L.: Scanpaths in saccadic eye movements while viewing and recognizing patterns. Vis. Res. 11, 929942 (1971)

    Article  Google Scholar 

  39. Paletta, L., Santner, K., Fritz, G., Mayer, H., Schrammel, J.: 3D attention: measurement of visual saliency using eye tracking glasses. In: CHI’13 Extended Abstracts on Human Factors in Computing Systems, CHI EA, pp. 199–204 (2013)

    Google Scholar 

  40. Pellacini, F., Lorigo, L., Gay, G.: Visualizing Paths in Context. Technical report #TR2006-580, Department of Computer Science, Dartmouth College (2006)

    Google Scholar 

  41. Räihä, K.J., Aula, A., Majaranta, P., Rantala, H., Koivunen, K.: Static visualization of temporal eye-tracking data. In: Costabile, M.F., Paternò, F. (eds.) Human-Computer Interaction-INTERACT 2005. LNCS, vol. 3585, pp. 946–949. Springer Berlin Heidelberg (2005)

    Chapter  Google Scholar 

  42. Ramloll, R., Trepagnier, C., Sebrechts, M., Beedasy, J.: Gaze data visualization tools: opportunities and challenges. In: Proceedings of the 8th International Conference on Information Visualization, IV, pp. 173–180 (2004)

    Google Scholar 

  43. Reda, K., Johnson, A., Leigh, J., Papke, M.: Evaluating user behavior and strategy during visual exploration. In: Proceedings of the 2014 BELIV Workshop, pp. 70–77 (2014)

    Google Scholar 

  44. Saraiya, P., North, C., Duca, K.: An insight-based methodology for evaluating bioinformatics visualizations. IEEE Trans. Vis. Comput. Graph. 11 (4), 443–456 (2005)

    Article  Google Scholar 

  45. Schulz, C.M., Schneider, E., Fritz, L., Vockeroth, J., Hapfelmeier, A., Brandt, T., Kochs, E.F., Schneider, G.: Visual attention of anaesthetists during simulated critical incidents. Br. J. Anaesth. 106 (6), 807–813 (2011)

    Article  Google Scholar 

  46. Sloetjes, H., Wittenburg, P.: Annotation by category – ELAN and ISO DCR. In: Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC, pp. 816–820 (2008)

    Google Scholar 

  47. Smuc, M., Mayr, E., Lammarsch, T., Aigner, W., Miksch, S., Gartner, J.: To score or not to score? Tripling insights for participatory design. IEEE Comput. Graph. Appl. 29, 29–38 (2009)

    Article  Google Scholar 

  48. Špakov, O., Räihä, K.J.: KiEV: a tool for visualization of reading and writing processes in translation of text. In: Proceedings of the 2008 Symposium on Eye Tracking Research & Applications, ETRA, pp. 107–110 (2008)

    Google Scholar 

  49. Tufte, E.R.: Beautiful Evidence, 1st edn. Graphics Press, Cheshire (2006)

    Google Scholar 

  50. Weibel, N., Fouse, A., Emmenegger, C., Kimmich, S., Hutchins, E.: Let’s look at the cockpit: exploring mobile eye-tracking for observational research on the flight deck. In: Proceedings of the 2012 Symposium on Eye Tracking Research & Applications, ETRA, pp. 107–114 (2012)

    Google Scholar 

  51. Yarbus, A.L.: Eye Movements and Vision. Plenum Press, New York (1967)

    Book  Google Scholar 

Download references

Acknowledgements

Fabian Beck is indebted to the Baden-Württemberg Stiftung for the financial support of this research project within the Postdoctoral Fellowship for Leading Early Career Researchers.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fabian Beck .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Beck, F., Blascheck, T., Ertl, T., Weiskopf, D. (2017). Word-Sized Eye-Tracking Visualizations. In: Burch, M., Chuang, L., Fisher, B., Schmidt, A., Weiskopf, D. (eds) Eye Tracking and Visualization. ETVIS 2015. Mathematics and Visualization. Springer, Cham. https://doi.org/10.1007/978-3-319-47024-5_7

Download citation

Publish with us

Policies and ethics