Abstract
In user studies, eye tracking is often used in combination with other recordings, such as think-aloud protocols. However, it is difficult to analyze the eye-tracking data and transcribed recordings together because of missing data alignment and integration. We suggest the use of word-sized eye-tracking visualizations to augment the transcript with important events that occurred concurrently to the transcribed activities. We explore the design space of such graphics by discussing how existing eye-tracking visualizations can be scaled down to word size. The suggested visualizations can optionally be combined with other event-based data such as interaction logs. We demonstrate our concept by a prototypical analysis tool.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Baldauf, M., Fröhlich, P., Hutter, S.: KIBITZER: a wearable system for eye-gaze-based mobile urban exploration. In: Proceedings of the 1st Augmented Human International Conference, AH, pp. 9:1–9:5 (2010)
Beck, F., Dit, B., Velasco-Madden, J., Weiskopf, D., Poshyvanyk, D.: Rethinking user interfaces for feature location. In: Proceedings of the 23rd IEEE International Conference on Program Comprehension, ICPC, pp. 151–162. IEEE (2015)
Beck, F., Koch, S., Weiskopf, D.: Visual analysis and dissemination of scientific literature collections with SurVis. IEEE Trans. Vis. Comput. Graph. 22 (1), 180–189 (2016)
Beck, F., Moseler, O., Diehl, S., Rey, G.D.: In situ understanding of performance bottlenecks through visually augmented code. In: Proceedings of the 21st IEEE International Conference on Program Comprehension, ICPC, pp. 63–72 (2013)
Beymer, D., Russell, D.M.: WebGazeAnalyzer: a system for capturing and analyzing web reading behavior using eye gaze. In: CHI ’05 Extended Abstracts on Human Factors in Computing Systems, CHI EA, pp. 1913–1916 (2005)
Blascheck, T., John, M., Kurzhals, K., Koch, S., Ertl, T.: VA2: a visual analytics approach for evaluating visual analytics applications. IEEE Trans. Vis. Comput. Graph. 22 (1), 61–70 (2016)
Blascheck, T., Kurzhals, K., Raschke, M., Burch, M., Weiskopf, D., Ertl, T.: State-of-the-art of visualization for eye tracking data. In: EuroVis – STARs, pp. 63–82 (2014)
Blascheck, T., Raschke, M., Ertl, T.: Circular heat map transition diagram. In: Proceedings of the 2013 Conference on Eye Tracking South Africa, ETSA, pp. 58–61 (2013)
Brandes, U., Nick, B.: Asymmetric relations in longitudinal social networks. IEEE Trans. Vis. Comput. Graph. 17 (12), 2283–2290 (2011)
Brewer, C.A., Harrower, M.: ColorBrewer 2.0. http://www.colorbrewer.org
Brugman, H., Russel, A.: Annotating multimedia/multi-modal resources with ELAN. In: Proceedings of the Fourth International Conference on Language Resources and Evaluation, LREC, pp. 2065–2068 (2004)
Burch, M., Beck, F., Raschke, M., Blascheck, T., Weiskopf, D.: A dynamic graph visualization perspective on eye movement data. In: Proceedings of the 2014 Symposium on Eye Tracking Research & Applications, ETRA, pp. 151–158 (2014)
Burch, M., Schmauder, H., Raschke, M., Weiskopf, D.: Saccade plots. In: Proceedings of the 2014 Symposium on Eye Tracking Research & Applications, ETRA, pp. 307–310 (2014)
Burch, M., Vehlow, C., Beck, F., Diehl, S., Weiskopf, D.: Parallel Edge Splatting for scalable dynamic graph visualization. IEEE Trans. Vis. Comput. Graph. 17 (12), 2344–2353 (2011)
Crowe, E.C., Narayanan, N.H.: Comparing interfaces based on what users watch and do. In: Proceedings of the 2000 Symposium on Eye Tracking Research & Applications, ETRA, pp. 29–36 (2000)
Dorr, M., Jarodzka, H., Barth, E.: Space-variant spatio-temporal filtering of video for gaze visualization and perceptual learning. In: Proceedings of the 2010 Symposium on Eye Tracking Research & Applications, ETRA, pp. 307–314 (2010)
Dou, W., Jeong, D.H., Stukes, F., Ribarsky, W., Lipford, H., Chang, R.: Recovering reasoning processes from user interactions. IEEE Comput. Graph. Appl. 29 (3), 52–61 (2009)
Duchowski, A., Medlin, E., Courina, N., Gramopadhye, A., Melloy, B., Nair, S.: 3D eye movement analysis for VR visual inspection training. In: Proceedings of the 2002 Symposium on Eye Tracking Research & Applications, ETRA, pp. 103–155 (2002)
Franchak, J.M., Kretch, K.S., Soska, K.C., Babcock, J.S., Adolph, K.E.: Head-mounted eye-tracking of infants’ natural interactions: a new method. In: Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, ETRA, pp. 21–27 (2010)
Goffin, P., Willett, W., Fekete, J.D., Isenberg, P.: Exploring the placement and design of word-scale visualizations. IEEE Trans. Vis. Comput. Graph. 20 (12), 2291–2300 (2014)
Goldberg, J.H., Helfman, J.I.: Visual scanpath representation. In: Proceedings of the 2010 Symposium on Eye Tracking Research & Applications, ETRA, pp. 203–210 (2010)
Goldberg, J.H., Kotval, X.P.: Computer interface evaluation using eye movements: methods and constructs. Int. J. Ind. Ergon. 24, 631–645 (1999)
Hlawatsch, M., Burch, M., Beck, F., Freire, J., Silva, C.T., Weiskopf, D.: Visualizing the evolution of module workflows. In: Proceedings of the International Conference on Information Visualisation, IV, pp. 40–49 (2015)
Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Van de Weijer, J.: Eye Tracking: A Comprehensive Guide to Methods and Measures, 1st edn. Oxford University Press, Oxford (2011)
Holsanova, J.: Picture viewing and picture description: two windows on the mind. Ph.D. thesis, Lund University (2001)
Holsanova, J.: Dynamics of picture viewing and picture description. Adv. Conscious. Res. 67, 235–256 (2006)
Hurter, C., Ersoy, O., Fabrikant, S., Klein, T., Telea, A.: Bundled visualization of dynamic graph and trail data. IEEE Trans. Vis. Comput. Graph. 20 (8), 1141–1157 (2014)
Itoh, K., Tanaka, H., Seki, M.: Eye-movement analysis of track monitoring patterns of night train operators: effects of geographic knowledge and fatigue. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 44, pp. 360–363 (2000)
Kipp, M.: ANVIL – a generic annotation tool for multimodal dialogue. In: Proceedings of the 7th European Conference on Speech Communication and Technology, Eurospeech, pp. 1367–1370 (2001)
Kipp, M.: Spatiotemporal coding in ANVIL. In: Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC, pp. 2042–2045 (2008)
Kipp, M.: ANVIL: The video annotation research tool. In: Jacques Durand, U.G., Kristoffersen, G. (eds.) The Oxford Handbook of Corpus Phonology, chap. 21, pp. 420–436. Oxford University Press, Oxford (2014)
Lankford, C.: Gazetracker: software designed to facilitate eye movement analysis. In: Proceedings of the 2000 Symposium on Eye Tracking Research & Applications, ETRA, pp. 51–55 (2000)
Lee, B., Henry Riche, N., Karlson, A.K., Carpendale, S.: SparkClouds: visualizing trends in tag clouds. IEEE Trans. Vis. Comput. Graph. 16 (6), 1182–1189 (2010)
Lipford, H.R., Stukes, F., Dou, W., Hawkins, M.E., Chang, R.: Helping users recall their reasoning process. In: Proceedings of the 2010 IEEE Symposium on Visual Analytics Science and Technology, VAST, pp. 187–194 (2010)
Mackworth, J.F., Mackworth, N.H.: Eye fixations recorded on changing visual scenes by the television eye-marker. J. Opt. Soc. Am. 48 (7), 439–444 (1958)
Minelli, R., Mocci, A., Lanza, M., Baracchi, L.: Visualizing developer interactions. In: Proceedings of the Second IEEE Working Conference on Software Visualization, VISSOFT, pp. 147–156 (2014)
Neumann, P., Schlechtweg, S., Carpendale, S.: ArcTrees: Visualizing relations in hierarchical data. In: Proceedings of the 7th Joint Eurographics/IEEE VGTC Conference on Visualization, EuroVis, pp. 53–60 (2005)
Noton, D., Stark, L.: Scanpaths in saccadic eye movements while viewing and recognizing patterns. Vis. Res. 11, 929942 (1971)
Paletta, L., Santner, K., Fritz, G., Mayer, H., Schrammel, J.: 3D attention: measurement of visual saliency using eye tracking glasses. In: CHI’13 Extended Abstracts on Human Factors in Computing Systems, CHI EA, pp. 199–204 (2013)
Pellacini, F., Lorigo, L., Gay, G.: Visualizing Paths in Context. Technical report #TR2006-580, Department of Computer Science, Dartmouth College (2006)
Räihä, K.J., Aula, A., Majaranta, P., Rantala, H., Koivunen, K.: Static visualization of temporal eye-tracking data. In: Costabile, M.F., Paternò, F. (eds.) Human-Computer Interaction-INTERACT 2005. LNCS, vol. 3585, pp. 946–949. Springer Berlin Heidelberg (2005)
Ramloll, R., Trepagnier, C., Sebrechts, M., Beedasy, J.: Gaze data visualization tools: opportunities and challenges. In: Proceedings of the 8th International Conference on Information Visualization, IV, pp. 173–180 (2004)
Reda, K., Johnson, A., Leigh, J., Papke, M.: Evaluating user behavior and strategy during visual exploration. In: Proceedings of the 2014 BELIV Workshop, pp. 70–77 (2014)
Saraiya, P., North, C., Duca, K.: An insight-based methodology for evaluating bioinformatics visualizations. IEEE Trans. Vis. Comput. Graph. 11 (4), 443–456 (2005)
Schulz, C.M., Schneider, E., Fritz, L., Vockeroth, J., Hapfelmeier, A., Brandt, T., Kochs, E.F., Schneider, G.: Visual attention of anaesthetists during simulated critical incidents. Br. J. Anaesth. 106 (6), 807–813 (2011)
Sloetjes, H., Wittenburg, P.: Annotation by category – ELAN and ISO DCR. In: Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC, pp. 816–820 (2008)
Smuc, M., Mayr, E., Lammarsch, T., Aigner, W., Miksch, S., Gartner, J.: To score or not to score? Tripling insights for participatory design. IEEE Comput. Graph. Appl. 29, 29–38 (2009)
Špakov, O., Räihä, K.J.: KiEV: a tool for visualization of reading and writing processes in translation of text. In: Proceedings of the 2008 Symposium on Eye Tracking Research & Applications, ETRA, pp. 107–110 (2008)
Tufte, E.R.: Beautiful Evidence, 1st edn. Graphics Press, Cheshire (2006)
Weibel, N., Fouse, A., Emmenegger, C., Kimmich, S., Hutchins, E.: Let’s look at the cockpit: exploring mobile eye-tracking for observational research on the flight deck. In: Proceedings of the 2012 Symposium on Eye Tracking Research & Applications, ETRA, pp. 107–114 (2012)
Yarbus, A.L.: Eye Movements and Vision. Plenum Press, New York (1967)
Acknowledgements
Fabian Beck is indebted to the Baden-Württemberg Stiftung for the financial support of this research project within the Postdoctoral Fellowship for Leading Early Career Researchers.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Beck, F., Blascheck, T., Ertl, T., Weiskopf, D. (2017). Word-Sized Eye-Tracking Visualizations. In: Burch, M., Chuang, L., Fisher, B., Schmidt, A., Weiskopf, D. (eds) Eye Tracking and Visualization. ETVIS 2015. Mathematics and Visualization. Springer, Cham. https://doi.org/10.1007/978-3-319-47024-5_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-47024-5_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-47023-8
Online ISBN: 978-3-319-47024-5
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)