Abstract
Evaluations have long been missing or imperfect in a publication presenting a new visualization technique, but proper evaluations are now becoming a standard. There are many reasons for the reluctance of evaluating visualization techniques, including the complexity of the task and the amount of work required. We propose a simple evaluation approach that consists of a set of tasks carried out in an experimental setting coupled with eye tracking to approximate the focus of the user’s attention. In addition, we discuss three methods to visualize the gaze data to gain insight into the user’s attention distribution, and show examples from a study where a parallel coordinate browser was evaluated.
Chapter PDF
Similar content being viewed by others
Keywords
- Visualization Technique
- Transition Graph
- Grey Background
- Information Visualization
- Interactive Visualization
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Spence, R.: Information Visualization – Design for Interaction. Prentice-Hall Europe, Pearson Education Ltd., Harlow, England (2007)
Ellis, G., Dix, A.: An explorative analysis of user evaluation studies in information visualisation. In: BELIV 2006 - Beyond Time and Errors: Novel Evaluation Methods for Information Visualisation (AVI 2006 Workshop). ACM Press, New York (2006)
Nielsen, J., Pernice, K.: Eyetracking Web Usability. New Riders Press, Indianapolis (2009)
Posner, M.I.: Orienting of attention. Quarterly Journal of Experimental Psychology 32, 3–25 (1980)
Saraiya, P., North, C., Duca, K.: An insight-based methodology for evaluating bioinformatics visualizations. IEEE Transactions on Visualization and Computer Graphics 11(4), 443–456 (2005)
Saraiya, P., North, C., Lam, V., Duca, K.A.: An insight-based longitudinal study of visual analytics. IEEE Transactions on Visualization and Computer Graphics 12(6), 1511–1522 (2006)
Shneiderman, B., Plaisant, C.: Strategies for evaluating information visualization tools: multi-dimensional in-depth long-term case studies. In: BELIV 2006: Proceedings of the 2006 AVI Workshop on Beyond Time and Errors, pp. 1–7. ACM, New York (2006)
Isenberg, P., Zuk, T., Collins, C., Carpendale, S.: Grounded evaluation of information visualizations. In: BELIV 2008: Proceedings of the 2008 Conference on Beyond Time and Errors, pp. 1–8. ACM, New York (2008)
Bertini, E., Plaisant, C., Santucci, G.: Beliv 2006: beyond time and errors; novel evaluation methods for information visualization. Interactions 14(3), 59–60 (2007)
Bertini, E., Perer, A., Plaisant, C., Santucci, G.: Beliv 2008: Beyond time and errors: novel evaluation methods for information visualization. In: CHI 2008: CHI 2008 Extended Abstracts on Human Factors in Computing Systems, pp. 3913–3916. ACM, New York (2008)
Andrews, K.: Evaluation comes in many guises. In: BELIV 2008: Beyond Time and Errors: Novel Evaluation Methods for Information Visualization (revised position paper; CHI 2008 workshop) (April 2008)
O’Connell, T.A., Choong, Y.Y.: User-centered evaluation methodology for interactive visualizations. In: BELIV 2008: Beyond Time and Errors: Novel Evaluation Methods for Information Visualization (position paper; CHI 2008 workshop) (April 2008)
Robertson, G.G.: Beyond time and errors – position statement. In: BELIV 2008: Beyond Time and Errors: Novel Evaluation Methods for Information Visualization (position paper; CHI 2008 workshop) (April 2008)
Goldberg, J.H., Kotval, X.P.: Computer interface evaluation using eye movements: methods and constructs. International Journal of Industrial Ergonomics 24, 631–645 (1999)
Jacob, R.J.K., Karn, K.S.: Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. In: Hyona, J., Radach, R., Deubel, H. (eds.) The Mind’s Eye: Cognitive and Applied Aspects of Eye Movement Research, pp. 573–605. Elsevier Science, Amsterdam (2003)
Ramloll, R., Trepagnier, C., Sebrechts, M., Beedasy, J.: Gaze data visualization tools: Opportunities and challenges. In: International Conference on Information Visualisation, pp. 173–180 (2004)
Špakov, O.: iComponent - Device-Independent Platform for Analyzing Eye Movement Data and Developing Eye-based Applications. In: Dissertations in Interactive Technology, vol. 9, University of Tampere (2008)
North, C.: Visualization Viewpoints: Toward measuring visualization insight. IEEE Computer Graphics and Applications 26(3), 6–9 (2006)
Hyrskykari, A., Ovaska, S., Majaranta, P., Räihä, K.J., Lehtinen, M.: Gaze path stimulation in retrospective think-aloud. Journal of Eye-Movement Research 2(4), 1–18 (2008)
Siirtola, H.: Direct manipulation of parallel coordinates. In: CHI 2000: CHI 2000 Extended Abstracts on Human Factors in Computing Systems, pp. 119–120. ACM, New York (2000)
Siirtola, H.: Direct manipulation of parallel coordinates. In: IV 2000: Proceedings of the International Conference on Information Visualization, pp. 373–378. IEEE Computer Society, Los Alamitos (2000)
Siirtola, H., Laivo, T., Heimonen, T., Räihä, K.J.: Visual perception of parallel coordinate visualizations. In: IV 2009: Proceedings of the Thirteenth International Conference on Information Visualization, pp. 3–9. IEEE Computer Society Press, Los Alamitos (2009)
Siirtola, H.: Parallel Coordinate Explorer (2000), http://www.cs.uta.fi/~hs/pce/
Nielsen, J.: Usability Engineering. Academic Press, Inc., London (1993)
Siirtola, H., Räihä, K.J.: Interacting with parallel coordinates. Interacting with Computers 18(6), 1278–1309 (2006)
Pomplun, M., Ritter, H., Velichkovsky, B.: Disambiguating complex visual information: Towards communication of personal views of a scene. Perception (25), 931–948 (1996)
Wooding, D.S.: Fixation maps: quantifying eye-movement traces. In: ETRA 2002: Proceedings of the 2002 Symposium on Eye Tracking Research & Applications, pp. 31–36. ACM, New York (2002)
Bojko, A.: Informative or misleading? Heatmaps deconstructed. In: Jacko, J.A. (ed.) Human-Computer Interaction, HCII 2009, Part I. LNCS, vol. 5610, pp. 30–39. Springer, Heidelberg (2009)
R Development Core Team: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria (2010) ISBN 3-900051-07-0
Aho, A.V., Kernighan, B.W., Weinberger, P.J.: The AWK programming language. Addison-Wesley Longman Publishing Co., Inc., Boston (1987)
Graphviz: Graphviz – graph visualization software (2008), http://www.graphviz.org/
Salvucci, D.D., Goldberg, J.H.: Identifying fixations and saccades in eye-tracking protocols. In: ETRA 2000: Proceedings of the 2000 Symposium on Eye Tracking Research & Applications, pp. 71–78. ACM, New York (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 IFIP International Federation for Information Processing
About this paper
Cite this paper
Siirtola, H., Räihä, KJ. (2011). Using Gaze Data in Evaluating Interactive Visualizations. In: Ebert, A., Dix, A., Gershon, N.D., Pohl, M. (eds) Human Aspects of Visualization. HCIV 2009. Lecture Notes in Computer Science, vol 6431. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19641-6_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-19641-6_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-19640-9
Online ISBN: 978-3-642-19641-6
eBook Packages: Computer ScienceComputer Science (R0)