Abstract
The line-up task hides a plot of real data amongst a line-up of decoys built around some plausible null hypothesis. It has been proposed as a mechanism for lending greater reliability and confidence to statistical inferences made from data graphics. The proposition is a seductive one, but whether or not line-ups guarantee consistent interpretation of statistical structure is an open question, especially when applied to representations of geo-spatial data. We build on empirical work around the extent to which statistical structure can be reliably judged in map line-ups, paying particular attention to the strategies employed when making line-up judgements. We conducted in-depth experiments with 19 graduate students equipped with a moderate background in geovisualization. The experiments consisted of a series of map line-up tasks with two map designs: choropleth maps and a centroid-dot alternative. We chose challenging tasks in the hope of exposing participants’ sensemaking activities. Through structured qualitative analysis of think-aloud protocols, we identify six sensemaking strategies and evaluate their effects in making judgements from map line-ups. We find five sensemaking strategies applicable to most visualization types, but one that seems particular to map line-up designs. We could not identify one single successful strategy, but users adopt a mix of different strategies, depending on the circumstances. We also found that choropleth maps were easier to use than centroid-dot maps.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Beecham, R., Dykes, J., Meulemans, W., Slingsby, A., Turkay, C., Wood, J.: Map LineUps: effects of spatial structure on graphical inference. IEEE Trans. Vis. Comput. Graph. 23(1), 391–400 (2017)
Boren, T., Ramey, J.: Thinking aloud: reconciling theory and practice. IEEE Trans. Prof. Commun. 43(3), 261–278 (2000)
Doppler Haider, J., Seidler, P., Pohl, M., Kodagoda, N., Adderley, R., Wong, B.L.W.: How analysts think: sense-making strategies in the analysis of temporal evolution and criminal network structures and activities. In: Proceedings of the Human Factors and Ergonomics Society 61st Annual Meeting 2017, Austin (2017)
Ericsson, K.A., Simon, H.A.: Protocol Analysis. MIT Press, Cambridge (1993)
Gigerenzer, G.: Gut Feelings: The Intelligence of the Unconscious. Penguin (2007)
Haider, J., et al.: Exploring the challenges of implementing guidelines for the design of visual analytics systems. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 59, no. 1, pp. 259–263 (2015)
Harrison, L., Yang, F., Franconeri, S., Chang, R.: Ranking visualizations of correlation using Weber’s Law. In: IEEE Conference on Information Visualization (InfoVis), vol. 20, pp. 1943–1952 (2014)
Hofmann, H., Follett, L., Majumder, M., Cook, D.: Graphical tests for power comparison of competing designs. IEEE Trans. Vis. Comput. Graph. 18(12), 2441–2448 (2012)
Klein, G.: Seeing What Others Don’t: The Remarkable Ways We Gain Insights. PublicAffairs, a Member of the Perseus Book Group, New York (2013)
Klein, G., Moon, B., Hoffman, R.R.: Making sense of sensemaking 1: alternative perspectives. IEEE Intell. Syst. 21(4), 70–73 (2006)
Klein, G., Moon, B., Hoffman, R.R.: Making sense of sensemaking 2: a macrocognitive model. IEEE Intell. Syst. 21(5), 88–92 (2006)
Kosara, R., Mackinlay, J.: Storytelling: the next step for visualization. Computer 46(5), 44–50 (2013)
Lee, B., Riche, N.H., Isenberg, P., Carpendale, S.: More than telling a story: transforming data into visually shared stories. IEEE Comput. Graph. Appl. 35(5), 84–90 (2015)
Lee, S., Kim, S., Hung, Y., Lam, H., Kang, Y., Yi, J.S.: How do people make sense of unfamiliar visualizations?: a grounded model of novice’s information visualization sensemaking. IEEE Trans. Vis. Comput. Graph. 22(1), 499–508 (2016)
Lemaire, P., Fabre, L.: Strategic aspects of human cognition: implications for understanding human reasoning. In: Methods of Though: Individual Differences in Reasoning Strategies, pp. 11–56 (2005)
Mayring, P.: Qualitative Inhaltsanalyse: Grundlagen und Techniken Beltz Verlag Weinheim (2003)
Newell, A., Simon, H.A.: Human Problem Solving, vol. 104. Prentice-Hall, Englewood Cliffs (1972)
O’Sullivan, D., Unwin, D.: Geographic Information Analysis, 2nd edn. Wiley, Hoboken (2010)
Pohl, M., Doppler Haider, J.: Sense-making strategies for the interpretation of visualizations-bridging the gap between theory and empirical research. Multimodal Technol. Interact. 1(3) (2017)
Rensink, R., Baldridge, G.: The perception of correlation in scatterplots. Comput. Graph. Forum 29, 1203–1210 (2010)
Schreier, M.: Qualitative Content Analysis in Practice. Sage Publications (2012)
Sedig, K., Parsons, P., Liang, H.N., Morey, J.: Supporting sensemaking of complex objects with visualizations: visibility and complementarity of interactions. In: Informatics. vol. 3, p. 20. Multidisciplinary Digital Publishing Institute (2016)
VanderPlas, S., Hofmann, H.: Spatial reasoning and data displays. IEEE Trans. Vis. Comput. Graph. 22(1), 459–468 (2016)
Wickham, H., Cook, D., Hofmann, H., Buja, A.: Graphical inference for Infovis. IEEE Trans. Vis. Comput. Graph. 16(6), 973–979 (2010)
Woll, S.: Everyday Thinking: Memory, Reasoning, and Judgment in the Real World. L. Erlbaum Associates, Mahwah (2001)
Zwaan, R.A., Magliano, J.P., Graesser, A.C.: Dimensions of situation model construction in narrative comprehension. J. Exp. Psychol. Learn. Mem. Cogn. 21(2), 386 (1995)
Acknowledgments
The research reported in this paper has received funding from the European Union 7th Framework Programme FP7/2007-2013, through the VALCRI project under grant agreement no. FP7-IP-608142, awarded to B.L. William Wong, Middlesex University London, and Partners.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 IFIP International Federation for Information Processing
About this paper
Cite this paper
Haider, J.D., Pohl, M., Beecham, R., Dykes, J. (2021). Strategies for Detecting Difference in Map Line-Up Tasks. In: Ardito, C., et al. Human-Computer Interaction – INTERACT 2021. INTERACT 2021. Lecture Notes in Computer Science(), vol 12934. Springer, Cham. https://doi.org/10.1007/978-3-030-85613-7_36
Download citation
DOI: https://doi.org/10.1007/978-3-030-85613-7_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-85612-0
Online ISBN: 978-3-030-85613-7
eBook Packages: Computer ScienceComputer Science (R0)
