The Impact of Streaming Data on Sensemaking with Mixed-Initiative Visual Analytics

  • Nick Cramer
  • Grant Nakamura
  • Alex EndertEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10284)


Visual data analysis helps people gain insights into data via interactive visualizations. People generate and test hypotheses and questions about data in context of the domain. This process can generally be referred to as sensemaking. Much of the work on studying sensemaking (and creating visual analytic techniques in support of it) has been focused on static datasets. However, how do the cognitive processes of sensemaking change when data are changing? Further, what implication for design does this create for mixed-initiative visual analytics systems? This paper presents the results of a user study analyzing the impact of streaming data on sensemaking. To perform this study, we developed a mixed-initiative visual analytic prototype, the Streaming Canvas, that affords the analysis of streaming text data. We compare the sensemaking process of people using this tool for a static and streaming dataset. We present the results of this study and discuss the implications on future visual analytic systems that combine machine learning and interactive visualization to help people make sense of streaming data.


Sensemaking Streaming data Visual analytics 



The research described in this paper is part of the Analysis In Motion Initiative and the Signature Discovery Initiative at Pacific Northwest National Laboratory. It was conducted under the Laboratory Directed Research and Development Program at PNNL, a multiprogram national laboratory operated by Battelle for the U.S. Department of Energy.


  1. 1.
    Alsakran, J., Chen, Y., Zhao, Y., Yang, J., Luo, D.: STREAMIT: dynamic visualization and interactive exploration of text streams (2011)Google Scholar
  2. 2.
    Andrews, C., Endert, A., North, C.: Space to think: large high-resolution displays for sensemaking. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2010), pp. 55–64 (2010)Google Scholar
  3. 3.
    Andrews, C., North, C.: Analyst’s workspace: an embodied sensemaking environment for large, high-resolution displays. In: 2012 IEEE Conference on Visual Analytics Science and Technology (VAST), pp. 123–131 (2012)Google Scholar
  4. 4.
    Bradel, L., North, C., House, L.: Multi-model semantic interaction for text analytics. In: Proceedings of IEEE Conference on Visual Analytics Science and Technology (VAST 2014), pp. 163–172 (2014)Google Scholar
  5. 5.
    Endert, A.: Semantic interaction for visual analytics: inferring analytical reasoning for model steering. Synth. Lect. Vis. 4(2), 1–99 (2016)CrossRefGoogle Scholar
  6. 6.
    Endert, A., Chang, R., North, C., Zhou, M.: Semantic interaction: coupling cognition and computation through usable interactive analytics. IEEE Comput. Graph. Appl. 35(4), 94–99 (2015)CrossRefGoogle Scholar
  7. 7.
    Endert, A., Fiaux, P., North, C.: Semantic interaction for sensemaking: inferring analytical reasoning for model steering. In: IEEE Conference on Visual Analytics Science and Technology (2012)Google Scholar
  8. 8.
    Endert, A., Fiaux, P., North, C.: Semantic interaction for visual text analytics. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2012), pp. 473–482 (2012)Google Scholar
  9. 9.
    Endert, A., Fox, S., Maiti, D., Leman, S.C., North, C.: The Semantics of Clustering: Analysis of User-Generated Spatializations of Text Documents (2012)Google Scholar
  10. 10.
    Endert, A., Hossain, M.S., Ramakrishnan, N., North, C., Fiaux, P., Andrews, C.: The human is the loop: new directions for visual analytics. J. Intell. Inf. Syst. 1–25 (2014)Google Scholar
  11. 11.
    Endert, A., Pike, W.A., Cook, K.: From streaming data to streaming insights: the impact of data velocities on mental models (2012)Google Scholar
  12. 12.
    Fischer, F., Mansmann, F., Keim, D.A.: Real-time visual analytics for event data streams. In: Proceedings of the 27th Annual ACM Symposium on Applied Computing, SAC 2012, pp. 801–806. ACM, New York (2012)Google Scholar
  13. 13.
    Jolaoso, S., Burtner, R., Endert, A.: Toward a deeper understanding of data analysis, sensemaking, and signature discovery. In: Abascal, J., Barbosa, S., Fetter, M., Gross, T., Palanque, P., Winckler, M. (eds.) INTERACT 2015. LNCS, vol. 9297, pp. 463–478. Springer, Cham (2015). doi: 10.1007/978-3-319-22668-2_36 CrossRefGoogle Scholar
  14. 14.
    Kamada, T., Kawai, S.: An algorithm for drawing general undirected graphs. Inf. Process. Lett. 31(1), 7–15 (1989)MathSciNetCrossRefzbMATHGoogle Scholar
  15. 15.
    Kang, Y.-A., Stasko, J.: Characterizing the intelligence analysis process: informing visual analytics design through a longitudinal field study (2011)Google Scholar
  16. 16.
    Keim, D., Andrienko, G., Fekete, J.-D., Görg, C., Kohlhammer, J., Melançon, G.: Visual analytics: definition, process, and challenges. In: Kerren, A., Stasko, J.T., Fekete, J.-D., North, C. (eds.) Information Visualization. LNCS, vol. 4950, pp. 154–175. Springer, Heidelberg (2008). doi: 10.1007/978-3-540-70956-5_7 CrossRefGoogle Scholar
  17. 17.
    Kirsh, D.: The intelligent use of space. Artif. Intell. 73(1–2), 31–68 (1995)CrossRefGoogle Scholar
  18. 18.
    Klein, G., Moon, B., Hoffman, R.: Making sense of sensemaking 2: a macrocognitive model. IEEE Intell. Syst. 21(5), 88–92 (2006)CrossRefGoogle Scholar
  19. 19.
    Mansmann, F., Fischer, F., Keim, D.A.: Dynamic visual analytics–facing the real-time challenge. In: Dill, J., Earnshaw, R., asik, D., Vince, J., Wong, P.C. (eds.) Expanding the Frontiers of Visual Analytics and Visualization, pp. 69–80. Springer, Heidelberg (2012)Google Scholar
  20. 20.
    Marshall, C.C.: Spatial hypertext: designing for change. 38, 88–97Google Scholar
  21. 21.
    Matejka, J., Grossman, T., Fitzmaurice, G.: Patina: dynamic heatmaps for visualizing application usage. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2013, pp. 3227–3236. ACM, New York (2013)Google Scholar
  22. 22.
    O’callaghan, L., Meyerson, A., Motwani, R., Mishra, N., Guha, S.: Streaming-data algorithms for high-quality clustering. In: ICDE, p. 0685. IEEE (2002)Google Scholar
  23. 23.
    Pelleg, D., Moore, A.W.: X-means: extending k-means with efficient estimation of the number of clusters. In: Proceedings of the Seventeenth International Conference on Machine Learning, ICML 2000, pp. 727–734. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA (2000)Google Scholar
  24. 24.
    Pirolli, P., Card, S.: The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis. Proc. Int. Conf. Intell. Anal. 5, 2–4 (2005)Google Scholar
  25. 25.
    Robertson, G., Ebert, D., Eick, S., Keim, D., Joy, K.: Scale and complexity in visual analytics. Inf. Vis. 8(4), 247–253 (2009)CrossRefGoogle Scholar
  26. 26.
    Rohrdantz, C., Oelke, D., Krstajic, M., Fischer, F.: Real-time visualization of streaming text data: tasks and challenges (2011)Google Scholar
  27. 27.
    Rose, S., Engel, D., Cramer, N., Cowley, W.: Automatic Keyword Extraction from Individual Documents. Wiley, Hoboken (2010). pp. 1–20CrossRefGoogle Scholar
  28. 28.
    Russell, D.M., Slaney, M., Qu, Y., Houston, M.: Being literate with large document collections: observational studies and cost structure tradeoffs, p. 55. IEEE Computer Society (2006). 1109739Google Scholar
  29. 29.
    Shipman, F.M., Marshall, C.C.: Formality considered harmful: experiences, emerging themes, and directions on the use of formal representations in interactive systems. Comput. Support. Coop. Work (CSCW) 8(4), 333–352 (1999)CrossRefGoogle Scholar
  30. 30.
    Skupin, A.: A cartographic approach to visualizing conference abstracts. IEEE Comput. Graph. Appl. 22, 50–58 (2002)CrossRefGoogle Scholar
  31. 31.
    Stasko, J., Goerg, C., Liu, Z.: Jigsaw: supporting investigative analysis through interactive visualization. Inf. Vis. 7(118–132), 2 (2008)Google Scholar
  32. 32.
    Stolper, C.D., Perer, A., Gotz, D.: Progressive visual analytics: user-driven visual exploration of in-progress analytics. IEEE Trans. Vis. Comput. Graph. 20(12), 1653–1662 (2014)CrossRefGoogle Scholar
  33. 33.
    Thomas, J.J., Cook, K.A.: Illuminating the path: the research and development agenda for visual analytics. IEEE Computer Society Press (2005)Google Scholar
  34. 34.
    Whiting, M., Cook, K., Grinstein, G., Liggett, K., Cooper, M., Fallon, J., Morin, M.: Vast challenge 2014: the kronos incident. In: 2014 IEEE Conference on Visual Analytics Science and Technology (VAST), pp. 295–300, October 2014Google Scholar
  35. 35.
    Wise, J.A., Thomas, J.J., Pennock, K., Lantrip, D., Pottier, M., Schur, A., Crow, V.: Visualizing the non-visual: spatial analysis and interaction with information for text documents. pp. 442–450. Morgan Kaufmann Publishers Inc, Burlington (1999). 300791Google Scholar
  36. 36.
    Wright, W., Schroh, D., Proulx, P., Skaburskis, A., Cort, B.: The sandbox for analysis: concepts and methods, pp. 801–810. ACM (2006)Google Scholar
  37. 37.
    Zhang, P., Soergel, D., Klavans, J.L., Oard, D.W.: Extending sense-making models with ideas from cognition and learning theories. Proc. Am. Soc. Inf. Sci. Technol. 45(1), 23 (2008)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Pacific Northwest National LaboratoriesRichlandUSA
  2. 2.School of Interactive ComputingGeorgia Institute of TechnologyAtlantaUSA

Personalised recommendations