A Model to Promote Interaction between Humans and Data Fusion Intelligence to Enhance Situational Awareness

  • Leonardo Botega
  • Cláudia Berti
  • Regina Araújo
  • Vânia Paula de Almeida Neris
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8510)


The operator of a Command & Control (C2) system has a crucial role on the improvement of information that is processed through data fusion engines to provide Situational Awareness (SAW). Through direct access to data transformations, operators can improve information quality, by reducing uncertainty, according to their skills and expertise. Uncertainty, in this work, is considered an adverse condition, which can make the real information less accessible. Although relevant solutions have been reported in the literature on innovative user interfaces and approaches for quality-aware knowledge representation, these are concerned mostly on transforming the way information is graphically represented and on quantitatively mapping the quality-aware knowledge acquired from systems, respectively. There are few studies that deal more specifically with accessibility for decision-makers in safety-critical situations, such as C2, considering the aspect of data uncertainty. This paper presents a model to help researchers to build uncertainty-aware interfaces for C2 systems, produced by both data fusion and human reasoning over the information. Combined to environmental and personal factors, a tailored and enriched knowledge can be built, interchangeable with systems intelligence. A case study on the monitoring of a conflict among rival soccer fans is being implemented for the validation of the proposed solution.


Data Fusion Situational Awareness Subway Station Police Commander Exploratory Visualization 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Endsley, M.R., Jones, D.G.: Designing for Situation Awareness: An Approach to User-Centered Design, 2nd edn. Taylor & Francis (2012)Google Scholar
  2. 2.
    Emiliani, P.L., Stephanidis, C.: Universal access to ambient intelligence environments: Opportunities and challenges for people with disabilities. IBM Systems Journal 3(44), 605–619 (2005)CrossRefGoogle Scholar
  3. 3.
    Xie, Z., Ward, M.O., Rundensteiner, E.A., Huang, S.: Integrating Data and Quality Space Interactions in Exploratory Visualizations. In: Fifth International Conference on Coordinated and Multiple Views in Exploratory Visualization (CMV 2007), pp. 47–60 (July 2007)Google Scholar
  4. 4.
    Friedemann, M., Raape, U., Tessmann, S., Schoeckel, T., Strobl, C.: Explicit Modeling and Visualization of Imperfect Information in the Context of Decision Support for Tsunami Early Warning in Indonesia. In: Smith, M.J., Salvendy, G. (eds.) Human Interface, Part I, HCII 2011. LNCS, vol. 6771, pp. 201–210. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  5. 5.
    Summers, V.A., Jones, R.L., Flo, R.: Increasing Situational Awareness by Visualizing Uncertainty (2005)Google Scholar
  6. 6.
    Wen, Z., Zhou, M.X.: An Optimization-based Approach to Dynamic Data Transformation for Smart Visualization. In: Proceedings of the 13th International Conference on Intelligent User Interfaces, IUI 2008, pp. 70–79. ACM, New York (2008)Google Scholar
  7. 7.
    Angelini, M., Ferro, N., Granato, G., Santucci, G., Silvello, G.: Information retrieval failure analysis: Visual analytics as a support for interactive what-if investigation. In: IEEE Conference on Visual Analytics Science and Technology, pp. 204–206. IEEE (October 2012)Google Scholar
  8. 8.
    Correa, C.D., Chan, Y.H., Ma, K.L.: A framework for uncertainty-aware visual analytics. In: 2009 IEEE Symposium on Visual Analytics Science and Technology, pp. 51–58 (2009)Google Scholar
  9. 9.
    McKeever, S.: Recognising Situations Using Extended Dempster-Shafer Theory (February 2011)Google Scholar
  10. 10.
    Zhang, D., Cao, J., Zhou, J., Guo, M.: Extended Dempster-Shafer Theory in Context Reasoning for Ubiquitous Computing Environments. In: 2009 International Conference on Computational Science and Engineering, pp. 205–212 (2009)Google Scholar
  11. 11.
    Blasch, E., Stampouli, D., Costa, P.C.G., Laskey, K.B., Valin, P., Ng, G.W., Schubert, J., Nagi, R.: Issues of Uncertainty Analysis in High-Level Information Fusion. Technical report (2012)Google Scholar
  12. 12.
    Laskey, K.B., Wright, E.J., da Costa, P.C.: Envisioning uncertainty in geospatial information. International Journal of Approximate Reasoning 51(2), 209–223 (2010)CrossRefGoogle Scholar
  13. 13.
    Keim, D.A., Bak, P., Bertini, E., Oelke, D., Spretke, D., Ziegler, H.: Advanced visual analytics interfaces. In: Proceedings of the International Conference on Advanced Visual Interfaces - AVI 2010, p. 3 (2010)Google Scholar
  14. 14.
    Riveiro, M.: Evaluation of uncertainty visualization techniques for information fusion. In: 11th International Conference on Information Fusion, pp. 1–8 (July 2007)Google Scholar
  15. 15.
    Hall, D., Jordan, J.: Human-centered information fusion. Artech House (2010)Google Scholar
  16. 16.
    Mahadevan, S.: Visualization Methods and User Interface Design Guidelines for Rapid Decision Making in Complex Multi-task Time-critical Environments. PhD thesis (2009)Google Scholar
  17. 17.
    Martinie, C., Palanque, P., Ragosta, M.: Some Issues with Interaction Design and Implementation in the Context of Autonomous Interactive Critical Systems. In: Workshop on End-user Interactions with Intelligent and Autonomous Systems. ACM SIGCHI Conference on Human Factors in Computing Systems (2012)Google Scholar
  18. 18.
    Verma, S., Vieweg, S., Corvey, W.J., Palen, L., Martin, J.H., Palmer, M., Schram, A., Anderson, K.M.: Natural Language Processing to the Rescue? Extracting “Situational Awareness” Tweets During Mass Emergency. In: Fifth International AAAI Conference on Weblogs and Social Media (2011)Google Scholar
  19. 19.
    Sears, A., Young, M., Feng, J.: Physical disabilities and computing technologies: An analysis of impairments. In: Sears, A., Jacko, J.A. (eds.) Human-Computer Interaction Handbook, pp. 829–852. Lawrence Erlbaum Associates (2008)Google Scholar
  20. 20.
    Chambers, L.: A hazard analysis of human factors in safety-critical systems engineering. In: 10th Australian Workshop on Safety Critical Systems, vol. 55 (2006)Google Scholar
  21. 21.
    Caminero Gil, F.J., Paternò, F., Motti, V.G.: Context-aware service front-ends. In: Proceedings of the 5th ACM SIGCHI Symposium on Engineering Interactive Computing Systems - EICS 2013, p. 339 (2013)Google Scholar
  22. 22.
    Mirhaji, P., Richesson, R.L., Turley, J.P., Zhang, J., Smith, J.W.: Public Health Situation Awareness, towards a semantic approach. Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 5434, 339–350 (2004)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Leonardo Botega
    • 1
  • Cláudia Berti
    • 1
  • Regina Araújo
    • 1
  • Vânia Paula de Almeida Neris
    • 1
  1. 1.Computer Science Department, Wireless Networks and Distributed Interactive Simulations Lab (WINDIS)Federal University of São CarlosSão CarlosBrazil

Personalised recommendations