Abstract
In this study, an information fusion component is presented, designed for fusing information acquired by a distributed surveillance system with prior information contained in intelligence databases. The fusion component is part of a larger system supporting the situational awareness of operators and decision makers in military and civil security domains based on concepts and processes in ISR (Intelligence, Surveillance and Reconnaissance). The distributed surveillance system is composed of unmanned aircraft systems, acquiring sensor data which has to be integrated with background information for providing useful input to a situational picture. To this end, the information fusion component includes mechanisms for information integration and conclusion drawing, based on an expressive knowledge model and on employing different reasoning techniques. This paper constitutes an extended version of [1], including further details on knowledge modeling, information extraction and model transformations as well as a first concept for an agent-based realization of the fusion system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Müller, W., Kuwertz, A., Mühlenberg, D., Sander, J.: Semantic information fusion to enhance situational awareness in surveillance scenarios. In: 2017 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI) pp. 397–402 (2017). http://doi.org/10.1109/MFI.2017.8170353
Valavanis, K.P., Vachtsevanos, G.J.: Handbook of Unmanned Aerial Vehicles. Springer, Netherlands (2015)
Tchouchenkov, I., Segor, F., Kollmann, M., Schönbein, R., Bierhoff, T.: Detection, recognition and counter measures against unwanted UAVS. In: Proceedings of the 10th Future Security 2015, Security Research Conference, pp. 333–340. Fraunhofer Verlag (2015)
Bouvry, P., Chaumette, S., Danoy, G., Guerrini, G., Jurquet, G., Kuwertz, A., Müller, W., Rosalie, M., Sander, J.: Using heterogeneous multilevel swarms of UAVs and high-level data fusion to support situation management in surveillance scenarios. In: Proceedings of the 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), pp. 424–429 (2016). https://doi.org/10.1109/MFI.2016.7849525
Sander, J., Kuwertz, A., Schneider, G., Essendorfer, B.: ISR analytics: architectural and methodic concepts. In: Proceedings of the 2012 Workshop Sensor Data Fusion: Trends, Solutions, Applications (SDF), Bonn, Germany, pp. 99–104 (2012). https://doi.org/10.1109/SDF.2012.6327916
Das, S.: High-Level Data Fusion. Artech House, Boston (2008)
Steinberg, A.N., Bowman, C.L., White, F.E.: Revisions to the JDL data fusions models. In: Proceedings of the 3rd NATO/IRIS Conference, Quebec City, Canada (1998)
Emter, T., Gheţa, I., Beyerer, J.: Object oriented environment model for video surveillance systems. In: Proceedings of the Future Security: 3rd Security Research Conference, Karlsruhe, pp. 315–320 (2008)
Gheţa, I., Heizmann, M., Beyerer, J.: Object oriented environment model for autonomous systems. In: Proceedings of the 2nd Skövde Workshop Information Fusion Topics. Skövde Studies in Informatics, pp. 9–12 (2008)
Bauer, A., Emter, T., Vagts, H., Beyerer, J.: Object-oriented world model for surveillance systems. In: Proceedings of the Future Security: 4th Security Research Conference, pp. 339–345 (2009)
Kuwertz, A., Beyerer, J.: Extending adaptive world modeling by identifying and handling insufficient knowledge models. J. Appl. Logic 19, 102–127 (2016). https://doi.org/10.1016/j.jal.2016.05.005
Kuwertz, A., Sander, J., Pfirrmann, U., Dyck, S.: High-level information management in joint ISR based on an object-oriented approach. In: 2017 Sensor Data Fusion: Trends, Solutions, Applications (SDF), pp. 1–6 (2017). https://doi.org/10.1109/SDF.2017.8126360
Patel-Schneider, P.F., Hayes, P., Horrocks, I., et al.: OWL web ontology language semantics and abstract syntax. W3C recommendation (2004). https://www.w3.org/TR/owl-semantics/
OWL Working Group: OWL 2 web ontology language document overview. Technical report W3C (2009). http://www.w3.org/TR/2009/REC-owl2-overview-20091027/
Horrocks, I., Patel-Schneider, P.F., Boley, H., Tabet, S., Grosof, B., Dean, M., et al.: SWRL: a semantic web rule language combining OWL and RuleML. W3C Member submission (2004). https://www.w3.org/Submission/SWRL/
Sirin, E., Parsia, B., Grau, B.C., Kalyanpur, A., Katz, Y.: Pellet: a practical OWL-DL reasoner. Web Semant. Sci. Serv. Agents World Wide Web 5(2), 51–53 (2007). https://doi.org/10.1016/j.websem.2007.03.004
Glimm, B., Horrocks, I., Motik, B., Stoilos, G.: Optimising ontology classification. In: The Semantic Web, ISWC 2010, pp. 225–240 (2010). http://doi.org/10.1007/978-3-642-17746-0_15
Laskey, K.B.: MEBN: a language for first-order Bayesian knowledge bases. Artif. Intell. 172(2), 140–178 (2008). https://doi.org/10.1016/j.artint.2007.09.006
Domingos, P., Lowd, D., Kok, S., Poon, H., Richardson, M., Singla, P.: Just add weights: Markov logic for the semantic web. In: Uncertainty Reasoning for the Semantic Web I, pp. 1–25. Springer, Heidelberg (2015).https://doi.org/10.1007/978-3-540-89765-1_1
Niu, F., Ré, C., Doan, A., Shavlik, J.: Tuffy: scaling up Statistical Inference in Markov logic networks using an RDBMS. Proc. VLDB Endow. 4(6), 373–384 (2011). https://doi.org/10.14778/1978665.1978669
de Oliveira, P.C.: Probabilistic reasoning in the semantic web using Markov logic. Master’s thesis, University of Coimbra, Portugal (2009)
Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach. Prentice Hall, Upper Saddle River (2003)
Beyerer, J., Heizmann, M., Sander, J.: Fuselets – an agent based architecture for fusion of heterogeneous information and data. In: Proceedings of the SPIE 6242 (2006)
Sander, J., Heizmann, M., Goussev, I., Beyerer, J.: A local approach for focussed Bayesian fusion. In: Proceedings of the SPIE 7345 (2009). https://doi.org/10.1117/12.820165
Sander, J., Beyerer, J.: A local approach for Bayesian fusion: mathematical analysis and agent based conception. Robot. Auton. Syst. 57(3), 259–267 (2009). https://doi.org/10.1016/j.robot.2008.10.005
Sander, J., Beyerer, J.: Decision theoretic approaches for focussed Bayesian fusion. In: Proceedings of the IEEE ISIF Workshop on Sensor Data Fusion: Trends, Solutions, Applications, SDF 2011. IEEE (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Kuwertz, A., Mühlenberg, D., Sander, J., Müller, W. (2018). Applying Knowledge-Based Reasoning for Information Fusion in Intelligence, Surveillance, and Reconnaissance. In: Lee, S., Ko, H., Oh, S. (eds) Multisensor Fusion and Integration in the Wake of Big Data, Deep Learning and Cyber Physical System. MFI 2017. Lecture Notes in Electrical Engineering, vol 501. Springer, Cham. https://doi.org/10.1007/978-3-319-90509-9_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-90509-9_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-90508-2
Online ISBN: 978-3-319-90509-9
eBook Packages: EngineeringEngineering (R0)