Abstract
For an agent to act intelligently in a multi-agent environment it must model the capabilities of other agents. In adversarial environments, like the beyond-visual-range air combat domain we study in this paper, it may be possible to get information about teammates but difficult to obtain accurate models of opponents. We address this issue by designing an agent to learn models of aircraft and missile behavior, and use those models to classify the opponents’ aircraft types and weapons capabilities. These classifications are used as input to a case-based reasoning (CBR) system that retrieves possible opponent team configurations (i.e., the aircraft type and weapons payload per opponent). We describe evidence from our empirical study that the CBR system recognizes opponent team behavior more accurately than using the learned models in isolation. Additionally, our CBR system demonstrated resilience to limited classification opportunities, noisy air combat scenarios, and high model error.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Shaw, R.L.: Fighter Combat: Tactics and Maneuvering. Naval Institute Press, Annapolis (1985)
Clive, P.D., Johnson, J.A., Moss, M.J., Zeh, J.M., Birkmire, B.M., Hodson, D.D.: Advanced Framework for Simulation, Integration and Modeling (AFSIM). In: Proceedings of the 13th International Conference on Scientific Computing, pp. 73–77 (2015)
Wang, Y., Witten, I.H.: Inducing model trees for continuous classes. In: Poster Papers of the 9th European Conference on Machine Learning, Prague, pp. 128–137. Springer (1997)
Karneeb, J., Floyd, M.W., Moore, P., and Aha, D.W.: Distributed discrepancy detection for BVR air combat. In: Proceedings of the IJCAI Workshop on Goal Reasoning, New York (2016)
Borck, H., Karneeb, J., Floyd, M.W., Alford, R., Aha, D.W.: Case-based policy and goal recognition. In: Hüllermeier, E., Minor, M. (eds.) ICCBR 2015. LNCS, vol. 9343, pp. 30–43. Springer, Cham (2015). doi:10.1007/978-3-319-24586-7_3
Intille, S.S., and Bobick, A.F.: A framework for recognizing multi-agent action from visual evidence. In: Proceedings of the 16th National Conference on Artificial Intelligence, pp. 518–525. AAAI Press, Orlando (1999)
Sukthankar, G., Sycara, K.P.: Simultaneous team assignment and behavior recognition from spatio-temporal agent traces. In: Proceedings of the 21st National Conference on Artificial Intelligence, pp. 716–721. AAAI Press, Boston (2006)
Wendler, J., Bach, J.: Recognizing and predicting agent behavior with case based reasoning. In: Proceedings of the RoboCup Robot Soccer World Cup, pp. 729–738 (2003)
Molineaux, M., Aha, D.W., Sukthankar, G.: Beating the defense: using plan recognition to inform learning agents. In: Proceedings of the 22nd International Florida Artificial Intelligence Research Society Conference, pp. 337–343. AAAI Press, Sanibel Island (2009)
Auslander, B., Lee-Urban, S., Hogg, C., Muñoz-Avila, H.: Recognizing the enemy: combining reinforcement learning with strategy selection using case-based reasoning. In: Althoff, K.-D., Bergmann, R., Minor, M., Hanft, A. (eds.) ECCBR 2008. LNCS, vol. 5239, pp. 59–73. Springer, Heidelberg (2008). doi:10.1007/978-3-540-85502-6_4
Ros, R., López de Màntaras, R., Arcos, J.L., Veloso, M.: Team playing behavior in robot soccer: a case-based reasoning approach. In: Weber, R.O., Richter, M.M. (eds.) ICCBR 2007. LNCS, vol. 4626, pp. 46–60. Springer, Heidelberg (2007). doi:10.1007/978-3-540-74141-1_4
Floyd, M.W., Esfandiari, B., Lam, K.: A case-based reasoning approach to imitating RoboCup players. In: Proceedings of the 21st International Florida Artificial Intelligence Research Society Conference, pp. 251–256. AAAI Press, Coconut Grove (2008)
Luo, D.-L., Shen, C.-L., Wang, B., Wu, W.-H.: Air combat decision-making for cooperative multiple target attack using heuristic adaptive genetic algorithm. In: Proceedings of the 4th International Conference on Machine Learning and Cybernetics, pp. 473–478 (2005)
Mulgund, S., Harper, K., Krishnakumar, K., Zacharias, G.: Air combat tactics optimization using stochastic genetic algorithms. In: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, pp. 3136–3141 (1998)
Acknowledgements
Thanks to OSD ASD (R&E) for supporting this research.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Floyd, M.W., Karneeb, J., Aha, D.W. (2017). Case-Based Team Recognition Using Learned Opponent Models. In: Aha, D., Lieber, J. (eds) Case-Based Reasoning Research and Development. ICCBR 2017. Lecture Notes in Computer Science(), vol 10339. Springer, Cham. https://doi.org/10.1007/978-3-319-61030-6_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-61030-6_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-61029-0
Online ISBN: 978-3-319-61030-6
eBook Packages: Computer ScienceComputer Science (R0)