ACT-R Modeling to Simulate Information Amalgamation Strategies
Today, military decision-making is dependent on the ability to amalgamate information across sources of varying degrees of agreement. Given the increasing volume of information, automated methods to assist in the identification and prioritization of the most valuable or relevant information has become paramount. Relevant information is not only critical to situational awareness and the military decision-making process, but vital to mission success. Towards this end, the US Army Research Laboratory (ARL) has undertaken a research initiative to model and test how analysts perceive the Value of Information (VoI) in varying military context. The goal of this effort is to develop methodologies useful in the development of automated information agents. As a part of the VoI initiative, ARL conducted an experiment with Subject Matter Experts (SMEs) at the US Army Intelligence Center of Excellence (ICOE), where data was collected on how intelligence analysts’ amalgamate information given information content and source reliability within complementary and contradictory conditional associations. The resulting experimental data was incorporated into an Adaptive Control of Thought-Rational (ACT-R) model. Exercising the ACT-R cognitive model resulted in some interesting response behaviors not observed in the initial experiment. In an effort to better understand the perceptions (cognitive underpinnings) of a military intelligence analyst, this paper extends the previous effort and utilizes a crowdsourced experiment within Amazon Mechanical Turk (Mturk). The experiment captures many of the same conditional ratings encountered by the military analysts. Data gained from the Mturk experiment will be examined using the ACT-R model as a simulation to determine whether the same data distributions exist within a wider audience and as a direct comparison to the analyst’s responses. This paper will examine the Mturk experimental design, discuss the experimental apparatus implementation and provide an overview of the ACT-R model utilized to replicate the amalgamation strategies.
KeywordsValue of Information Adaptive Control of Thought-Rationale Information amalgamation Cognitive modeling
This research was supported in part by an appointment to the Student Research Participation Program at the U.S. Army Research Laboratory administered by the Oak Ridge Institute for Science and Education through an interagency agreement between U.S. Department of Energy and USARL.
- 1.Hanratty, T., Heilman, E., Dumer, J., Hammell II, R.J.: Knowledge elicitation to prototype the value of information. In: Proceedings of the 23rd Midwest Artificial Intelligence and Cognitive Sciences Conference (MAICS 2012) (2012)Google Scholar
- 2.Hanratty, T., Heilman, E., Richardson, J., Mittrick, M., Caylor, J.: Determining the perceived value of information when combining supporting and conflicting data. In: Proceedings of the SPIE 10207, Next-Generation Analyst, vol. 102070 N, 3 May 2017. https://doi.org/10.1117/12.2264820
- 3.Anderson, J.R., Lebiere, C.: The Atomic Components of Thought. Erlbaum, Mahwah (1998)Google Scholar
- 4.Anonymous: US Army Field Manual (FM) 2-22.3, Human Intelligence Collection Operations, US Army, September 2006Google Scholar
- 5.Hammell II, R.J., Hanratty, T., Heilman, E.: Capturing the value of information in complex military environments: a fuzzy-based approach. In: Proceedings of the IEEE International Conference on Fuzzy Systems 2012 (FUZZ-IEEE 2012), Brisbane, Australia, 10–15 June 2012Google Scholar
- 6.Hanratty, T., Heilman, E., Richardson, J., Caylor, J.: A fuzzy-logic approach to information amalgamation. In: FUZZ-IEEE, Naples, Italy, 9–12 July 2017Google Scholar
- 7.Cassenti, D.N., Reifers, A.L.: Counting ACT-R to represent time. In: Proceedings of Human Factors and Ergonomics Society Conference (2005)Google Scholar
- 8.The University of North Carolina at Chapel Hill, P.: ACT-R Components [Digital image] (2011). https://sakai.unc.edu/access/content/group/e0fe0057-42ab-4f4d-abde-a150a98989c4/public/classnotes/chap10.html
- 9.Buwalda, T.A., Borst, J.P., Taatgen, N.A., Van Rijn, H.: Evading a multitasking bottleneck: presenting intermediate representations in the environment. In: Proceedings of the 33st Annual Conference of the Cognitive Science Society (2011)Google Scholar
- 10.Kelley, T.D., Patton, D.J., Allender, L.: Predicting situation awareness errors using cognitive modeling. In: Smith, M.J., Salvendy, G., Harris, D., Koubek, R.J. (eds.) Proceedings of Human-Computer Interaction International 2001 Conference, Usability Evaluation and Interface Design: Cognitive Engineering, Intelligent Agents and Virtual Reality, vol. 1, pp. 1455–1459. Erlbaum, Mahwah (2001)Google Scholar
- 11.Caylor, J., Hanratty, T., Heilman, E., Cassenti, D., Richardson, J., Asher, A.: Evaluation of information amalgamation strategies using ACT-R. In: Proceedings of the 8th International Conference on Applied Human Factors and Ergonomics, Los Angeles, California, 17–21 July 2017Google Scholar