Bracketing Human Performance to Support Automation for Workload Reduction: A Case Study
Semi-automated Forces (SAFs) are commonly used in training simulation. SAFs often require human intervention to ensure that appropriate, individual training opportunities are presented to trainees. We cast this situation as a supervisory control challenge and are developing automation designed to support human operators, reduce workload, and improve training outcomes. This paper summarizes a combined analytic and empirical verification study that identified specific situations in the overall space of possible scenarios where automation may be particularly helpful. By bracketing “high performance” and “low performance” conditions, this method illuminates salient points in the space of operational performance for future human-in-the-loop studies.
KeywordsSimulation-based training Semi-automated forces Cognitive workload
This work is supported by the Office of Naval Research project N00014-1-C-0170 Tactical Semi-Automated Forces for Live, Virtual, and Constructive Training (TACSAF). The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the Department of Defense or Office of Naval Research. The U.S. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation hereon. We would like to thank collaborators and sponsors at NAWC TSD and ONR who have provided insights and operational perspectives in the development of TXA: LCDR Brent Olde, Ami Bolton, Melissa Walwanis, and Heather Priest.
- 1.Wray, R.E., Woods, A.: A cognitive systems approach to tailoring learner practice. In: Laird, J., Klenk, M. (eds.) Proceedings of the Second Advances in Cognitive Systems Conference, Baltimore, MD (2013)Google Scholar
- 2.Sheridan, T.B.: Humans and Automation: System Design and Research Issues. Wiley, New York (2002)Google Scholar
- 3.Wray, R.E., van Lent, M., Beard, J.T., Brobst, P.: The design space of control options for AIs in computer games. In: IJCAI 2005 Workshop on Reasoning, Representation, and Learning in Computer Games, pp. 113–118. US Naval Research Laboratory (2005)Google Scholar
- 4.Jones, R.M., Bachelor, B., Stacy, W., Colonna-Romano, J.: Automated monitoring and evaluation of expected behavior. In: International Conference on Artificial Intelligence, Las Vegas (in preparation)Google Scholar
- 7.Jones, R.M., Wray, R.E., Bachelor, B., Zaientz, J.: Using cognitive workload analysis to predict and mitigate workload for training simulation. In: Proceedings of the Applied Human Factors and Ergonomics Conference 2015, Las Vegas (2015)Google Scholar
- 8.Kieras, D.E., Meyer, D.E.: The role of cognitive task analysis in the application of predictive models of human performance. In: Schraagen, J.M.C., Chipman, S.E., Shalin, V.L. (eds.) Cognitive Task Analysis. Lawrence Erlbaum, Mahwah, NJ (2000)Google Scholar