Abstract
An approach for the verification of autonomous behavior-based robotic missions has been developed in a collaborative effort between Fordham University and Georgia Tech. This paper addresses the step after verification, how to present this information to users. The verification of robotic missions is inherently probabilistic, opening the possibility of misinterpretation by operators. A human study was performed to test three different displays (numeric, graphic, and symbolic) for summarizing the verification results. The displays varied by format and specificity. Participants made decisions about high-risk robotic missions using a prototype interface. Consistent with previous work, the type of display had no effect. The displays did not reduce the time participants took compared to a control group with no summary, but did improve the accuracy of their decisions. Participants showed a strong preference for more specific data, heavily using the full verification results. Based on these results, a different display paradigm is suggested.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
Participants used prior situational information for new scenarios.
References
Doesburg, J.C., Steiger, G.E.: The evolution of chemical, biological, radiological, and nuclear defense and the contributions of army research and development. NBC Report, the United States Army Nuclear and Chemical Agency (2004)
Lyons, D.M., Arkin, R.C., Jiang, S., Liu, T.M., Nirmal, P.: Performance verification for behavior-based robot missions. IEEE Trans. Rob. 31(3) (2015)
Tversky, A., Kahneman, D.: Judgment under uncertainty: heuristics and biaes. Science 185(4157), 1124–1131 (1974)
Budescu, D.V., Weinberg, S., Wallsten, T.S.: Decisions based on numerically and verbally expressed uncertainties. J. Exp. Psychol. Hum. Percept. Perform. 14(2), 281 (1988)
Wallsten, T.S., Budescu, D.V.: A review of human linguistic probability processing: general principles and empirical evidence. Knowledge Eng. Rev. 10(01), 43–62 (1995)
Bisantz, A.M., Marsiglio, S.S., Munch, J.: Displaying uncertainty: investigating the effects of display format and specificity. Hum. Factors: J. Hum. Factors Ergon. Soc. 47(4), 777–796 (2005)
Lyons, D.M., Arkin, R.C., Jiang, S., Harrington, D., Liu, T.M.: Verifying and validating multirobot missions. IEEE/RSJ Int. Conf. Intelligent Robots Syst. (IROS) (2014)
MacKenzie, D.C., Arkin, R.C., Cameron, J.M.: Multiagent mission specification and execution. In: Robot Colonies, pp. 29–52. Springer, US (1997)
Jhala R., Majumdar R.: Software model checking. ACM Comput. Surv. 41(4) 21–53 (2009)
Cleveland, W.S., McGill, R.: Graphical perception: theory, experimentation, and application to the development of graphical methods. J. Am. Statistical Association 79(387), 531–554 (1984)
Daradkeh, M., Churcher, C., McKinnon, A.: Supporting informed decision-making under uncertainty and risk through interactive visualisation. In: Proceedings of the Fourteenth Australasian User Interface Conference, vol. 139, pp. 23–32. Australian Computer Society, Inc. (2013)
Masalonis, A., Mulgund, S., Song, L., Wanke, C., Zobell, S.: Using probabilistic demand predictions for traffic flow management decision support. In: Proceedings of the 2004 AIAA Guidance, Navigation, and Control Conference. American Institute of Aeronautics and Astronautics (2004)
Acknowledgments
This research is supported by the United States Defense Threat Reduction Agency, Basic Research Award #HDTRA1-11-1-0038.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing Switzerland
About this paper
Cite this paper
O‘Brien, M., Arkin, R. (2017). An Analysis of Displays for Probabilistic Robotic Mission Verification Results. In: Savage-Knepshield, P., Chen, J. (eds) Advances in Human Factors in Robots and Unmanned Systems. Advances in Intelligent Systems and Computing, vol 499. Springer, Cham. https://doi.org/10.1007/978-3-319-41959-6_33
Download citation
DOI: https://doi.org/10.1007/978-3-319-41959-6_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-41958-9
Online ISBN: 978-3-319-41959-6
eBook Packages: EngineeringEngineering (R0)