Skip to main content

An Analysis of Displays for Probabilistic Robotic Mission Verification Results

  • Conference paper
  • First Online:

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 499))

Abstract

An approach for the verification of autonomous behavior-based robotic missions has been developed in a collaborative effort between Fordham University and Georgia Tech. This paper addresses the step after verification, how to present this information to users. The verification of robotic missions is inherently probabilistic, opening the possibility of misinterpretation by operators. A human study was performed to test three different displays (numeric, graphic, and symbolic) for summarizing the verification results. The displays varied by format and specificity. Participants made decisions about high-risk robotic missions using a prototype interface. Consistent with previous work, the type of display had no effect. The displays did not reduce the time participants took compared to a control group with no summary, but did improve the accuracy of their decisions. Participants showed a strong preference for more specific data, heavily using the full verification results. Based on these results, a different display paradigm is suggested.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Participants used prior situational information for new scenarios.

References

  1. Doesburg, J.C., Steiger, G.E.: The evolution of chemical, biological, radiological, and nuclear defense and the contributions of army research and development. NBC Report, the United States Army Nuclear and Chemical Agency (2004)

    Google Scholar 

  2. Lyons, D.M., Arkin, R.C., Jiang, S., Liu, T.M., Nirmal, P.: Performance verification for behavior-based robot missions. IEEE Trans. Rob. 31(3) (2015)

    Google Scholar 

  3. Tversky, A., Kahneman, D.: Judgment under uncertainty: heuristics and biaes. Science 185(4157), 1124–1131 (1974)

    Article  Google Scholar 

  4. Budescu, D.V., Weinberg, S., Wallsten, T.S.: Decisions based on numerically and verbally expressed uncertainties. J. Exp. Psychol. Hum. Percept. Perform. 14(2), 281 (1988)

    Article  Google Scholar 

  5. Wallsten, T.S., Budescu, D.V.: A review of human linguistic probability processing: general principles and empirical evidence. Knowledge Eng. Rev. 10(01), 43–62 (1995)

    Google Scholar 

  6. Bisantz, A.M., Marsiglio, S.S., Munch, J.: Displaying uncertainty: investigating the effects of display format and specificity. Hum. Factors: J. Hum. Factors Ergon. Soc. 47(4), 777–796 (2005)

    Article  Google Scholar 

  7. Lyons, D.M., Arkin, R.C., Jiang, S., Harrington, D., Liu, T.M.: Verifying and validating multirobot missions. IEEE/RSJ Int. Conf. Intelligent Robots Syst. (IROS) (2014)

    Google Scholar 

  8. MacKenzie, D.C., Arkin, R.C., Cameron, J.M.: Multiagent mission specification and execution. In: Robot Colonies, pp. 29–52. Springer, US (1997)

    Google Scholar 

  9. Jhala R., Majumdar R.: Software model checking. ACM Comput. Surv. 41(4) 21–53 (2009)

    Google Scholar 

  10. Cleveland, W.S., McGill, R.: Graphical perception: theory, experimentation, and application to the development of graphical methods. J. Am. Statistical Association 79(387), 531–554 (1984)

    Article  MathSciNet  Google Scholar 

  11. Daradkeh, M., Churcher, C., McKinnon, A.: Supporting informed decision-making under uncertainty and risk through interactive visualisation. In: Proceedings of the Fourteenth Australasian User Interface Conference, vol. 139, pp. 23–32. Australian Computer Society, Inc. (2013)

    Google Scholar 

  12. Masalonis, A., Mulgund, S., Song, L., Wanke, C., Zobell, S.: Using probabilistic demand predictions for traffic flow management decision support. In: Proceedings of the 2004 AIAA Guidance, Navigation, and Control Conference. American Institute of Aeronautics and Astronautics (2004)

    Google Scholar 

Download references

Acknowledgments

This research is supported by the United States Defense Threat Reduction Agency, Basic Research Award #HDTRA1-11-1-0038.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Matthew O‘Brien .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing Switzerland

About this paper

Cite this paper

O‘Brien, M., Arkin, R. (2017). An Analysis of Displays for Probabilistic Robotic Mission Verification Results. In: Savage-Knepshield, P., Chen, J. (eds) Advances in Human Factors in Robots and Unmanned Systems. Advances in Intelligent Systems and Computing, vol 499. Springer, Cham. https://doi.org/10.1007/978-3-319-41959-6_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-41959-6_33

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-41958-9

  • Online ISBN: 978-3-319-41959-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics