Skip to main content

Towards Unified Performance Metrics for Multi-robot Human Interaction Systems

  • Conference paper
Autonomous and Intelligent Systems (AIS 2011)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 6752))

Included in the following conference series:

Abstract

This paper intends to be a further step towards identifying common performance metrics for task-oriented human-robot interaction. We believe that within the context of human-robot interaction systems, both human and robot independent actions and joint interactions can significantly affect the quality of the accomplished task, thus proposing a generic performance metric to assess the performance of the human-robot team. In our previous work, and toward efficive modelling of such metric, we proposed a fuzzy temporal model to evaluate the human trust in automation which directly influences the interaction time that should be directly and indirectly dedicated toward interacting with the robot. Another fuzzy temporal-based model was also presented to evaluate the human reliability during interaction time. In this paper, the model is then extended to accomodate for multi-robot scenarios. Sequential and parallel robot cooperation schemes with varying levels of task dependency are considered.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Donmez, B., Pina, P., Cummings, M.: Evaluation Criteria for Human-Automation Performance Metrics. In: PerMIS Conference Proceedings (2008)

    Google Scholar 

  2. Olsen, D.R., Goodrich, M.A.: Metrics for Evaluating Human-Robot Interactions. In: Performance Metrics for Intelligent Systems Workshop (2003)

    Google Scholar 

  3. Endsley, M.R.: Design and Evaluation of Situation Awareness Enhancement. In: Proceedings of the Human Factors Society 32nd Annual Meeting, vol. 1, pp. 97–101 (1988)

    Google Scholar 

  4. Goodrich, M.A., Olsen, D.R.: Seven Principles of Efficient Human Robot Interaction. In: Proceedings IEEE International Conference on Systems, Man and Cybernetics, pp. 3943–3948 (2003)

    Google Scholar 

  5. Pina, P., Cummings, M.L., Crandall, J.W., Penna, M.D.: Identifying Generalizable Metric Classes to Evaluate Human-Robot Teams. In: Workshop at the 3rd Annual Conference on Human-Robot Interaction (2008)

    Google Scholar 

  6. Santoni, C., Neto, J.A., Vieira, M.F., Scherer, D.: Proposing Strategies to Prevent the Human Error in Automated Industrial Environments. In: HCI International Conference (2009)

    Google Scholar 

  7. Williams, K.: Summary of Unmanned Aircraft Accident/Incident Data: Human Factors Implications. Technical Report (2004)

    Google Scholar 

  8. Dhillon, B.S.: Human Reliability and Error in Medical System. In: Series on Industrial And Systems Engineering - Medical (2003)

    Google Scholar 

  9. Abou Saleh, J., Karray, F.: Temporal Fuzzy Based Modeling as Applied to the Class of Man-Machine Interaction. In: IEEE International Conference on Fuzzy Systems (2010)

    Google Scholar 

  10. Abou Saleh, J., Karray, F.: Towards Generalized Performance Metrics for Human-Robot Interaction. In: International Conference on Autonomous and Intelligent Systems (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Saleh, J.A., Karray, F. (2011). Towards Unified Performance Metrics for Multi-robot Human Interaction Systems. In: Kamel, M., Karray, F., Gueaieb, W., Khamis, A. (eds) Autonomous and Intelligent Systems. AIS 2011. Lecture Notes in Computer Science(), vol 6752. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21538-4_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-21538-4_31

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-21537-7

  • Online ISBN: 978-3-642-21538-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics