Skip to main content

Improving Trust-Guided Behavior Adaptation Using Operator Feedback

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9343))

Abstract

It is important for robots to be trusted by their human teammates so that they are used to their full potential. This paper focuses on robots that can estimate their own trustworthiness based on their performance and adapt their behavior to engender trust. Ideally, a robot can receive feedback about its performance from teammates. However, that feedback can be sporadic or non-existent (e.g., if teammates are busy with their own duties), or come in a variety of forms (e.g., different teammates using different vocabularies). We describe a case-based algorithm that allows a robot to learn a model of feedback and use that model to adapt its behavior. We evaluate our system in a simulated robotics domain by showing that a robot can learn a model of operator feedback and use that model to improve behavior adaptation.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Oleson, K.E., Billings, D.R., Kocsis, V., Chen, J.Y., Hancock, P.A.: Antecedents of trust in human-robot collaborations. In: Proceedings of the 1st International Multi-disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support, pp. 175–178 (2011)

    Google Scholar 

  2. Floyd, M.W., Drinkwater, M., Aha, D.W.: How much do you trust me? Learning a case-based model of inverse trust. In: Lamontagne, L., Plaza, E. (eds.) ICCBR 2014. LNCS, vol. 8765, pp. 125–139. Springer, Heidelberg (2014)

    Google Scholar 

  3. Sabater, J., Sierra, C.: Review on computational trust and reputation models. Artif. Intell. Rev. 24(1), 33–60 (2005)

    Article  MATH  Google Scholar 

  4. Kaniarasu, P., Steinfeld, A., Desai, M., Yanco, H.A.: Potential measures for detecting trust changes. In: 7th International Conference on Human-Robot Interaction, pp. 241–242 (2012)

    Google Scholar 

  5. Kaniarasu, P., Steinfeld, A., Desai, M., Yanco, H.A.: Robot confidence and trust alignment. In: 8th International Conference on Human-Robot Interaction, pp. 155–156 (2013)

    Google Scholar 

  6. Saleh, J.A., Karray, F., Morckos, M.: Modelling of robot attention demand in human-robot interaction using finite fuzzy state automata. In: International Conference on Fuzzy Systems, pp. 1–8 (2012)

    Google Scholar 

  7. Briggs, P., Smyth, B.: Provenance, trust, and sharing in peer-to-peer case-based web search. In: Althoff, K.-D., Bergmann, R., Minor, M., Hanft, A. (eds.) ECCBR 2008. LNCS (LNAI), vol. 5239, pp. 89–103. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  8. Tavakolifard, M., Herrmann, P., Öztürk, P.: Analogical trust reasoning. In: Ferrari, E., Li, N., Bertino, E., Karabulut, Y. (eds.) IFIPTM 2009. IFIP AICT, vol. 300, pp. 149–163. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  9. Leake, D.B., Whitehead, M.: Case provenance: the value of remembering case sources. In: Weber, R.O., Richter, M.M. (eds.) ICCBR 2007. LNCS (LNAI), vol. 4626, pp. 194–208. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  10. Baier, J.A., McIlraith, S.A.: Planning with preferences. AI Mag. 29(4), 25–36 (2008)

    Google Scholar 

  11. Maes, P., Kozierok, R.: Learning interface agents. In: 11th National Conference on Artificial Intelligence, pp. 459–465 (1993)

    Google Scholar 

  12. Horvitz, E.: Principles of mixed-initiative user interfaces. In: 18th Conference on Human Factors in Computing Systems, pp. 159–166 (1999)

    Google Scholar 

  13. Li, N., Kambhampati, S., Yoon, S.W.: Learning probabilistic hierarchical task networks to capture user preferences. In: 21st International Joint Conference on Artificial Intelligence, pp. 1754–1759 (2009)

    Google Scholar 

  14. Aha, D.W., McSherry, D., Yang, Q.: Advances in conversational case-based reasoning. Knowl. Eng. Rev. 20(3), 247–254 (2005)

    Article  Google Scholar 

  15. McGinty, L., Smyth, B.: On the role of diversity in conversational recommender systems. In: Ashley, K.D., Bridge, D.G. (eds.) ICCBR 2003. LNCS, vol. 2689, pp. 276–290. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  16. Mahmood, T., Ricci, F.: Improving recommender systems with adaptive conversational strategies. In: 20th ACM Conference on Hypertext and Hypermedia, pp. 73–82 (2009)

    Google Scholar 

  17. McCarthy, K., Reilly, J., McGinty, L., Smyth, B.: On the dynamic generation of compound critiques in conversational recommender systems. In: De Bra, P.M.E., Nejdl, W. (eds.) AH 2004. LNCS, vol. 3137, pp. 176–184. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  18. Quinlan, J.R.: Generating production rules from decision trees. In: 10th International Joint Conference on Artificial Intelligence, pp. 304–307 (1987)

    Google Scholar 

  19. Knexus Research Corporation: eBotworks (2015). http://www.knexusresearch.com/products/ebotworks.php. Accessed 6 May 2015

  20. Kim, T., Hinds, P.: Who should I blame? Effects of autonomy and transparency on attributions in human-robot interaction. In: 15th IEEE International Symposium on Robot and Human Interactive Communication, pp. 80–85 (2006)

    Google Scholar 

Download references

Acknowledgments

Thanks to the Naval Research Laboratory and the Office of Naval Research for supporting this research.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Michael W. Floyd .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Floyd, M.W., Drinkwater, M., Aha, D.W. (2015). Improving Trust-Guided Behavior Adaptation Using Operator Feedback. In: Hüllermeier, E., Minor, M. (eds) Case-Based Reasoning Research and Development. ICCBR 2015. Lecture Notes in Computer Science(), vol 9343. Springer, Cham. https://doi.org/10.1007/978-3-319-24586-7_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-24586-7_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-24585-0

  • Online ISBN: 978-3-319-24586-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics