© 2020

Human-Robot Interaction

Evaluation Methods and Their Standardization

  • Céline Jost
  • Brigitte Le Pévédic
  • Tony Belpaeme
  • Cindy Bethel
  • Dimitrios Chrysostomou
  • Nigel Crook
  • Marine Grandgeorge
  • Nicole Mirnig

Part of the Springer Series on Bio- and Neurosystems book series (SSBN, volume 12)

Table of contents

  1. Front Matter
    Pages i-xlv
  2. General Context

    1. Front Matter
      Pages 1-1
    2. Kim Baraka, Patrícia Alves-Oliveira, Tiago Ribeiro
      Pages 21-64
  3. Methodologies to Design Evaluations

    1. Front Matter
      Pages 89-89
    2. Cindy L. Bethel, Zachary Henkel, Kenna Baugus
      Pages 91-124
    3. Matthew Rueben, Shirley A. Elprama, Dimitrios Chrysostomou, An Jacobs
      Pages 125-144
    4. Cindy L. Bethel, Jessie E. Cossitt, Zachary Henkel, Kenna Baugus
      Pages 145-174
  4. Some Standardization Proposals

    1. Front Matter
      Pages 175-175
    2. Josefine Wallström, Jessica Lindblom
      Pages 177-201
  5. Disciplinary Points of View

    1. Front Matter
      Pages 229-229
    2. Jessica Lindblom, Beatrice Alenljung, Erik Billing
      Pages 231-256
    3. Marine Grandgeorge
      Pages 257-268
    4. An Jacobs, Shirley A. Elprama, Charlotte I. C. Jewell
      Pages 269-286
    5. Céline Jost, Brigitte Le Pévédic
      Pages 287-330
  6. Recommendations and Conclusions

    1. Front Matter
      Pages 331-331
    2. Renato Paredes Venero, Alex Davila
      Pages 333-353

About this book


This book offers the first comprehensive yet critical overview of methods used to evaluate interaction between humans and social robots. It reviews commonly used evaluation methods, and shows that they are not always suitable for this purpose. Using representative case studies, the book identifies good and bad practices for evaluating human-robot interactions and proposes new standardized processes as well as recommendations, carefully developed on the basis of intensive discussions between specialists in various HRI-related disciplines, e.g. psychology, ethology, ergonomics, sociology, ethnography, robotics, and computer science. The book is the result of a close, long-standing collaboration between the editors and the invited contributors, including, but not limited to, their inspiring discussions at the workshop on Evaluation Methods Standardization for Human-Robot Interaction (EMSHRI), which have been organized yearly since 2015. By highlighting and weighing good and bad practices in evaluation design for HRI, the book will stimulate the scientific community to search for better solutions, take advantages of interdisciplinary collaborations, and encourage the development of new standards to accommodate the growing presence of robots in the day-to-day and social lives of human beings.


Human-robot Communication Models Statistical Methods for Human-robot Interaction Socially Interactive Robots Classifying Social Robots User Evaluation of Companion Robots Robot Prototype Trials Psychophysiological Measures in HRI Behavioral Measures in HRI Task Performance Metrics in HRI Large Scale Human Studies in HRI Validating Questionnaires for HRI Research Evaluating Child-robot Interaction Structured Interviews in HRI Research UX Evaluation in Social HRI Integrative Social Robotics Anthropomorphism in HRI Robust Experimental Design for HRI Long-term HRI EMSHRI Workshops

Editors and affiliations

  • Céline Jost
    • 1
  • Brigitte Le Pévédic
    • 2
  • Tony Belpaeme
    • 3
  • Cindy Bethel
    • 4
  • Dimitrios Chrysostomou
    • 5
  • Nigel Crook
    • 6
  • Marine Grandgeorge
    • 7
  • Nicole Mirnig
    • 8
  1. 1.University Paris 8Saint-DenisFrance
  2. 2.IUT de Vannes—Département STIDUniversity of South BrittanyVannesFrance
  3. 3.IDLab—imec—ELISGhentBelgium
  4. 4.Social, Therapeutic, and Robotic Systems LabMississippi State UniversityMississippi StateUSA
  5. 5.Robotics and Automation GroupAalborg UniversityAalborgDenmark
  6. 6.Research and Knowledge Exchange, Faculty of Technology, Design and EnvironmentOxford Brookes UniversityOxfordUK
  7. 7.Laboratoire Ethologie Animale et HumaineUniversité Rennes 1PaimpontFrance
  8. 8.Center for Human-Computer InteractionUniversity of SalzburgSalzburgAustria

Bibliographic information

Industry Sectors
Chemical Manufacturing