Skip to main content

Analysis of a Multimodal Human-Robot-Interface in Terms of Mental Workload

  • Conference paper
  • First Online:
Advances in Ergonomic Design of Systems, Products and Processes

Abstract

The trend away from highly automated processes using heavy industrial robots towards HRI-systems (human-robot-interaction) using light-weight robots, is leading to a strong increase concerning the technical complexity of future industrial work systems. This article reports the results of an experimental evaluation of a multimodal human-robot-interface. Two typical application scenarios from the robot programming were examined, each performed with three different modalities of control. The mental workload of the operators was operationalized by subjective, objective and physiological indicators. There were significant differences in mental workload between the different types of control in both application scenarios. The present results demonstrate the benefits of adaptive system design in human-robot-interaction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Arenius M (2009) Getting the feeling – “Human Error” in an educational ship-handling simulator. Magisterarbeit. University Linköping, Linköping. Institut of Computer Science, checked on 1/24/2016

    Google Scholar 

  • Backs R, Walrath L (1992) Eye movement and pupillary response indices of mental workload during visual search of symbolic displays. Appl Ergon 23:243–254

    Article  Google Scholar 

  • Beatty J, Lucero-Wagoner B (2007) The pupillary system. In: Cacioppo JT, Tassinary LG, Berntson GG (eds) Handbook of psychophysiology, 3rd edn. Cambridge University Press, Cambridge, pp 142–162

    Google Scholar 

  • Benedetto S, Pedrotty M, Minin L, Baccino T, Re A, Montanari R (2011) Driver workload and eye blink duration. Transport Res 14:199–208

    Google Scholar 

  • Brookhuis K, de Waard D (2010) Monitoring drivers’ mental workload in driving simulators using physiological measures. Accid Anal Prev 42:898–903

    Article  Google Scholar 

  • Cardona G, Quevedo N (2014) Blinking and driving: the influence of saccades and cognitive workload. Curr Eye Res 39:239–244

    Article  Google Scholar 

  • Di Nocera F, Camilli M, Terenzi M (2007) A random glance on the flight deck: pilots’ scanning strategies and real-time assessment of mental workload. Edited by University of Rome, Rome

    Google Scholar 

  • Driver MJ, Mock TJ (1975) Human information processing, decision style theory, and accounting information systems. The Account Rev 50:490–508, checked on 2/3/2016

    Google Scholar 

  • Fels M, Bauer R, Gharabaghi A (2015) Predicting workload profiles of brain–robot interface and electromyographic neurofeedback with cortical resting-state networks. Personal trait or task-specific challenge? J Neural Eng 12(4):46029, DOI: 10.1088/1741-2560/12/4/046029

    Article  Google Scholar 

  • Goodale MA, Milner AD (1992) Separate visual pathways for perception and action. Trends Neurosci 15:20–25

    Article  Google Scholar 

  • Haddadin S (ed) (2014) Towards safe robots. Approaching Asimov’s 1st law. Springer, Heidelberg (Springer tracts in advanced robotics, 90)

    Google Scholar 

  • Halverson T, Estepp J, Christensen J, Monnin J (2012) Classifying Workload with eye movements in a complex task. Proceedings of the Human Factors an Ergonomics Society Annual Meeting 58:168–172

    Article  Google Scholar 

  • Hart SG, Staveland LE (1988) Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Hancock PA, Meshkati N (eds) Human mental workload. North Holland Press, Amsterdam

    Google Scholar 

  • Kahneman D (1973) Attention and effort. Prentice-Hall, Englewood Cliffs, NJ, (Prentice-Hall series in experimental psychology), checked on 1/20/2016

    Google Scholar 

  • Loewenfeld I (1993) The pupil: anatomy, physiology, and clinical applications. Iowa State University, Ames

    Google Scholar 

  • Manzey D (1998) Psychophysiologie mentaler Beanspruchung. In: Rößler F (ed) Enzyklopädie der Psychologie. Ergebnisse und Anwendungen der Psychophysiologie, vol 5, 5th edn. Hogrefe, Göttingen, pp 799–864

    Google Scholar 

  • Marshall SP (2000) Method and apparatus for eye tracking and monitoring pupil dilation to evaluate cognitive activity on 7/18/2000. Patent no. 6.090.051

    Google Scholar 

  • Marshall SP (2002) The index of cognitive activity: measuring cognitive workload. IEEE Human Factors Meeting, 7, Scottsdale

    Google Scholar 

  • Marshall SP (2007) Identifying cognitive state from eye metrics. Aviat Space Environ Med 78:165–175

    Google Scholar 

  • Marshall SP, Pleydell-Pearce CW, Dickson BT (2003) Integrating psychophysiological measures of cognitive workload and eye movements to detect strategy shifts. In: Proceedings of the thirth-sixth annual Hawaii international conference on system sciences. IEEE, Los Alamitos, CA

    Book  Google Scholar 

  • Martens S, Wyble B (2010) The attentional blink: past, present, and future of a blind spot in perceptual awareness. Neurosci Biobehav Rev 34:947–957

    Article  Google Scholar 

  • Martins R, Carvalho JM (2015) Eye blinking as an indicator of fatigue and mental load – a systematic review. In: Arezes PM (ed) Occupational safety and hygiene III. Selected extended and revised contributions from the International Symposium on Safety and Hygiene, Guimarães, Portugal, 12–13 February 2015. CRC Press/Balkema, Leiden, The Netherlands, pp 231–235

    Google Scholar 

  • Neisser U (1976) Cognition and reality. Principles and implications of cognitive psychology. W.H. Freeman, San Francisco, CA

    Google Scholar 

  • Neudörfer A (ed) (2014) Konstruieren sicherheitsgerechter Produkte. Methoden und systematische Lösungssammlungen zur EG-Maschinenrichtlinie. 6., aktual. Aufl. Springer Vieweg, Berlin (VDI-Buch)

    Google Scholar 

  • Packebusch L (2003) Psychische Belastung und Beanspruchung - Normung für die Praxis. In: Wirtschaftspsychologie aktuell. Arbeit und Gesundheit, vol 4, 4th edn. With assistance of R. Decker. Deutscher Psychologen Verlag GmbH, pp 32–36

    Google Scholar 

  • Rasmussen J (1986) Information processing and human-machine interaction. An approach to cognitive engineering. North-Holland, New York (North-Holland series in system science and engineering, 12)

    Google Scholar 

  • Rubio S, Díaz E, Martín J, Puente JM (2004) Evaluation of subjective mental workload: a comparison of SWAT, NASA-TLX, and workload profile methods. Appl Pyschol 53:61–86

    Article  Google Scholar 

  • Schneider M, Deml B (2016) An integrated approach to mental workload assessment. In: Deml B, Stock P, Bruder R, Schlick C (eds) Advances in ergonomic design of systems, products and processes. Proceedings of the Annual Meeting of GfA 2015, vol 1, 1st edn. Springer, Berlin, pp 191–208

    Google Scholar 

  • Schwalm M (2009) Pupillometrie als Methode zur Erfassung mentaler Beanspruchungen im automotive Kontext. Dissertation, University of Saarland, Saarbrücken

    Google Scholar 

  • Spillner R (2015) Einsatz und Planung von Roboterassistenz zur Berücksichtigung von Leistungswandlungen in der Produktion. Utz, Wiss, München (IWB-Forschungsberichte, 296)

    Google Scholar 

  • Steinhauer S, Siegle G, Condray R, Pless M (2004) Sympathetic and parasympathetic innervation of pupillary dilation during sustained processing. Int J Psychophysiol 52:77–86

    Article  Google Scholar 

  • Sträter O (2005) Cognition and safety An integrated approach to systems design and assessment. Ashgate, Aldershot

    Google Scholar 

  • van Gaal S, Lamme VAF (2012) Unconscious high-level information processing: implication for neurobiological theories of consciousness. Neuroscientist 18:287–301

    Article  Google Scholar 

  • Watling C, Smith S (2013) In the blink of an eye: the circadian effects on ocular and subjective indices of driver sleepiness. Australasian Road Safety Research, Policing & Education Conference, Brisbane

    Google Scholar 

  • Wickens CD (1984) Processing resources in attention. In: Parasuraman R, Davies DR (eds) Varieties of attention. Academic Press, London, pp 63–102

    Google Scholar 

  • Wickens CD, Hollands JG, Banbury S, Parasuraman R (2013) Engineering psychology and human performance, 4th edn. Pearson, Boston, MA

    Google Scholar 

  • Wilson GF (2009) An analysis of mental workload in pilots during flight using multiple psychophysiological measures. Int J Aviat Psychol 12:3–18

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marc Schneider .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer-Verlag GmbH Germany

About this paper

Cite this paper

Schneider, M., Deml, B. (2017). Analysis of a Multimodal Human-Robot-Interface in Terms of Mental Workload. In: Schlick, C., et al. Advances in Ergonomic Design of Systems, Products and Processes. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-53305-5_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-53305-5_18

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-53304-8

  • Online ISBN: 978-3-662-53305-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics