Skip to main content

Human Error Prediction Using Eye Tracking to Improvise Team Cohesion in Human-Machine Teams

  • Conference paper
  • First Online:

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 778))

Abstract

The rapid increase in integration of intelligent systems in every corner of technology created an emerging field called Human-Machine Teaming (HMT). In HMT, human and machine collaborate with one another to accomplish a common goal or task. To achieve the best performance of a team, it is necessary to build trust and cohesion among all teammates (machines and humans). Furthermore, in a team, it is an established fact that a team member ability to predict fellow member’s future course of action and have an accurate picture is a valuable asset and will result in better team dynamics and team performance. To realize such an ability we are proposing a human error predicting methodology that could give an intelligent system a better understanding of human actions in advance. In the proposed method, we used eye-tracking metrics such as gaze density and cognitive state to predict human errors. The results obtained with the proposed and developed methods are found to be efficient in predicting human error probability.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. IBM: The human-machine interchange: how intelligent automation is reconstructing business operations. Business consulting (2017) public.dhe.ibm.com/common/ssi/ecm/gb/en/gbe03879usen/human-machine-interchange.pdf

  2. Guszcza, J., Lewis, H., Evans-Greenwood, P.: Why Humans and computers think better together. Deloitte Insights (2017). https://www2.deloitte.com/insights/us/en/deloitte-review/issue-20/augmented-intelligence-human-computer-collaboration.html

  3. Ziemke, T., Schaefer, K.E., Endsley, M.: Situation awareness in human-machine interactive systems, pp. 1–2 (2017)

    Article  Google Scholar 

  4. Eddy, N.: Relationship between humans, machines must evolve: gatner. E-Week. http://www.eweek.com/small-business/relationship-between-humans-machines-must-evolve-gartner

  5. Aponso, B.: HAT tricks: understanding human autonomy teaming through applications (2017)

    Google Scholar 

  6. McCourt, M.J., Mehta, S.S., Doucette, E.A., Curtis, J.W.: Human-machine teaming for effective estimation and path planning. In: Micro-and Nanotechnology Sensors, Systems, and Applications VIII, vol. 9836, p. 98361 W. International Society for Optics and Photonics (2016)

    Google Scholar 

  7. Mu, L., Xiao, B.P., Xue, W.K., Yuan, Z.: The prediction of human error probability based on Bayesian networks in the process of task. In: 2015 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), pp. 145–149. IEEE (2015)

    Google Scholar 

  8. Ramakrishnan, R., Zhang, C., Shah, J.: Perturbation training for human-robot teams. J. Artif. Intell. Res. 59, 495–541 (2017)

    MathSciNet  MATH  Google Scholar 

  9. Yang, X.J., Unhelkar, V.V., Li, K., Shah, J.A.: Evaluating effects of user experience and system transparency on trust in automation. In: HRI, pp. 408–416 (2017)

    Google Scholar 

  10. Baluja, S., Dean, P.: Non-intrusive gaze tracking using artificial neural networks. In: Advances in Neural Information Processing Systems, pp. 753–760 (2014)

    Google Scholar 

  11. Dzeng, R.J., Lin, C.T., Fang, Y.C.: Using eye-tracker to compare search patterns between experienced and novice workers for site hazard identification. Saf. Sci. 82, 56–67 (2016)

    Article  Google Scholar 

  12. Goswami, A., Gursimran, W., Mark, M., Ganesh, P.: Using eye tracking to investigate reading patterns and learning styles of software requirement inspectors to enhance inspection team outcome. In: Proceedings of the 10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, p. 34. ACM (2016)

    Google Scholar 

  13. Maguire, R.: Validating a process for understanding human error probabilities in complex human computer interfaces. Complexity in Design and Engineering, pp. 313–326 (2005)

    Google Scholar 

  14. Voßkühler, A., Nordmeier, V., Kuchinke, L., Jacobs, A.M.: OGAMA (open gaze and mouse analyzer): open-source software designed to analyze eye and mouse movements in slideshow study designs. Behav. Res. Methods 40(4), 1150–1162 (2008)

    Article  Google Scholar 

  15. Piquado, T., Isaacowitz, D., Wingfield, A.: Pupillometry as a measure of cognitive effort in younger and older adults. Psychophysiology 47(3), 560–569 (2010)

    Article  Google Scholar 

  16. Guenther, N., Schonlau, M.: Support vector machines. Stata. J. 16(4), 917–937 (2016)

    Google Scholar 

  17. Su, J., Zhang, H.: A fast decision tree learning algorithm. In: AAAI, vol. 6, pp. 500–505 (2006)

    Google Scholar 

Download references

Acknowledgments

The University of Toledo and Round 1 Award from the Ohio Federal Research Jobs Commission (OFMJC) through Ohio Federal Research Network (OFRN) fund this research project; authors also appreciate support of the Paul A. Hotmer Family CSTAR (Cybersecurity and Teaming Research) Lab and EECS (Electrical Engineering and Computer Science) Department at the University of Toledo.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Praveen Damacharla .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Damacharla, P., Javaid, A.Y., Devabhaktuni, V.K. (2019). Human Error Prediction Using Eye Tracking to Improvise Team Cohesion in Human-Machine Teams. In: Boring, R. (eds) Advances in Human Error, Reliability, Resilience, and Performance. AHFE 2018. Advances in Intelligent Systems and Computing, vol 778. Springer, Cham. https://doi.org/10.1007/978-3-319-94391-6_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-94391-6_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-94390-9

  • Online ISBN: 978-3-319-94391-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics