Abstract
The result of training to improve in a given skill is most often demonstrated by an increase in the relevant performance measures. However, a complementary and at times more informative measure is the mental workload imposed on the performer when doing the task. While a number of varied methods exist for measuring workload, we have chosen to explore physiological and neurological correlates for their low amount of impact and interference on subjects during an experiment. In this study, participants trained on a six-task cognitive battery over four weeks while being simultaneously recorded with remote eye tracking and a host of other neurophysiological instruments. In this preliminary analysis, we found that measures of saccades, fixations, and pupil diameters significantly correlated with task performance over time and at different difficulties, indicating the validity of our task battery as well as the specificity of workload-related eye tracking measures.
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Parasuraman, R.: Neuroergonomics: research and practice. Theor. Issues Ergon. Sci. 4(1–2), 5–20 (2003)
Parasuraman, R., Wilson, G.F.: Putting the brain to work: neuroergonomics past, present, and future. Hum. Factors 50(3), 468–474 (2008)
Fedota, J., Parasuraman, R.: Neuroergonomics and human error. AU Theor. Issues Ergon. Sci. 11(5), 402–421 (2010)
Ayaz, H., Pakir, M., Izzetoglu, K., Curtin, A., Shewokis, P.A., Bunce, S.C., Onaral, B.: Monitoring expertise development during simulated UAV piloting tasks using optical brain imaging. In: 2012 IEEE Aerospace Conference (2012)
Ayaz, H., Onaral, B., Izzetoglu, K., Shewokis, P.A., McKendrick, R., Parasuraman, R.: Continuous monitoring of brain dynamics with functional near infrared spectroscopy as a tool for neuroergonomic research: empirical examples and a technological development. Front. Hum. Neurosci. 7, 871 (2013)
Afergan, D., Peck, E.M., Solovey, E.T., Jenkins, A., Hincks, S.W., Brown, E.T., Chang, R., Jacob, R.J.K.: Dynamic difficulty using brain metrics of workload. ACM, Toronto, Ontario, Canada (2014). https://doi.org/10.1145/2556288.2557230
Hancock, P., Chignell, M.H.: Toward a theory of mental work load: stress and adaptability in human-machine systems. In: Proceedings of the International IEEE Conference on Systems, Man and Cybernetics, 378–383 (1986)
Hart, S.G.: NASA-task load index (NASA-TLX); 20 years later. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Sage (2006)
Debue, N., van de Leemput, C.: What does germane load mean? An empirical contribution to the cognitive load theory. Front. Psychol. 5, 1099 (2014)
John, M.S., Kobus, D.A., Morrison, J.G.: A multi-tasking environment for manipulating and measuring neural correlates of cognitive workload. In: Proceedings of the IEEE 7th Conference on Human Factors and Power Plants (2002)
Miller, G.A.: The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychol. Rev. 63(2), 81 (1956)
Solovey, E.T., Zec, M., Garcia Perez, E.A., Reimer, B., Mehler, B.: Classifying driver workload using physiological and driving performance data: two field studies. In: Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems. ACM (2014)
Mehler, B., Reimer, B., Coughlin, J.F.: Sensitivity of physiological measures for detecting systematic variations in cognitive demand from a working memory task: an on-road study across three age groups. Hum. Factors 54(3), 396–412 (2012)
Ahlstrom, U., Friedman-Berg, F.J.: Using eye movement activity as a correlate of cognitive workload. Int. J. Ind. Ergon. 36(7), 623–636 (2006)
Jacob, R.J.K., Karn, K.S.: Eye tracking in human-computer interaction and usability research: ready to deliver the promises. In: Hyönä, J., Radach, R., Deubel, H. (eds.) The Mind’s Eye, pp. 573–605. North-Holland, Amsterdam (2003)
Goldberg, J.H., Kotval, X.P.: Computer interface evaluation using eye movements: methods and constructs. Int. J. Ind. Ergon. 24(6), 631–645 (1999)
Parasuraman, R., Christensen, J., Grafton, S.: Neuroergonomics: the brain in action and at work. Neuroimage 59(1), 1–3 (2012)
Ayaz, H., Willems, B., Bunce, S., Shewokis, P.A., Izzetoglu, K., Hah, S., Deshmukh, A., Onaral, B.: Estimation of cognitive workload during simulated air traffic control using optical brain imaging sensors. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) Foundations of Augmented Cognition. Directing the Future of Adaptive Systems: 6th International Conference, FAC 2011, Held as Part of HCI International 2011, Proceedings, pp. 549–558, Springer, Berlin, Heidelberg, Orlando, FL, USA, 9–14 July 2011
Liu, Y., Ayaz, H., Shewokis, P.A.: Multisubject “learning” for mental workload classification using concurrent EEG, fNIRS, and physiological measures. Front. Hum. Neurosci. 11, 389 (2017)
Di Domenico, S.I., Rodrigo, A.H., Ayaz, H., Fournier, M.A., Ruocco, A.C.: Decision-making conflict and the neural efficiency hypothesis of intelligence: a functional near-infrared spectroscopy investigation. Neuroimage 109, 307–317 (2015)
Durantin, G., Gagnon, J.F., Tremblay, S., Dehais, F.: Using near infrared spectroscopy and heart rate variability to detect mental overload. Behav. Brain Res. 259, 16–23 (2014)
Rodrigo, A.H., Domenico, S.I.D., Ayaz, H., Gulrajani, S., Lam, J., Ruocco, A.C.: Differentiating functions of the lateral and medial prefrontal cortex in motor response inhibition. NeuroImage 85, Part 1(0), 423–431 (2014)
Logan, G.D., Van Zandt, T., Verbruggen, F., Wagenmakers, E.J.: On the ability to inhibit thought and action: general and special theories of an act of control. Psychol. Rev. 121(1), 66–95 (2014)
Shalev, L., Ben-Simon, A., Mevorach, C., Cohen, Y., Tsal, Y.: Conjunctive continuous performance task (CCPT)–a pure measure of sustained attention. Neuropsychologia 49(9), 2584–2591 (2011)
McKendrick, R., Ayaz, H., Olmstead, R., Parasuraman, R.: Enhancing dual-task performance with verbal and spatial working memory training: continuous monitoring of cerebral hemodynamics with NIRS. NeuroImage 85, Part 3(0), 1014–1026 (2014)
Owen, A.M., McMillan, K.M., Laird, A.R., Bullmore, E.: N-back working memory paradigm: a meta-analysis of normative functional neuroimaging studies. Hum. Brain Mapp. 25(1), 46–59 (2005)
Wickens, C.D.: Situation awareness and workload in aviation. Curr. Dir. Psychol. Sci. 11(4), 128–133 (2002)
Endsley, M.R.: Design and evaluation for situation awareness enhancement. Proc. Hum. Factors Soc. Annu. Meet. 32(2), 97–101 (1988)
Hagen, K., Ehlis, A.-C., Haeussinger, F.B., Heinzel, S., Dresler, T., Mueller, L.D., Herrmann, M.J., Fallgatter, A.J., Metzger, F.G.: Activation during the trail making test measured with functional near-infrared spectroscopy in healthy elderly subjects. NeuroImage 85, Part 1, 583–591 (2014)
Müller, L.D., Guhn, A., Zeller, J.B.M., Biehl, S.C., Dresler, T., Hahn, T., Fallgatter, A.J., Polak, T., Deckert, J., Herrmann, M.J.: Neural correlates of a standardized version of the trail making test in young and elderly adults: a functional near-infrared spectroscopy study. Neuropsychologia 56, 271–279 (2014)
Aklin, W.M., Lejuez, C.W., Zvolensky, M.J., Kahler, C.W., Gwadz, M.: Evaluation of behavioral measures of risk taking propensity with inner city adolescents. Behav. Res. Ther. 43(2), 215–228 (2005)
Crowley, T.J., Raymond, K.M., Mikulich-Gilbertson, S.K., Thompson, L.L., Lejuez, C.W.: A risk-taking “set” in a novel task among adolescents with serious conduct and substance problems. J. Am. Acad. Child Adolesc. Psychiatry 45(2), 175–183 (2006)
Ebbinghaus, H.: Memory: a contribution to experimental psychology. Ann. Neurosci. 20(4), 155–156 (2013)
Ayaz, H., Dehais, F.: Neuroergonomics: The Brain at Work and Everyday Life, 1st edn. Elsevier, Academic Press, London (2019)
Gramann, K., Ferris, D.P., Gwin, J., Makeig, S.: Imaging natural cognition in action. Int. J. Psychophys. 91(1), 22–29 (2014)
Gramann, K., Fairclough, S.H., Zander, T.O., Ayaz, H.: Editorial: trends in neuroergo-nomics. Front. Hum. Neurosci. 11(165) (2017). https://doi.org/10.3389/fnhum.2017.00165
Acknowledgments
This research was supported by the Air Force Research Laboratory’s Human Performance Sensing BAA call 002 under contract number FA8650-16-c-6764. The content of the information herein does not necessarily reflect the position or the policy of the sponsor and no official endorsement should be inferred.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Mark, J. et al. (2020). Eye Tracking-Based Workload and Performance Assessment for Skill Acquisition. In: Ayaz, H. (eds) Advances in Neuroergonomics and Cognitive Engineering. AHFE 2019. Advances in Intelligent Systems and Computing, vol 953. Springer, Cham. https://doi.org/10.1007/978-3-030-20473-0_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-20473-0_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-20472-3
Online ISBN: 978-3-030-20473-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)