Eye Tracking-Based Workload and Performance Assessment for Skill Acquisition
The result of training to improve in a given skill is most often demonstrated by an increase in the relevant performance measures. However, a complementary and at times more informative measure is the mental workload imposed on the performer when doing the task. While a number of varied methods exist for measuring workload, we have chosen to explore physiological and neurological correlates for their low amount of impact and interference on subjects during an experiment. In this study, participants trained on a six-task cognitive battery over four weeks while being simultaneously recorded with remote eye tracking and a host of other neurophysiological instruments. In this preliminary analysis, we found that measures of saccades, fixations, and pupil diameters significantly correlated with task performance over time and at different difficulties, indicating the validity of our task battery as well as the specificity of workload-related eye tracking measures.
KeywordsCognitive workload Eye tracking Multimodal Task battery
This research was supported by the Air Force Research Laboratory’s Human Performance Sensing BAA call 002 under contract number FA8650-16-c-6764. The content of the information herein does not necessarily reflect the position or the policy of the sponsor and no official endorsement should be inferred.
- 4.Ayaz, H., Pakir, M., Izzetoglu, K., Curtin, A., Shewokis, P.A., Bunce, S.C., Onaral, B.: Monitoring expertise development during simulated UAV piloting tasks using optical brain imaging. In: 2012 IEEE Aerospace Conference (2012)Google Scholar
- 5.Ayaz, H., Onaral, B., Izzetoglu, K., Shewokis, P.A., McKendrick, R., Parasuraman, R.: Continuous monitoring of brain dynamics with functional near infrared spectroscopy as a tool for neuroergonomic research: empirical examples and a technological development. Front. Hum. Neurosci. 7, 871 (2013)CrossRefGoogle Scholar
- 6.Afergan, D., Peck, E.M., Solovey, E.T., Jenkins, A., Hincks, S.W., Brown, E.T., Chang, R., Jacob, R.J.K.: Dynamic difficulty using brain metrics of workload. ACM, Toronto, Ontario, Canada (2014). https://doi.org/10.1145/2556288.2557230
- 7.Hancock, P., Chignell, M.H.: Toward a theory of mental work load: stress and adaptability in human-machine systems. In: Proceedings of the International IEEE Conference on Systems, Man and Cybernetics, 378–383 (1986)Google Scholar
- 8.Hart, S.G.: NASA-task load index (NASA-TLX); 20 years later. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Sage (2006)Google Scholar
- 10.John, M.S., Kobus, D.A., Morrison, J.G.: A multi-tasking environment for manipulating and measuring neural correlates of cognitive workload. In: Proceedings of the IEEE 7th Conference on Human Factors and Power Plants (2002)Google Scholar
- 12.Solovey, E.T., Zec, M., Garcia Perez, E.A., Reimer, B., Mehler, B.: Classifying driver workload using physiological and driving performance data: two field studies. In: Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems. ACM (2014)Google Scholar
- 18.Ayaz, H., Willems, B., Bunce, S., Shewokis, P.A., Izzetoglu, K., Hah, S., Deshmukh, A., Onaral, B.: Estimation of cognitive workload during simulated air traffic control using optical brain imaging sensors. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) Foundations of Augmented Cognition. Directing the Future of Adaptive Systems: 6th International Conference, FAC 2011, Held as Part of HCI International 2011, Proceedings, pp. 549–558, Springer, Berlin, Heidelberg, Orlando, FL, USA, 9–14 July 2011CrossRefGoogle Scholar
- 29.Hagen, K., Ehlis, A.-C., Haeussinger, F.B., Heinzel, S., Dresler, T., Mueller, L.D., Herrmann, M.J., Fallgatter, A.J., Metzger, F.G.: Activation during the trail making test measured with functional near-infrared spectroscopy in healthy elderly subjects. NeuroImage 85, Part 1, 583–591 (2014)CrossRefGoogle Scholar
- 30.Müller, L.D., Guhn, A., Zeller, J.B.M., Biehl, S.C., Dresler, T., Hahn, T., Fallgatter, A.J., Polak, T., Deckert, J., Herrmann, M.J.: Neural correlates of a standardized version of the trail making test in young and elderly adults: a functional near-infrared spectroscopy study. Neuropsychologia 56, 271–279 (2014)CrossRefGoogle Scholar
- 34.Ayaz, H., Dehais, F.: Neuroergonomics: The Brain at Work and Everyday Life, 1st edn. Elsevier, Academic Press, London (2019)Google Scholar
- 36.Gramann, K., Fairclough, S.H., Zander, T.O., Ayaz, H.: Editorial: trends in neuroergo-nomics. Front. Hum. Neurosci. 11(165) (2017). https://doi.org/10.3389/fnhum.2017.00165