Abstract
Tracking cognitive workload (CWL) of physicians interacting with health information technology (HIT) might be useful in order to identify high-risk tasks, and to flag situations when performance might be expected to decline. Eight physician radiation oncologists (3-faculty, 5-residents) pupillary responses were monitored during treatment-planning tasks. The average change in task evoked pupillary response (TEPR) from pre-set baseline was calculated and the percent of time that the TEPR dilated by ≥0.45 mm (from historical studies) was taken as a measure of CWL where performance degradation could be expected. Physician performance was assessed subjectively (willingness-to-approve the treatment-plan) and objectively (number and severity of errors). There was an association between CWL and subjective performance (p < 0.01), but not objective performance (p > 0.05) as assessed using logistic regression analysis. Future research is needed to further advance available methods to quantify the relationship between CWL and performance during physicians-HIT interactions.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Ayaz, H., Willems, B., Bunce, B., Shewokis, P.A., Izzetoglu, K., Hah, S., Deshmukh, A., Onaral, B.: Cognitive workload assessment of air traffic controllers using optical brain imaging sensors. Advances in Understanding Human Performance: Neuroergonomics, Human Factors Design, and Special Populations, pp. 21–31 (2010)
Calkin, B.A.: Parameters affecting mental workload and the number of simulated UCAVs that can be effectively supervised, Doctoral dissertation, Wright State University (2007)
Colle, H.A., Reid, G.B.: Estimating a mental workload redline in a simulated air-to-ground combat mission. Int. J. Aviat. Psychol. 15(4), 303–319 (2005)
De Waard, D.: The Measurement of Drivers’ Mental Workload. Groningen University, Traffic Research Center, Netherlands (1996)
Liang, G.F., Lin, J.T., Hwang, S.L., Huang, F.H., Yenn, T.C., Hsu, C.C.: Evaluation and prediction of on-line maintenance workload in nuclear power plants. Human Factors Ergon. Manuf. Service Ind. 19(1), 64–77 (2009)
Carswell, C.M., Clarke, D., Seales, W.B.: Assessing mental workload during laparoscopic surgery. Surg. Innov. 12(1), 80–90 (2005)
Gaba, D.M., Lee, T.: Measuring the workload of the anesthesiologist. Anesth. Analg. 71(4), 354–361 (1990)
D’Souza, N., Holden, L., Robson, S., Mah, K., Di Prospero, L., Wong, C.S., Chow, E., Spayne, J.: Modern palliative radiation treatment: do complexity and workload contribute to medical errors? Int. J. Radiat. Oncol.* Biol.* Phys. 84(1), e43–e48 (2012)
Young, G., Zavelina, L., Hooper, V.: Assessment of workload using NASA task load index in perianesthesia nursing. J. PeriAnesthesia Nurs. 23(2), 102–110 (2008)
Yurko, Y.Y., Scerbo, M.W., Prabhu, A.S., Acker, C.E., Stefanidis, D.: Higher mental workload is associated with poorer laparoscopic performance as measured by the NASA-TLX tool. Simul. Healthc. 5(5), 267–271 (2010)
Mazur, L.M., Mosaly, P.R., Jackson, M., Chang, S.X., Burkhardt, K.D., Adams, R.D., Jones, E.L., Hoyle, L., Xu, J., Rockwell, J., Marks, L.B.: Quantitative assessment of workload and stressors in clinical radiation oncology. Int. J. Radiat. Oncol.* Biol.* Phys. 83(5), e571–e576 (2012)
Mazur, L.M., Mosaly, P.R., Hoyle, L.M., Jones, E.L., Marks, L.B.: Subjective and objective quantification of physician’s workload and performance during radiation therapy planning tasks. Pract. Radiat. Oncol. 3(4), e171–e177 (2013)
Mosaly, P.R., Mazur, L.M., Jones, E.L., Hoyle, L., Zagar, T., Chera, B.S., Marks, L.B.: Quantifying the impact of cross coverage on physician’s workload and performance in radiation oncology. Pract. Radiat. Oncol. 3(4), e179–e186 (2013)
Dahlstrom, N., Nahlinder, S.: A comparison of two recorders for obtaining in-flight heart rate data. Appl. Psychophysiol. Biofeedback 31(3), 273–279 (2006)
Dussault, C., Jouanin, J.C., Philippe, M., Guezennec, C.Y.: EEG and ECG changes during simulator operation reflect mental workload and vigilance. Aviat. Space Environ. Med. 76(4), 344–351 (2005)
Kramer, A.F.: Physiological metrics of mental workload: a review of recent progress. Multiple-task Perform., 279–328 (1991)
Beatty, J.: Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychol. Bull. 91(2), 276 (1982)
Hahnemann, D., Beatty, J.: Pupillary responses in a pitch-discrimination task. Percept. Psychophys. 2(3), 101–105 (1967)
Peavler, W.S.: Pupil size, information overload, and performance differences. Psychophysiology 11(5), 559–566 (1974)
Beatty, J., Lucero-Wagoner, B.: The pupillary system. Handb. Psychophysiol. 2, 142–162 (2000)
Juris, M., Velden, M.: The pupillary response to mental overload. Physiol. Psychol. 5(4), 421–424 (1977)
Karatekin, C., Couperus, J.W., Marcus, D.J.: Attention allocation in the dual-task paradigm as measured through behavioral and psychophysiological responses. Psychophysiology 41(2), 175–185 (2004)
Veltman, J.A., Gaillard, A.W.K.: Physiological workload reactions to increasing levels of task difficulty. Ergonomics 41(5), 656–669 (1998)
Zhang, J.H., Qin, P.P., Raisch, J., Wang, R.B.: Predictive modeling of human operator cognitive state via sparse and robust support vector machines. Cogn. Neurodyn. 7(5), 395–407 (2013)
Averty, P., Athenes, S., Collet, C., Dittmar, A.: Evaluating a new index of mental workload in real ATC situation using psychophysiological measures. In: Proceedings of the 21st Digital Avionics Systems Conference, vol. 2, pp. 7A4-1. IEEE (2002)
Reimer, B., Mehler, B.: The impact of cognitive workload on physiological arousal in young adult drivers: a field study and simulation validation. Ergonomics 54(10), 932–942 (2011)
Mazur, L.M., Mosaly, P.R., Hoyle, L.M., Jones, E.L., Chera, B.S., Marks, L.B.: Relating physician’s workload with errors during radiation therapy planning. Pract. Radiat. Oncol. 4(2), 71–75 (2014)
Marshall, S.P.: The index of cognitive activity: measuring cognitive workload. In: Proceedings of the 2002 IEEE 7th Conference on Human Factors and Power Plants, pp. 7–5. IEEE (2002)
Granholm, E., Asarnow, R.F., Sarkin, A.J., Dykes, K.L.: Pupillary responses index cognitive resource limitations. Psychophysiology 33(4), 457–461 (1996)
Lee, K.: Effects of flight factors on pilot performance, workload, and stress at final approach to landing phase of flight. Doctoral dissertation, University of Central Florida, Orlando, Florida (2010)
Kass, S.J., Cole, K.S., Stanny, C.J.: Effects of distraction and experience on situation awareness and simulated driving. Transp. Res. Part F Traffic Psychol. Behav. 10(4), 321–329 (2007)
Patten, C.J., Kircher, A., Östlund, J., Nilsson, L., Svenson, O.: Driver experience and cognitive workload in different traffic environments. Accid. Anal. Prev. 38(5), 887–894 (2006)
Stein, E.S.: The Measurement of Pilot Performance: A Master-Journeyman Approach (No. DOT/FAA/CT-83/15). Federal Aviation Administration Technical Center, Atlantic City, NJ (1984)
Acknowledgments
This study was originally funded by the UNC Healthcare System. The data analysis was partially supported by the grant numbers R18HS023458 and R21HS024062 from the Agency for Healthcare Research and Quality. The content is solely the responsibility of the authors and does not necessarily represent the official views of the Agency for Healthcare Research and Quality. Finally, we want to express our gratitude to all participants for their time and effort while participating in our experiments.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing Switzerland
About this paper
Cite this paper
Mosaly, P.R., Mazur, L., Marks, L. (2017). Physiological Evaluation and Quantification of Physician’s Cognitive Workload During Interaction with Computer Based Clinical System. In: Ahram, T., Karwowski, W. (eds) Advances in The Human Side of Service Engineering. Advances in Intelligent Systems and Computing, vol 494. Springer, Cham. https://doi.org/10.1007/978-3-319-41947-3_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-41947-3_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-41946-6
Online ISBN: 978-3-319-41947-3
eBook Packages: EngineeringEngineering (R0)