Skip to main content

Validation of Virtual Reality Cognitive Assessment for Pilots Across the Lifespan

  • Conference paper
  • First Online:
Engineering Psychology and Cognitive Ergonomics (HCII 2021)

Abstract

This research reports on the acceptance and responses to a Virtual Reality (VR) cognitive health screening tool for younger and older pilots. Currently, there are few cognitive assessments that examine the cognitive health of pilots across the lifespan. The cognitive assessments tools for pilots that do exist index a variety of domain-independent functions which do not translate to real-world risks during flights. Furthermore, domain-independent functions such as processing speed, are negatively affected by age thereby making these tools potentially biased against older pilots. CANFLY, a 3-Dimensional (3D) virtual reality simulator, addresses the need for a domain-specific cognitive assessment tool which assesses cognitive functions that pertain to real-world flight such as situation awareness and prospective memory. While CANFLY addresses the problem of validity and generalization to real-world risk, it is also important to ensure that older pilots do not experience the systematic bias that can occur with the use of domain-independent cognitive assessment tools. Some possible age-related issues that could potentially arise with VR cognitive assessment tools include unexpected negative effects (such as simulator sickness or discomfort), or a general lack of acceptance of 3D flight simulation devices amongst older pilots. To examine age effects in VR flight, forty-seven pilots (four females), between the ages of 17 and 71, flew two sessions, the first in a standard full-scale simulator and the second in a VR flight simulator. The tasks in the VR flight were designed as the cognitive health screening tool and indexed key domain-dependent cognitive factors such as situation awareness and prospective memory. After the two sessions, the pilots were also asked to describe their experience with the 3D VR simulator compared to the standard flight simulator. Thus, the present study examined whether or not simulation environment and pilot age had an effect on flight performance. Interactions between the pilot age and effect of the simulation environment were also investigated. Age was also explored as a factor in the acceptance of the VR flight environment and the presence of cybersickness after the VR flight. The results showed that older pilots performed worse for a number of flight tasks, but that there was no interaction effect between age and flight simulation environment on situation awareness and prospective memory. There was a preference for the VR simulation over the full-scale simulator, and this was seen in both age groups. No effect of age was found for the cybersickness measures, although there was a small trend for pilots of all ages to experience slightly increased symptoms associated with queasiness after the VR flight. Findings from the present research show that older pilots are not likely to experience bias from the VR technology or cybersickness symptoms in a VR cognitive health screening tool. Results support the use of VR as a useful platform for evaluating domain-dependent cognition for pilots across the lifespan.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Statista Homepage. https://www.statista.com/statistics/910024/average-age-pilots-in-the-united-states/#:~:text=This%20statistic%20illustrates%. Accessed 11 Feb 2021

  2. Keith, C.: Report on the COPA 2017 membership survey. Ottawa, ON. https://copanational.org/sites/copanational.org/wp-content/uploads/2017/02/2017_Membership_survey_eng.pdf. Accessed 11 Feb 2021

  3. Aging and the General Aviation Pilot. https://www.aopa.org/-/media/Files/AOPA/Home/Pilot-Resources/Safety-and-Proficiency/Accident-Analysis/Special-Reports/1302agingpilotreport.pdf. Accessed 11 Feb 2021

  4. U.S. Department of Transportation. https://www.transportation.gov/testimony/faa%E2%80%99s-age-60-commercial-pilot-rule. Accessed 11 Feb 2021

  5. Odenheimer, G.: Function, flying, and the age-60 rule. J. Am. Geriatr. Soc. 47, 910–911 (1999). https://doi.org/10.1111/j.1532-5415.1999.tb03854.x

    Article  Google Scholar 

  6. Guide For Aviation Medical Examiners. https://www.faa.gov/about/office_org/headquarters_offices/avs/offices/aam/ame/guide/. Accessed 11 Feb 2021

  7. Bazargan, M., Guzhva, V.: Impact of gender, age and experience of pilots on general aviation accidents. Accident Anal. Prevent. 43, 962–970 (2011). https://doi.org/10.1016/j.aap.2010.11.023

    Article  Google Scholar 

  8. Oster, C., Strong, J., Zorn, C.: Why Airplanes Crash. Oxford University Press, New York (1992). https://global.oup.com/academic/product/why-airplanes-crash-9780195072235?cc=ca&lang=en&. Accessed 11 Feb 2021

  9. Rebok, G., Qiang, Y., Baker, S., Li, G.: Pilot age and error in air taxi crashes. Aviat. Space Environ. Med. 80, 647–651 (2009). https://doi.org/10.3357/ASEM.2369.2009

    Article  Google Scholar 

  10. Finstad, K., Bink, M., McDaniel, M., Einstein, G.: Breaks and task switches in prospective memory. Appl. Cogn. Psychol. 20, 705–712 (2006). https://doi.org/10.1002/acp.1223

    Article  Google Scholar 

  11. Dismukes, R.: Prospective memory in workplace and everyday situations. Curr. Direct. Psychol. Sci. 21, 215–220 (2012). https://doi.org/10.1177/0963721412447621

    Article  Google Scholar 

  12. Van Benthem, K., Herdman, C., Tolton, R., LeFevre, J.: Prospective memory failures in aviation: effects of cue salience, workload, and individual differences. Aerosp. Med. Hum. Perform. 86, 366–373 (2015). https://doi.org/10.3357/amhp.3428.2015

    Article  Google Scholar 

  13. Endsley, M.: Situation awareness misconceptions and misunderstandings. J. Cogn. Eng. Decis. Making 9, 4–32 (2015). https://doi.org/10.1177/1555343415572631

    Article  Google Scholar 

  14. Endsley, M.: Towards a new paradigm for automation: designing for situation awareness. IFAC Proc. Vol. 28, 365–370 (1995). https://doi.org/10.1016/s1474-6670(17)45259-1

    Article  Google Scholar 

  15. Nguyen, T., Lim, C., Nguyen, N., Gordon-Brown, L., Nahavandi, S.: A review of situation awareness assessment approaches in aviation environments. IEEE Syst. J. 13, 3590–3603 (2019). https://doi.org/10.1109/JSYST.2019.2918283

    Article  Google Scholar 

  16. Kay, G.: CogScreen aeromedical edition professional manual (professional manual). 824 Florida: Psychological Assessment Resources Inc. (1995)

    Google Scholar 

  17. Chee, S., Bigornia, V., Logsdon, D.: The application of a computerized cognitive screening tool in naval aviators. Milit. Med. 186, 198–204 (2021). https://doi.org/10.1093/milmed/usaa333

    Article  Google Scholar 

  18. Eckert, M., Naom, K., Roberts, D., Calhoun, V., Harris, K.: Age-related changes in processing speed: unique contributions of cerebellar and prefrontal cortex. Front. Hum. Neurosci. (2010). https://doi.org/10.3389/neuro.09.010.2010

    Article  Google Scholar 

  19. Examining the federal aviation administration’s age 60 rule. https://www.govinfo.gov/content/pkg/CHRG-109shrg63516/html/CHRG-109shrg63516.htm. Accessed 11 Feb 2021

  20. Van Benthem, K., Herdman, C.M.: CanFly! A distinctly canadian approach to promoting safe aviation in the third age. Presentation for the Canadian Owners and Pilots Association. Flight 8 Meeting, 23 September 2014, Ottawa, ON (2014)

    Google Scholar 

  21. Arns, L., Cerney, M.: The relationship between age and incidence of cybersickness among immersive environment users. In: IEEE Proceedings of the Virtual Reality, VR 2005 (2005). https://doi.org/10.1109/VR.2005.1492788

  22. Sharples, S., Cobb, S., Moody, A., Wilson, J.: Virtual reality induced symptoms and effects (VRISE): comparison of head mounted display (HMD), desktop and projection display systems. Displays 29, 58–69 (2008). https://doi.org/10.1016/j.displa.2007.09.005

    Article  Google Scholar 

  23. Cobb, S., Nichols, S., Ramsey, A., Wilson, J.: Virtual reality-induced symptoms and effects (VRISE). Presence: Teleoper. Virtual Environ. 8, 169–186 (1999). https://doi.org/10.1162/105474699566152

    Article  Google Scholar 

  24. Bermúdez Rey, M., Clark, T., Wang, W., Leeder, T., Bian, Y., Merfeld, D.: Vestibular perceptual thresholds increase above the age of 40. Front. Neurol. 7, 162 (2016)

    Article  Google Scholar 

  25. Kennedy, R., Lane, N., Berbaum, K., Lilienthal, M.: simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. Int. J. Aviat. Psychol. 3, 203–220 (1993). https://doi.org/10.1207/s15327108ijap0303_3

    Article  Google Scholar 

  26. Balk, S., Bertola, M., Inman, V.: Simulator sickness questionnaire: twenty years later. In: Proceedings of the 7th International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design: driving assessment 2013 (2013). https://doi.org/10.17077/drivingassessment.1498

  27. Knight, M., Arns, L.: The relationship among age and other factors on incidence of cybersickness in immersive environment users. In: Proceedings of the 3rd symposium on Applied perception in graphics and visualization - APGV 2006 (2006). https://doi.org/10.1145/1140491.1140539

  28. Chen, S., Zhou, R.: Age-related declines in prospective memory: modulation of the prospective and retrospective components. Acta Psychol. Sinica. 42, 640–650 (2010). https://doi.org/10.1007/978-3-540-73281-5_72

  29. West, R., Craik, F.: Age-related decline in prospective memory: the roles of cue accessibility and cue sensitivity. Psychol. Aging 14, 264–272 (1999). https://doi.org/10.1037/0882-7974.14.2.264

    Article  Google Scholar 

  30. Ramkhalawansingh, R., Butler, J., Campos, J.: Visual–vestibular integration during self-motion perception in younger and older adults. Psychol. Aging 33, 798–813 (2018). https://doi.org/10.1037/pag0000271

    Article  Google Scholar 

  31. Stauffert, J., Niebling, F., Latoschik, M.: Latency and cybersickness: impact, causes, and measures. A review. Front. Virtual Reality 1 (2020). https://doi.org/10.3389/frvir.2020.582204

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Oluchi Audu , Kathleen Van Benthem or Chris M. Herdman .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Audu, O., Van Benthem, K., Herdman, C.M. (2021). Validation of Virtual Reality Cognitive Assessment for Pilots Across the Lifespan. In: Harris, D., Li, WC. (eds) Engineering Psychology and Cognitive Ergonomics. HCII 2021. Lecture Notes in Computer Science(), vol 12767. Springer, Cham. https://doi.org/10.1007/978-3-030-77932-0_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-77932-0_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-77931-3

  • Online ISBN: 978-3-030-77932-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics