Human-Computer Interaction Approaches for the Assessment and the Practice of the Cognitive Capabilities of Elderly People

  • Manuela ChessaEmail author
  • Chiara Bassano
  • Elisa Gusai
  • Alice E. Martis
  • Fabio Solari
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11134)


The cognitive assessment of elderly people is usually performed by means of paper-pencil tests, which may not provide an exhaustive evaluation of the cognitive abilities of the subject. Here, we analyze two solutions based on interaction in virtual environments. In particular, we consider a non-immersive exergame based on a standard tablet, and an immersive VR environment based on a head-mounted display. We show the potential use of such tools, by comparing a set of computed metrics with the results of standard clinical tests, and we discuss the potential use of such tools to perform more complex evaluations. In particular, the use of immersive environments, which could be implemented both with head-mounted displays or with configurations of stereoscopic displays, allows us to track the patients’ pose, and to analyze his/her movements and posture, when performing Activities of Daily Living, with the aim of having a further way to assess cognitive capabilities.


Virtual reality Exergames Human pose tracking Cognitive assessment Immersive environments 


  1. 1.
    Giannakouris, K., et al.: Ageing characterises the demographic perspectives of the European societies. Stat. Focus 72, 2008 (2008)Google Scholar
  2. 2.
    Prince, M., Comas-Herrera, A., Knapp, M., Guerchet, M., Karagiannidou, M.: World Alzheimer report 2016: improving healthcare for people living with dementia: coverage, quality and costs now and in the future (2016)Google Scholar
  3. 3.
    Aalten, P., et al.: Behavioral problems in dementia: a factor analysis of the neuropsychiatric inventory. Dement. Geriatr. Cogn. Disord. 15(2), 99–105 (2003)CrossRefGoogle Scholar
  4. 4.
    Winblad, B., et al.: Mild cognitive impairment-beyond controversies, towards a consensus: report of the international working group on mild cognitive impairment. J. Intern. Med. 256(3), 240–246 (2004)CrossRefGoogle Scholar
  5. 5.
    Gauthier, S., et al.: Mild cognitive impairment. Lancet 367(9518), 1262–1270 (2006)CrossRefGoogle Scholar
  6. 6.
    Farias, S.T., Mungas, D., Reed, B.R., Harvey, D., Cahn-Weiner, D., DeCarli, C.: MCI is associated with deficits in everyday functioning. Alzheimer Dis. Assoc. Disord. 20(4), 217 (2006)CrossRefGoogle Scholar
  7. 7.
    Hertzog, C., Kramer, A.F., Wilson, R.S., Lindenberger, U.: Enrichment effects on adult cognitive development: can the functional capacity of older adults be preserved and enhanced? Psychol. Sci. Public Interest 9(1), 1–65 (2008)CrossRefGoogle Scholar
  8. 8.
    Powers, K.L., Brooks, P.J., Aldrich, N.J., Palladino, M.A., Alfieri, L.: Effects of video-game play on information processing: a meta-analytic investigation. Psychon. Bull. Rev. 20(6), 1055–1079 (2013)CrossRefGoogle Scholar
  9. 9.
    Anderson-Hanley, C., et al.: Exergaming and older adult cognition: a cluster randomized clinical trial. Am. J. Prev. Med. 42(2), 109–119 (2012)CrossRefGoogle Scholar
  10. 10.
    Zakzanis, K.K., Quintin, G., Graham, S.J., Mraz, R.: Age and dementia related differences in spatial navigation within an immersive virtual environment. Med. Sci. Monitor 15(4), CR140–CR150 (2009)Google Scholar
  11. 11.
    Yeh, S.C., Chen, Y.C., Tsai, C.F., Rizzo, A.: An innovative virtual reality system for mild cognitive impairment: diagnosis and evaluation. In: 2012 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES), pp. 23–27. IEEE (2012)Google Scholar
  12. 12.
    McCallum, S., Boletsis, C.: Dementia games: a literature review of dementia-related serious games. In: Ma, M., Oliveira, M.F., Petersen, S., Hauge, J.B. (eds.) SGDA 2013. LNCS, vol. 8101, pp. 15–27. Springer, Heidelberg (2013). Scholar
  13. 13.
    Martis, A.E., Bassano, C., Solari, F., Chessa, M.: Going to a virtual supermarket: comparison of different techniques for interacting in a serious game for the assessment of the cognitive status. In: Battiato, S., Farinella, G.M., Leo, M., Gallo, G. (eds.) ICIAP 2017. LNCS, vol. 10590, pp. 281–289. Springer, Cham (2017). Scholar
  14. 14.
    Gusai, E., Bassano, C., Solari, F., Chessa, M.: Interaction in an immersive collaborative virtual reality environment: a comparison between leap motion and HTC controllers. In: Battiato, S., Farinella, G.M., Leo, M., Gallo, G. (eds.) ICIAP 2017. LNCS, vol. 10590, pp. 290–300. Springer, Cham (2017). Scholar
  15. 15.
    Ashford, J.W., et al.: Should older adults be screened for dementia? Alzheimer’s Dement. J. Alzheimer’s Assoc. 2(2), 76–85 (2006)CrossRefGoogle Scholar
  16. 16.
    Lezak, M.D., Howieson, D.B., Loring, D.W., Fischer, J.S.: Neuropsychological Assessment. Oxford University Press, USA (2004)Google Scholar
  17. 17.
    Alzheimer’s Society: What is dementia? Accessed 07 June 2018
  18. 18.
    Folstein, M.F., Folstein, S.E., McHugh, P.R.: “mini-mental state”: a practical method for grading the cognitive state of patients for the clinician. J. Psychiatr. Res. 12(3), 189–198 (1975)CrossRefGoogle Scholar
  19. 19.
    Tombaugh, T.N., McIntyre, N.J.: The mini-mental state examination: a comprehensive review. J. Am. Geriatr. Soc. 40(9), 922–935 (1992)CrossRefGoogle Scholar
  20. 20.
    Pfeiffer, E.: A short portable mental status questionnaire for the assessment of organic brain deficit in elderly patients. J. Am. Geriatr. Soc. 23(10), 433–441 (1975)CrossRefGoogle Scholar
  21. 21.
    Malhotra, C., et al.: Diagnostic performance of short portable mental status questionnaire for screening dementia among patients attending cognitive assessment clinics in Singapore. Ann. Acad. Med. Singap. 42(7), 315–319 (2013)Google Scholar
  22. 22.
    Brodaty, H., et al.: The GPCOG: a new screening test for dementia designed for general practice. J. Am. Geriatr. Soc. 50(3), 530–534 (2002)CrossRefGoogle Scholar
  23. 23.
    Ahn, I.S., et al.: Impairment of instrumental activities of daily living in patients with mild cognitive impairment. Psychiatry Investig. 6(3), 180–184 (2009)CrossRefGoogle Scholar
  24. 24.
    Aretouli, E., Brandt, J.: Everyday functioning in mild cognitive impairment and its relationship with executive cognition. Int. J. Geriatr. Psychiatry 25(3), 224–233 (2010)CrossRefGoogle Scholar
  25. 25.
    Spooner, D.M., Pachana, N.A.: Ecological validity in neuropsychological assessment: a case for greater consideration in research with neurologically intact populations. Arch. Clin. Neuropsychol. 21(4), 327–337 (2006)CrossRefGoogle Scholar
  26. 26.
    Rizzo, A.A., Schultheis, M., Kerns, K.A., Mateer, C.: Analysis of assets for virtual reality applications in neuropsychology. Neuropsychol. Rehabil. 14(1–2), 207–239 (2004)CrossRefGoogle Scholar
  27. 27.
    Maillot, P., Perrot, A., Hartley, A.: Effects of interactive physical-activity video-game training on physical and cognitive function in older adults. Psychol. Aging 27(3), 589 (2012)CrossRefGoogle Scholar
  28. 28.
    Laamarti, F., Eid, M., Saddik, A.E.: An overview of serious games. Int. J. Comput. Games Technol. 2014, 11 (2014)CrossRefGoogle Scholar
  29. 29.
    Chessa, M., Noceti, N.: Investigating natural interaction in augmented reality environments using motion qualities. In: VISIGRAPP (6: VISAPP), pp. 110–117 (2017)Google Scholar
  30. 30.
    Benveniste, S., Jouvelot, P., Pin, B., Péquignot, R.: The MINWii project: renarcissization of patients suffering from Alzheimer’s disease through video game-based music therapy. Entertain. Comput. 3(4), 111–120 (2012)CrossRefGoogle Scholar
  31. 31.
    Manera, V., et al.: “Kitchen and cooking,” a serious game for mild cognitive impairment and Alzheimer’s disease: a pilot study. Front. Aging Neurosci. 7, 24 (2015)CrossRefGoogle Scholar
  32. 32.
    Ben-Sadoun, G., et al.: Physical and cognitive stimulation using an exergame in subjects with normal aging, mild and moderate cognitive impairment. J. Alzheimer’s Dis. 53(4), 1299–1314 (2016)CrossRefGoogle Scholar
  33. 33.
    Zucchella, C., et al.: Serious games for screening pre-dementia conditions: from virtuality to reality? a pilot project. Funct. Neurol. 29(3), 153 (2014)Google Scholar
  34. 34.
    Oliveira, C.R., et al.: Development and feasibility of a virtual reality task for the cognitive assessment of older adults: the ECO-VR. Span. J. Psychol. 19 (2016)Google Scholar
  35. 35.
    Vourvopoulos, A., Faria, A.L., Ponnam, K., Bermudez i Badia, S.: Rehabcity: design and validation of a cognitive assessment and rehabilitation tool through gamified simulations of activities of daily living. In: Proceedings of the 11th Conference on Advances in Computer Entertainment Technology, p. 26. ACM (2014)Google Scholar
  36. 36.
    Zygouris, S., et al.: A preliminary study on the feasibility of using a virtual reality cognitive training application for remote detection of mild cognitive impairment. J. Alzheimer’s Dis. 56(2), 619–627 (2017)CrossRefGoogle Scholar
  37. 37.
    Manera, V., et al.: A feasibility study with image-based rendered virtual reality in patients with mild cognitive impairment and dementia. PloS one 11(3), e0151487 (2016)CrossRefGoogle Scholar
  38. 38.
    Solari, F., Chessa, M., Garibotti, M., Sabatini, S.P.: Natural perception in dynamic stereoscopic augmented reality environments. Displays 34(2), 142–152 (2013)CrossRefGoogle Scholar
  39. 39.
    Parsons, T.D., McPherson, S., Interrante, V.: Enhancing neurocognitive assessment using immersive virtual reality. In: 2013 1st Workshop on Virtual and Augmented Assistive Technology (VAAT), pp. 27–34. IEEE (2013)Google Scholar
  40. 40.
    Corriveau Lecavalier, N., Ouellet, É., Boller, B., Belleville, S.: Use of immersive virtual reality to assess episodic memory: A validation study in older adults. Neuropsychological rehabilitation, pp. 1–19 (2018)Google Scholar
  41. 41.
    Tarnanas, I., Schlee, W., Tsolaki, M., Müri, R., Mosimann, U., Nef, T.: Ecological validity of virtual reality daily living activities screening for early dementia: longitudinal study. JMIR Serious Games 1(1), e1 (2013)CrossRefGoogle Scholar
  42. 42.
    Eisapour, M., Cao, S., Domenicucci, L., Boger, J.: Participatory design of a virtual reality exercise for people with mild cognitive impairment. In: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. ACM (2018). CS15Google Scholar
  43. 43.
    Chessa, M., Noceti, N., Martini, C., Solari, F., Odone, F.: Designing assistive tools for the market. In: Computer Vision for Assistive Healthcare, pp. 337–362. Elsevier (2018)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Department of Informatics, Bioengineering, Robotics, and Systems EngineeringUniversity of GenoaGenoaItaly

Personalised recommendations