Abstract
The aim of this work is the design and the development of an ICT platform integrating advanced Natural User Interface technologies for multi-domain Cognitive Rehabilitation without the direct physician involvement to the rehabilitation session. The platform is made up of a set-top-box connected to a TV monitor, a Microsoft Kinect RGB-D sensor and a (optional) WWS Smartex e-shirt for clinical signs monitoring.
Customized algorithms for calibration, people segmentation, body skeletonization and hands tracking through the RGB-D sensor have been implemented in order to infer knowledge about the reaction of the end-user to the Graphical User Interface designed for specific cognitive domains. For proper interaction, gestures of Alzheimer Disease’s patients are acquired by Microsoft Kinect in the nominal functioning range, allowing 100% hands detection rate, useful for an error free human-machine interaction.
Chapter PDF
Similar content being viewed by others
References
Clare, L., et al.: Cognitive Rehabilitation in Dementia. In: Neuropsychologistical Rehabilitation, pp. 193–196. Psychology Press Ltd. (2001)
Neal, M., Briggs, M.: Validation therapy for dementia (Cochrane Review). The Cochrane Library, Chichester, UK, vol. (2) (2004)
Spector, A., Orrell, M., Davies, S., Woods, B.: Reality orientation for Dementia. Cochrane Database Syst. Rev. (4): CD001119. Review (2000)
Woods, R.T., Bruce, E., Edwards, R.T., Hounsome, B., Keady, J., Moniz-Cook, E.D., Orrell, M., Russell, I.T.: Reminiscence groups for people with dementia and their family carers: pragmatic eight-center randomised trial of joint reminiscence and maintenance versus usual treatment: a protocol. Trials 10, 64–74 (2009)
Clare, L., Woods, R.T., Moniz Cook, E.D., Orrel, M., Spector, A.: Cognitive Rehabilitation in Alzheimer’s Disease. Aging Clin. Exp. Res. 18, 141–143 (2006)
Richard, E., et al.: Augmented Reality for Rehabilitation of Cognitive Disable Children: A preliminary Study. Virtual Rehabilitation, 102–108 (2007)
Standen, P., Brown, D.: Virtual reality and its role in removing the barriers that turn cognitive impairments into intellectual disability. Virtual Reality 10(3), 241–252 (2006)
Taylor, M.J.D., et al.: Activity-promoting gaming systems in exercise and rehabilitation. Journal of Rehabilitation Research 48(10), 1171–1186 (2011)
Pugnetti, L., Mendozzi, L., Barbieri, E., Motta, A.: VR experience with neurological patients: basic cost/benefit issues. Stud. Health Technol. Inform. 58, 243–248 (1998)
Rizzo, A.A., Buckwalter, J.G.: The status of virtual reality for the cognitive rehabilitation of persons with neurological disorders and acquired brain injury. Stud. Health Technol. Inform. 39, 22–33 (1997)
Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Comput. Graph. 21(6), 34–47 (2001)
Azuma, R.T.: A survey of augmented reality. Presence: Teleoperators and Virtual Environments 6(4), 355–385 (1997)
Nacke, L.E., et al.: Brain training for silver aged gamers: effects of age and game form on effectiveness, self-assessment, and gameplay. Cyberpsychology & Behavior 12(5), 493–499 (2009)
Imbeault, F., et al.: Serious Games in Cognitive Training for Alzheimer’s Patients. In: IEEE Int. Conference on Serious Games and Applications for Health, pp. 122–129 (2011)
Jiang, C.F., Chen, D.K., Li, Y.S., Kuo, J.L.: Development of a computer-aided tool for evaluation and training in 3d spatial cognitive function. In: 19th IEEE Symposium on Computer-Based Medical Systems, pp. 241–244 (2006)
Tremblay, J.B., Bouchard, A., Bouzouane, A.: Adaptive game mechanics for learning purposes: making serious games playable and fun. In: Proc. Int. Conf. on Computer Supported Education, vol. 2, pp. 465–470 (April 2010)
Da Gama, A., et al.: Improving Motor Rehabilitation Process through a Natural Interaction Based System Using Kinect Sensor. In: Proceedings of IEEE Symposium on 3D User Interfaces, pp. 145–146 (2012)
Lange, B., et al.: Development and evaluation of low cost game based balance rehabilitation tool using the Microsoft Kinect Sensor. In: 33rd IEEE International Conference on Engineering in Medicine and Biology Society (2011)
Soong, Y.L.W., Man Way, K.D.: A Tele-cognitive Rehabilitation Platform for Persons with Brain Injuries. In: TENCON IEEE Region 10 Conference (2006)
Solana, J., et al.: PREVIRNEC, A new platform for cognitive tele-rehabilitation. In: The Third Int. Conference on Advanced Cognitive Technologies and Applications (2011)
Folstein, M., Folstein, S., McHugh, P.: Mini-mental state: a practical method of grading the cognitive state of patients for the clinician. J. Psychiat. Res. 12, 189–198 (1975)
ISO/IEC. 2001. International Standard ISO/IEC 9126 – 1. Software engineering - Product quality - Part 1: Quality model. International Organization for Standardization/International Electrotechnical Commision, Geneva (2001)
http://msdn.microsoft.com/en-us/library/hh361572%28v=office.14%29.aspx
http://www.microsoft.com/en-us/kinectforwindowsdev/start.aspx
Holt, C.C.: Forecasting seasonals and trends by exponentially weighted moving averages, ONR Memorandum, vol. 52. Carnegie Institute of Technology, Pittsburgh (1957), available from the Engineering Library, University of Texas at Austin
Roberts, S.W.: Control Chart Tests Based on Geometric Moving Averages. Technometrics (1959)
Sangheon, P., Sunjin, Y., Joongrock, K., Sungjin, K., Sangyoun, L.: 3D hand tracking using Kalman Filter in depth space. EURASIP Journal on Advances in Signal Processing 2012, 36 (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Leone, A., Caroppo, A., Siciliano, P. (2014). A Virtual Trainer by Natural User Interface for Cognitive Rehabilitation in Dementia. In: Stephanidis, C., Antona, M. (eds) Universal Access in Human-Computer Interaction. Aging and Assistive Environments. UAHCI 2014. Lecture Notes in Computer Science, vol 8515. Springer, Cham. https://doi.org/10.1007/978-3-319-07446-7_29
Download citation
DOI: https://doi.org/10.1007/978-3-319-07446-7_29
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07445-0
Online ISBN: 978-3-319-07446-7
eBook Packages: Computer ScienceComputer Science (R0)