Advertisement

Potential Application of Virtual Reality for Interface Customisation (and Pre-training) of Amputee Patients as Preparation for Prosthetic Use

  • David W. SimeEmail author
Chapter
Part of the Advances in Experimental Medicine and Biology book series (AEMB, volume 1120)

Abstract

Virtual Reality has been used to great effect in the field of retraining and strengthening neural pathways in victims of serious brain injury and stroke.

Meanwhile, VR visualisation of missing limbs in amputees has been used to great effect not only in the treatment of “phantom limb syndrome” but in helping amputees restore muscle tone in remaining limb sections and torso prior to fitting these areas for prosthetics.

The natural next step, combining elements of both approaches, is the potential application of virtual reality to actively train the patient for using these prostheses prior to them being fitted, and furthermore adjusting and customising the prosthetic itself to the emergent needs of the patient whilst using the VR training.

This raises fascinating new applications not only for virtual reality itself, but for the numerous peripheral technologies which have risen around VR. These technologies include force feedback, “haptic” sensory simulation and monitoring of muscle strength, position and movement ranges.

This chapter aims to assess the capabilities of these technologies, both now and in the future.

By reviewing the work of two key studies in this area this chapter aims to bring together the necessary skills and establish the collaborative crossovers (and existing precedents) which would be required to develop this application of VR in the future.

Keywords

Prostheses Amputee rehabilitation Haptic feedback Force feedback Muscle conditioning Neural retraining DBI (Direct Brain Interfacing) 

References

  1. Abt CC (1987) Serious games. University Press of AmericaGoogle Scholar
  2. Calhane C (2017) 8 Ways virtual reality could transform the lives of disabled people [Online]. AbilityNet. [13/08/2018]. Available from: https://www.abilitynet.org.uk/news-blogs/8-ways-virtual-reality-could-transform-lives-disabled-people
  3. Centres for Disease Control and Prevention (2018) Facts about upper and lower limb reduction defects [Online]. CDC. [10/10/2018]. Available from: https://www.cdc.gov/ncbddd/birthdefects/ul-limbreductiondefects.html
  4. Chandrashekar S (2018) GAAD: how virtual reality can transform the way people with disabilities learn [Online]. Corporate Learning Trends. [10/10/2018]. Available from: https://www.d2l.com/enterprise/blog/gaad-virtual-reality-people-disabilities-learn/
  5. Cruz-Neira C, Fernandez M, Portales C (2018) Virtual reality and games. Multimodal Technol Interact 2(1):8. [Online]. [Viewed 14/10/18]. Available from:  https://doi.org/10.3390/mti2010008
  6. Delazio A, Nakagaki K, Klatzky K, Hudson SE (2018) Force jacket: pneumatically-actuated jacket for embodied haptic experiences, vol. 1, pp 1–13. [Online]. [12/10/2017]. Available from: https://yivian.com/resource/paper/Force-Jacket-Pneumatically-Actuated-Jacket-for-Embodied-Haptic-Experiences-Paper.pdf
  7. Freeman E, Anderson R, Williamson J, Wilson G, Brewster S (2017) Textured surfaces for ultrasound haptic displays. In: Proceedings of 19th ACM International conference on multimodal interaction, Glasgow, UK, November 13–17, 2017 (ICMI’17), 2p.  https://doi.org/10.1145/3136755.3143020
  8. Hinchet, R, Vechev, V, Shea H, Hillings O (2018) Wearable haptic feedback for grasping in VR via a thin form-factor electrostatic brake [Online]Google Scholar
  9. Iturrate I, Chavarriaga R, Montesono L, Minguez J, Millan J (2015) Teaching brain-machine interfaces as an alternative paradigm to neuroprosthetics control, Sci Rep 5(13893):1–10. [Online]. [13/10/2018]. Available from: https://www.nature.com/articles/srep13893
  10. Johnson R (2015) Smart prosthetics to learn mind reading [Online]. EE Times. [13/10/2018]. Available from: https://www.eetimes.com/document.asp?doc_id=1327672
  11. Li B, Bailenson J (2017) Exploring the influence of haptic and olfactory cues of a virtual donut on satiation and eating behaviour. Presence Teleop Virt 26(3):337–354. [Online]. [12/10/2018]. Available from: https://www.mitpressjournals.org/doi/abs/10.1162/pres_a_00300?journalCode=pres
  12. Loomis JM, Marston JR, Golleridge RG, Klatzky RL (2005) Personal guidance system for people with visual impairment: a comparison of spatial displays for route guidance. J Visual Impairment Blindness 99(4):219–232. [Online]. [Viewed on 13/10/18]. Available from: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2801896/
  13. National Health Service England and Wales (2018) Clinical Commissioning Policy: provision of multi-grip upper limb prosthetics [Online]. NHS. [10/10/2018]. Available from: https://www.engage.england.nhs.uk/consultation/specialised-services-consultation/user_uploads/upper-limb-policy.pdf
  14. Naturecom Scientific Reports. [Online]. [17 October 2018]. Available from: https://www.nature.com/articles/srep13893
  15. Ottobock (2017) Myoelectric prosthetics 101 [Online]. Ottobock. [09/10/2018]. Available from: https://www.ottobockus.com/prosthetics/info-for-new-amputees/prosthetics-101/myoelectric-prosthetics-101/
  16. Pélisson D, Prablanc C, Goodale MA et al (1986) Visual control of reaching movements without vision of the limb. Exp Brain Res 62:303.  https://doi.org/10.1007/BF00238849 CrossRefPubMedGoogle Scholar
  17. Phelan I (2015) Exploring virtual reality and prosthetic training. In: Arles C (ed) IEEE virtual reality. Location of conference, 23/03/2015. Provence. IEEE, France, pp 353–354Google Scholar
  18. Phelan M, Arden C, Garcia M, Roast C (2015) Exploring virtual reality and prosthetic training. In: IEEE Virtual Reality conference (VR). [Online] 23–27 March Ed, pp 353–354. [Viewed 13/10/18]. Available from: http://shura.shu.ac.uk/9309/
  19. Pieris RL, Peng W, Chen Z, Chan L, Minamizawa K (2017) ThermoVR: exploring integrated thermal haptic feedback with head mounted displays. In: Peris RL (ed) CHI ‘17 Proceedings of the 2017 CHI conference on human factors in computing systems. Denver, Colorado, 06/11/2017. ACM, USA, pp 5452–5456Google Scholar
  20. Pocket Sized Hands (2017) 5 Ways AR and VR are going to change the oil and gas industry. [Online]. Pocket Sized Hands [Viewed 12/10/2017]. Available from: https://pocketsizedhands.com/blog/2018/04/12/5waysarandvraregoingtochangetheoilandgasindustry
  21. Prahm C, Vujaklija I, Kayali F, Purgathofer P, Aszmann OC (2017) Game-based rehabilitation for myoelectric prosthesis control (Eysenbach G ed). JMIR Serious Games 5(1):e3. doi: https://doi.org/10.2196/games.6026
  22. Ritterfeld U, Cody M, Vorderer P (eds) (2009) Serious games: mechanisms and effects. Routledge, New YorkGoogle Scholar
  23. Rouse M (2005) Myoelectric signal (motor action potential) [Online]. Tech Target. [09/10/2018]. Available from: https://searchmobilecomputing.techtarget.com/definition/myoelectric-signal
  24. Saponsik G, Levin M (2011) Virtual reality in stroke rehabilitation: a meta-analysis and implications for clinicians. Stroke 42(5):1380–1396. [Online]. [13/10/2018]. Available from: https://www.ncbi.nlm.nih.gov/pubmed/21474804
  25. Sathiyanarayanan M, Rajan S (2016) MYO Armband for physiotherapy healthcare: a case study using gesture recognition application. In: 2016 8th International Conference on Communication Systems and Networks (COMSNETS), Bangalore, pp 1–6. doi: 10.1109/COMSNETS.2016.7439933Google Scholar
  26. Sime DW (2019) Virtual reality therapeutic environments in Autism Spectrum Disorder (ASD) and Alzheimer’s: treatment, diagnosis, and refinement. In: Guazzaroni G (ed) virtual and augmented reality in mental health treatment. IGI Global, Hershey, pp 51–59.  https://doi.org/10.4018/978-1-5225-7168-1.ch004 CrossRefGoogle Scholar
  27. Snyder C (2016a) Virtual reality technologies: part 3 [Online]. Leading Ones. [Viewed on 7/10/2018]. Available from: http://www.leadingones.com/articles/intro-to-vr-3.html
  28. Snyder C (2016b) Degrees of freedom. Intro to VR concepts 1(Part 4):P1. [Online]. [13/10/2018]. Available from: http://www.leadingones.com/articles/intro-to-vr-4.html
  29. Unity (2018) Unity serious games showcase [online]. Unity. [13/10/2018]. Available from: https://unity3d.com/learn/resources/talks/unity-serious-games-showcase
  30. Wilkinson P (2016) A brief history of serious games, entertainment and serious games. Springer 9970: 17-41 [Online]. [13/10/2018]. Available from: https://www.springer.com/cda/content/document/cda_downloaddocument/9783319461519-c2.pdf?SGWID=0-0-45-1590681-p180248346

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Oncor – Online Corporate Video Production Ltd.GlasgowUK

Personalised recommendations