Skip to main content
SpringerLink
Log in

Natural Interaction for Medical Simulation and Training

  • Chapter
  • First Online:
Natural Interaction in Medical Training

Part of the book series: Human–Computer Interaction Series ((BRIEFSHUMAN))

  • 409 Accesses

Abstract

Skills training is of primary importance for healthcare professionals. New technologies such as natural interfaces and virtual reality bring new possibilities in learning outcomes especially if used synergically exploiting some principles derived from the so-called serious gaming interfaces. Virtual reality combined with natural interaction interfaces, through which natural gestures can be used to control interaction, have been primarily used in the medical field for the development of rehabilitation systems. However, such technologies are also promising for the implementation of decision support and skill training systems since they can improve users engagement in task completion and team based activities through immersivity and physical participation. In this chapter we are going to give an overview of the current state of medical simulation, considering issues and new perspectives, and to explain why immersive digital systems and natural interaction are important and can contribute to improving medical training. A large literature on immersive and natural interaction systems is reviewed highlighting good practices and limits. New opportunities offered by the recent development of virtual reality, especially if combined with computer vision systems, are introduced.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    ‘Harvey mannequin’ was one of the earliest electronic patients, currently sold by Laerdal Corporation.

References

  1. Harris SB (1992) The society for the recovery of persons apparently dead. Skept 24–31

    Google Scholar 

  2. Cooper J, Taqueti VR (2004) A brief history of the development of mannequin simulators for clinical education and training. Qual Saf Health Care

    Google Scholar 

  3. Gaba DM (2004) The future vision of simulation in health care, Qual Saf Health Care

    Google Scholar 

  4. Bradley P (2006) The history of simulation in medical education and possible future directions. Med Educ

    Google Scholar 

  5. McIntosh C, Macario A, Flanagan B, Gaba D (2006) Simulation: what does it really cost?. Simul Healthc J Soc Simul Healthc

    Google Scholar 

  6. Dale E (1969) Audio-visual methods in teaching. Holt(Rinehart and Winston), NY, USA

    Google Scholar 

  7. Sales BRA, Machado LS, Moraes RM (2011) Interactive collaboration for virtual reality systems related to medical education and training. CRC Press, Technology and Medical Sciences, pp 157–162

    Google Scholar 

  8. Allard J, Cotin S, Faure F, Bensoussan PJ, Poyer F, Duriez C et al (2007) SOFA—an open source framework for medical simulation. Med Meets Virtual Real 15:1–6

    Google Scholar 

  9. Oliveira ACMTG, Botega LC, Pavarini L, Rossatto DJ, Nunes FLS, Bezerra A (2006) Virtual reality framework for medical training: implementation of a deformation class using Java. In: Proceedings of the SIGGRAPH international conference on virtual-reality continuum and its applications in industry (SIGGRAPH 2006). T.F.H. (Publications), Hong Kong, pp. 347–351

    Google Scholar 

  10. Montgomery K, Bruyns C, Brown J, Sorkin S, Mazzella F, Thonier G, Tellier A, Lerman B, Menon A (2002) Spring: a general framework for collaborative, real-time surgical simulation. Med Meets Virtual Real (MMVR) 23–26

    Google Scholar 

  11. MicroSim L (2012). http://www.laerdal.com/it/docid/5899175/MicroSim

  12. Goktekin T, Cavusoglu MC, Tendick F, Sastry S (2004) GiPSi: an open source open architecture software development framework for surgical simulation. In: Proceedings of the international symposium on medical simulation. Cambridge

    Google Scholar 

  13. Kononowicz AA et al (2012) Effects of introducing a voluntary virtual patient module to a basic life support with an automated external defibrillator course: a randomised trial. BMC Med Educ 12(1):41

    Article  Google Scholar 

  14. Kelle S, Klemke R, Specht M (2013) Effects of game design patterns on basic life support training content. Int Forum Educ Technol Soc (IFETS)

    Google Scholar 

  15. Honey MLL, Diener S, Connor K, Veltman M, Bodily D (2009) Teaching in virtual space: second life simulation for haemorrhage management. In: Ascilite Conference. Aukland

    Google Scholar 

  16. Cowan B, Shelley M, Sabri H, Kapralos B, Hogue A, Hogan M, Jenkin M, Goldsworthy G, Rose L, Dubrowski A (2008) Interprofessional care simulator for critical care education. In: Proceedings of the 2008 conference on future play: research, play, share (Future Play-08). ACM, New York, NY, USA, pp 260–261

    Google Scholar 

  17. Sliney A, Murphy D (2008) Jdoc: a serious game for medical learning. In: International conference on advances in computer-human interaction

    Google Scholar 

  18. Buttussi F, Pellis T, Cabas VA, Pausler D, Carchietti E, Chittaro L (2013) Evaluation of a 3D serious game for advanced life support retraining. Int J Med Inf. Elsevier

    Google Scholar 

  19. Abt CC (1987) Serious games. University press of America

    Google Scholar 

  20. Hansen MM (2008) Versatile, immersive, creative and dynamic virtual 3-D healthcare learning environments: a review of the literature. J Med Internet Res 10(3)

    Google Scholar 

  21. Schreuder HW, Oei G, Maas M, Borleffs JC, Schijven MP (2011) Implementation of simulation in surgical practice: minimally invasive surgery has taken the lead: the Dutch experience. Med Teach 33(2):105–115

    Google Scholar 

  22. Cook DA, Hatala R, Brydges R, Zendejas B, Szostek JH, Wang AT, Erwin PJ, Hamstra SJ (2011) Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA 306(9):978–988

    Article  Google Scholar 

  23. Cowan B, Sabri H, Kapralos B, Moussa F, Cristancho S, Dubrowski A (2011) A serious game for off-pump coronary artery bypass surgery procedure training. In: MMVR, pp 147–149

    Google Scholar 

  24. Cowan B, Sabri H, Kapralos B, Porte M, Backstein D, Cristancho S, Dubrowski A (2010) A serious game for total knee arthroplasty procedure, education and training. J Cyber Ther Rehabil 3(3):285–98

    Google Scholar 

  25. Bowyer MW, Streete KA, Muniz GM, Liu AV (2008) Immersive virtual environments for medical training. In: Seminars in colon and rectal surgery 2008 Jun 30 (vol 19, no 2). WB Saunders, Philadelphia, PA, USA, pp 90–97

    Google Scholar 

  26. Andreatta PB, Maslowski E, Petty S, Shim W, Marsh M, Hall T, Stern S, Frankel J (2010) Virtual reality triage training provides a viable solution for disaster preparedness. Acad Emerg Med 17(8):870–876

    Article  Google Scholar 

  27. Kurenov SN, Cance WW, Noel B, Mozingo DW (2008) Game-based mass casualty burn training. Stud Health Tech Inf 142:142–4

    Google Scholar 

  28. Parvati DE, Heinrichs WL, Patricia Y (2011) CliniSpace: a multiperson 3D online immersive training environment accessible through a browser. Med Meets Virtual Real 18 NextMed 163:173

    Google Scholar 

  29. Taekman JM, Shelley K (2010) Virtual environments in healthcare: immersion, disruption, and flow. Int Anesthesiol Clin 48(3):101–121

    Article  Google Scholar 

  30. Youngblood P, Harter PM, Srivastava S, Moffett S, Heinrichs WL, Dev P (2008) Design, development, and evaluation of an online virtual emergency department for training trauma teams. Simul Healthc 3(3):146–53

    Article  Google Scholar 

  31. Heinrichs WL, Youngblood P, Harter PM, Dev P (2008) Simulation for team training and assessment: case studies of online training with virtual worlds. World J Surg 32(2):161–170

    Article  Google Scholar 

  32. Wiederhold BK, Wiederhold MD (2008) Virtual reality for posttraumatic stress disorder and stress inoculation training. J CyberTher Rehabil 1(1):23–35

    MathSciNet  Google Scholar 

  33. Alverson DC, Saiki SM Jr, Caudell TP, Summers K, Panaiotis, Sherstyuk A, Nickles D, Holten J, Goldsmith T, Stevens S, Kihmm K, Mennin S, Kalishman S, Mines J, Serna L, Mitchell S, Lindberg M, Jacobs J, Nakatsu C, Lozanoff S, Wax DS, Saland L, Norenberg J, Shuster G, Keep M, Baker R, Buchanan HS, Stewart R, Bowyer M, Liu A, Muniz G, Coulter R, Maris C, Wilks D (2005) Distributed immersive virtual reality simulation development for medical education, J Int Assoc Med Sci Educ 15–1

    Google Scholar 

  34. Kaufman M (2006) Team training of medical first responders for CBRNE events using multiplayer game technology. In: Proceedings of medicine meets virtual reality

    Google Scholar 

  35. Duffy TM, Jonassen DH (1992) Constructivism and the technology of instruction, Constructivism: new implications for instructional technology. A conversation. pp 1–6

    Google Scholar 

  36. Hogle JG. Considering games as cognitive tools: in search of effective

    Google Scholar 

  37. Luo X et al (2005) Integration of augmented reality and assistive devices for post-stroke hand opening rehabilitation. In: Proceedings of IEEE engineering in medicine and biology 27th annual conference. pp 6855–6858

    Google Scholar 

  38. Gunn C, Hutchins M, Stevenson D, Adcock M, Youngblood P (2005) Using collaborative haptics in remote surgical training. In: Eurohaptics conference and symposium on haptic interfaces for virtual environment and teleoperator systems (WHC2005). Italy

    Google Scholar 

  39. Burke JW, McNeill MDJ, Charles DK, Morrow PJ, Crosbie JH, McDonough SM (2010) Augmented reality games for upper-limb stroke rehabilitation. In: 2010 second international conference on games and virtual worlds for serious applications (VS-GAMES). IEEE, pp 75–78

    Google Scholar 

  40. Sparks D, Chase D, Coughlin L (2009) Wii have a problem: a review of self- reported Wii related injuries. Inform Prim Care 17(1):55–57

    Google Scholar 

  41. Satava RM (1993) Virtual reality surgical simulator. Surg Endosc 7(3):203–205

    Article  Google Scholar 

  42. Yanbin P, Hanwu H, Jinfang L, Dali Z (2007) Data-glove based interactive training system for virtual delivery operation. In: Second workshop on digital media and its application in museum and heritages. IEEE, pp 383–388

    Google Scholar 

  43. Wachs JP, Klsch M, Stern H, Edan Y (2011) Vision-based hand-gesture applications. Commun ACM 54(2):60–71

    Article  Google Scholar 

  44. Rautaray SS, Agrawal A (2015) Vision based hand gesture recognition for human computer interaction: a survey. Artif Intell Rev 43(1):1–54

    Article  Google Scholar 

  45. Graetzel C, Fong T, Grange S, Baur C (2004) A non-contact mouse for surgeon-computer interaction. Technol Health Care 12(3):245–257

    Google Scholar 

  46. Lange B, Koenig S, McConnell E, Chang C, Juang R, Suma E, Bolas M, Rizzo A (2012) Interactive game-based rehabilitation using the Microsoft kinect. Virtual reality short papers and posters (VRW), IEEE

    Google Scholar 

  47. Wattanasoontorn V, Magdics M, Boada I, Sbert M (2013). A kinect-based system for cardiopulmonary resuscitation simulation: a pilot study. In: Serious games development and applications. Springer Berlin Heidelberg, pp 51–63

    Google Scholar 

  48. Jayakumar A, Mathew B, Uma N, Nedungadi P (2015) Interactive gesture based cataract surgery simulation. In: 2015 Fifth international conference on advances in computing and communications (ICACC). IEEE, pp 350–353

    Google Scholar 

  49. Seymour NE, Gallagher AG, Roman SA, O’brien, MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236(4):458

    Google Scholar 

  50. Ruthenbeck Greg S, Reynolds Karen J (2015) Virtual reality for medical training: the state-of-the-art. J Simul 9(1):16–26

    Article  Google Scholar 

  51. Vankipuram A, Khanal P, Ashby A, Vankipuram M, Gupta A, DrummGurnee D, Josey K, Smith M (2014) Design and development of a virtual reality simulator for advanced cardiac life support training. IEEE J Biomed Health Inform 18(4):1478–1484

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Engineering, University of Florence, Florence, Italy

    Alberto Del Bimbo

  2. Media Integration and Communication Center, University of Florence, Florence, Italy

    Andrea Ferracani, Daniele Pezzatini & Lorenzo Seidenari

Authors
  1. Alberto Del Bimbo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Andrea Ferracani
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Daniele Pezzatini
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lorenzo Seidenari
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alberto Del Bimbo .

Rights and permissions

Reprints and permissions

Copyright information

© 2017 The Author(s)

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Del Bimbo, A., Ferracani, A., Pezzatini, D., Seidenari, L. (2017). Natural Interaction for Medical Simulation and Training. In: Natural Interaction in Medical Training. Human–Computer Interaction Series(). Springer, Cham. https://doi.org/10.1007/978-3-319-61036-8_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-61036-8_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-61035-1

  • Online ISBN: 978-3-319-61036-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation