Skip to main content

Toward Smart Learning Environments: Affordances and Design Architecture of Augmented Reality (AR) Applications in Medical Education

  • Conference paper
  • First Online:
Proceedings of First International Conference on Smart System, Innovations and Computing

Part of the book series: Smart Innovation, Systems and Technologies ((SIST,volume 79))

Abstract

Medical education places emphasis on situational learning of real-life clinical contexts, while simultaneously focusing on human body three-dimensional (3D) visualization. However, classrooms and laboratories being the main learning environment in early years of medical education, there is limited exposure to real clinical environments to adequately meet such objectives. This study proposes that augmented reality (AR) applications can provide both affordances. Such applications fulfill many of the criteria for smart learning environments (SLE). A systematic review aiming to identify the affordances of AR applications, their design architectures, and impact evaluations was conducted. This review evaluated 25 studies and, with model case studies, analyzed how the different AR applications provided situational learning and visualization in medical education and how their design architecture provided such affordances toward contextualized, interactive, and personalized SLEs. It was found that AR affords facilitation of situational learning and visualization individually. Their integrated educational impact, however, needs to be evaluated further.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Similar content being viewed by others

References

  1. Hugues O., Fuchs, P., Nannipieri, O.: New Augmented Reality Taxonomy: Technologies and Features of Augmented Environment. In: Furht B, editor. Handbook of Augmented Reality. New York, NY: Springer New York; p. 47–63 (2011)

    Google Scholar 

  2. Merriam Webster Online. Affordance

    Google Scholar 

  3. Shelton, B.E., Hedley, N.R., Using augmented reality for teaching Earth-Sun relationships to undergraduate geography students. The First IEEE International Workshop Agumented Reality Toolkit (2002)

    Google Scholar 

  4. Kaufmann, H., Schmalstieg, D.: Mathematics and geometry education with collaborative augmented reality. Computers & Graphics.27(3):339–45 (2003)

    Google Scholar 

  5. Sen, A., L. Selvaratnam, K.L. Wan, J.J. Khoo, P.A. Rajadurai.: Virtual histopathology—essential education tools to ensure pathology competence for tomorrow’s medical interns. In INTED2016 Proceedings. eds L. Gómez Chova et al. p. 4633–4640. International Association of Technology, Education and Development, Spain (2016)

    Google Scholar 

  6. Wan, K.L., Sen, A., Selvaratnam, L., Khoo, J.J., Rajadurai, P.A.: Addressing the ‘Pathology Gap’ in Clinical Education and Internship: The Impetus to Develop Digital (3D) Anatomic Pathology Learning Resources. Proceedings of the 2016 IEEE International Conference On Teaching and Learning In Education (ICTLE’16), Kuala Lumpur, Malaysia, pp. 101–106 (2016)

    Google Scholar 

  7. Hwang, G.J.: Definition, framework and research issues of smart learning environments—a context-aware ubiquitous learning perspective. Smart Learn Environ 1 (1), 1–14 (2014)

    Google Scholar 

  8. Ai, D., Yang, J., Fan, J., Zhao, Y., Song, X., Shen, J., et al.: Augmented reality based real-time subcutaneous vein imaging system. Biomedical optics express.7(7):2565–85 (2016)

    Google Scholar 

  9. Bifulco, P., Narducci, F., Vertucci, R., Ambruosi, P., Cesarelli, M., Romano, M.: Telemedicine supported by Augmented Reality: an interactive guide for untrained people in performing an ECG test. Biomedical engineering online.13:153 (2014)

    Google Scholar 

  10. Blum, T., Kleeberger, V., Bichlmeier, C., Navab, N.: Mirracle: An augmented reality magic mirror system for anatomy education. 2012 IEEE Virtual Reality Workshops (VRW) IEEE Press (2012)

    Google Scholar 

  11. Botden, S.M., de Hingh, I.H., Jakimowicz, J.J.: Suturing training in Augmented Reality: gaining proficiency in suturing skills faster. Surgical endoscopy. 23(9), 2131–2137 (2009)

    Google Scholar 

  12. Coles, T.R., John, N.W., Gould, D.A., Caldwell, D.G.: Integrating Haptics with Augmented Reality in a Femoral Palpation and Needle Insertion Training Simulation. IEEE transactions on haptics. 4(3), 199–209 (2011)

    Google Scholar 

  13. Jamali, S.S., Shiratuddin, M.F., Wong, K.W., Oskam, C.L.: Utilising mobile-augmented reality for learning human anatomy. Procedia-Social and Behavioral Sciences.197, 659–668 (2015)

    Google Scholar 

  14. Keri, Z., Sydor, D., Ungi, T., Holden, M.S., McGraw, R., Mousavi, P., et al.: Computerized training system for ultrasound-guided lumbar puncture on abnormal spine models: a randomized controlled trial. Canadian Journal of Anesthesia. 62(7), 777–784 (2015)

    Google Scholar 

  15. Leitritz, M.A., Ziemssen, F., Suesskind, D., Partsch, M., Voykov, B., Bartz-Schmidt, K.U., et al.: Critical evaluation of the usability of augmented reality ophthalmoscopy for the training of inexperienced examiners. Retina (Philadelphia, Pa). 34(4), 785–91 (2014)

    Google Scholar 

  16. Ma, M., Fallavollita, P., Seelbach, I., Von Der Heide, A.M., Euler, E., Waschke, J., et al.: Personalized augmented reality for anatomy education. Clinical anatomy (New York, NY). 29(4), 446–453 (2016)

    Google Scholar 

  17. McKenzie, F.D., Hubbard, T.W., Ullian JA, Garcia HM, Castelino RJ, Gliva GA.: Medical student evaluation using augmented standardized patients: preliminary results. Studies in health technology and informatics. 119, 379–384 (2006)

    Google Scholar 

  18. Samosky, J.T., Baillargeon, E., Bregman, R., Brown, A., Chaya, A., Enders, L., et al.: Real-time “x-ray vision” for healthcare simulation: an interactive projective overlay system to enhance intubation training and other procedural training. Studies in health technology and informatics.163, 549–551 (2011)

    Google Scholar 

  19. Samosky, J.T., Wang, B., Nelson, D.A., Bregman, R., Hosmer, A., Weaver, R.A.: BodyWindows: enhancing a mannequin with projective augmented reality for exploring anatomy, physiology and medical procedures. Studies in health technology and informatics. 173, 433–439 (2012)

    Google Scholar 

  20. Vaughn, J., Lister, M., Shaw, R.J.: Piloting Augmented Reality Technology to Enhance Realism in Clinical Simulation. Computers, informatics, nursing: CIN. 34(9), 402–405 (2016)

    Google Scholar 

  21. Al Hamidy Hazidar, R.S.: Visualization Cardiac Human Anatomy using Augmented Reality Mobile Application (2014)

    Google Scholar 

  22. Albrecht, U.V., Folta-Schoofs, K., Behrends, M., von Jan, U.: Effects of mobile augmented reality learning compared to textbook learning on medical students: randomized controlled pilot study. Journal of Medical Internet Research.15(8), e182 (2013)

    Google Scholar 

  23. Ferrer-Torregrosa, J., Jimenez-Rodriguez, M.A., Torralba-Estelles, J., Garzon-Farinos, F., Perez-Bermejo, M., Fernandez-Ehrling, N.: Distance learning ects and flipped classroom in the anatomy learning: comparative study of the use of augmented reality, video and notes. BMC medical education.16(1), 230 (2016)

    Google Scholar 

  24. Juanes, J.A., Hernández, D., Ruisoto, P., García, E., Villarrubia, G., Prats, A.: Augmented reality techniques, using mobile devices, for learning human anatomy. Proceedings of the Second International Conference on Technological Ecosystems for Enhancing Multiculturality; ACM (2014)

    Google Scholar 

  25. Küçük, S., Kapakin, S., Göktaş, Y.: Learning anatomy via mobile augmented reality: effects on achievement and cognitive load. Anatomical sciences education (2016)

    Google Scholar 

  26. Rahn, A., Kjaergaard, H.:Augmented Reality As A Visualizing Facilitator In Nursing Education. INTED2014 Proceedings. 6560–6568 (2014)

    Google Scholar 

  27. Rodriguez-Pardo, C., Hernandez, S., Patricio, M.Á., Berlanga, A., Molina, J.M.: An Augmented Reality Application for Learning Anatomy. International Work-Conference on the Interplay Between Natural and Artificial Computation; Springer (2015)

    Google Scholar 

  28. Saenz, M., Strunk, J., Maset, K., Seo, J.H., Malone, E.: FlexAR: anatomy education through kinetic tangible augmented reality. ACM SIGGRAPH 2015 Posters; ACM (2015)

    Google Scholar 

  29. Tanaka, M., Uchida, A., Kanda, A., Matsuo, T.: Effects of Digital Textbook-Based Nursing Education in Professional School. Computer Application Technologies (CCATS), 2015 International Conference on; IEEE Press (2015)

    Google Scholar 

  30. Wang, L.L., Wu, H.H., Bilici, N., Tenney-Soeiro, R.: Gunner Goggles: Implementing Augmented Reality into Medical Education. Studies in health technology and informatics. 220, 446–9 (2016)

    Google Scholar 

  31. Berry, C., Board, J.:A Protein in the palm of your hand through augmented reality. Biochemistry and molecular biology education: a bimonthly publication of the International Union of Biochemistry and Molecular Biology. 42(5), 446–9 (2014)

    Google Scholar 

  32. Thomas, R.G., John, N.W., Delieu, J.M.: Augmented reality for anatomical education. Journal of visual communication in medicine. 33(1), 6–15 (2010)

    Google Scholar 

  33. Rahn, A., Buhl, M.: Augmented Reality as Wearable Technology in Visualizing Human Anatomy. Is the adaptive researcher the road to success in design-based research? 30 Students as Math Level Designers: How students position themselves through design of a math. 90 (2016)

    Google Scholar 

  34. Microsoft: HoloAnatomy, https://www.microsoft.com/en-us/store/p/holoanatomy/9nblggh4ntd3#

  35. Santoso, M.: HeARt: Augmented and Virtual Reality (AR / VR) for Medical School Learning Tool Enhancement (2016) https://www.youtube.com/watch?v=dWf7oEwZKbs&ab_channel=MarkusSantoso

  36. Forsythe, R., Lewis, P., Brailsford, M., Clark, D., Bishop, P.: Introducing Patient ScenARios – SimMan gets personality! (2014) http://campus-interactive-media.com/work/test-work/

  37. Kamarainen, A.M., Metcalf, S., Grotzer, T., Browne, A., Mazzuca, D., Tutwiler MS, Dede C.: EcoMOBILE: Integrating augmented reality and probeware with environmental education field trips. Comput. Educ. 68, 545–556. 10.1016/j.compedu.2013.02.018 (2013)

  38. Andujar, J.M., Mejias, A., Marquez, M.A.:Augmented reality for the improvement of remote laboratories: an augmented remote laboratory. IEEE Trans. Educ. 54(3), 492–500. 10.1109/TE.2010.2085047 (2011)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Arkendu Sen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sen, A., Chuen, C.L., Zay Hta, A.C. (2018). Toward Smart Learning Environments: Affordances and Design Architecture of Augmented Reality (AR) Applications in Medical Education. In: Somani, A., Srivastava, S., Mundra, A., Rawat, S. (eds) Proceedings of First International Conference on Smart System, Innovations and Computing. Smart Innovation, Systems and Technologies, vol 79. Springer, Singapore. https://doi.org/10.1007/978-981-10-5828-8_80

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-5828-8_80

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-5827-1

  • Online ISBN: 978-981-10-5828-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics