Skip to main content

Interactive Mixed Reality for Muscle Structure and Function Learning

  • Conference paper
  • First Online:
Medical Imaging and Augmented Reality (MIAR 2016)

Abstract

Understanding the structure and function of the muscular system is important in many different medical scenarios, such as student and patient education, muscle training, and rehabilitation of patients with kinetic problems. The structure and function of muscles are difficult to learn as muscle movement is imperceptible using the traditional methods. In this paper, an interactive mixed reality system is proposed for facilitating the learning of the muscles of the upper extremities. The proposed system consists of two main components: an AR view, overlaying the virtual model of the arm on top of the video stream, and a VR view, providing a more detailed understanding of the muscles. The mixed reality view helps the user to mentally map the behaviour of muscles to his/her own body during different movements. A user study including twenty students was performed by a questionnaire framework. The results indicate that our system is useful for learning the structure and function of the muscle and can be a valuable supplement to established muscle learning paradigms.

M. Ma, P. Jutzi, and F. Bork—These three authors have contributed equally to this work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    www.zygotebody.com.

  2. 2.

    http://www.anatomium.com/.

  3. 3.

    http://www.autodesk.com/products/3ds-max/overview.

References

  1. Azer, S.A.: Can “YouTube” help students in learning surface anatomy? Surg. Radiol. Anat. 34(5), 465–468 (2012)

    Article  Google Scholar 

  2. Bacca, J., Baldiris, S., Fabregat, R., Graf, S.: Augmented reality trends in education: a systematic review of research and applications. Educ. Technol. Soc. 17(4), 133–149 (2014)

    Google Scholar 

  3. Basdogan, C., Sedef, M., Harders, M., Wesarg, S.: VR-based simulators for training in minimally invasive surgery. IEEE Comput. Graph. Appl. 27(2), 54–66 (2007)

    Article  Google Scholar 

  4. Blum, T., Kleeberger, V., Bichlmeier, C., Navab, N.: Mirracle: an augmented reality magic mirror system for anatomy education. In: Proceedings of the IEEE Virtual Reality, pp. 115–116, March 2012

    Google Scholar 

  5. Chang, K.E., Chang, C.T., Hou, H.T., Sung, Y.T., Chao, H.L., Lee, C.M.: Development and behavioral pattern analysis of a mobile guide system with augmented reality for painting appreciation instruction in an art museum. Comput. Educ. 71, 185–197 (2014, 2015)

    Google Scholar 

  6. Chien, C.H., Chen, C.H., Jeng, T.S.: An interactive augmented reality system for learning anatomy structure. In: Proceedings of the International Multi Conference Engineers and Computer Scientists I (2010)

    Google Scholar 

  7. Davis, L., Hamza-Lup, F.G., Daly, J., Ha, Y., Frolich, S., Meyer, C., Martin, G., Norfleet, J., Lin, K.C., Imielinska, C., Rolland, J.P.: Application of augmented reality to visualizing anatomical airways. Proc. SPIE 4711, 400–405 (2002)

    Article  Google Scholar 

  8. Di Serio, Á., Ibáñez, M.B., Kloos, C.D.: Impact of an augmented reality system on students’ motivation for a visual art course. Comput. Educ. 68, 585–596 (2013)

    Article  Google Scholar 

  9. General Medical Council: Tomorrow’s Doctors - Outcomes and standards for undergraduate medical education. No. 1, UK: General Medical Council, Manchester (2009)

    Google Scholar 

  10. Johnson, L., Adams Becker, S., Estrada, V., Freeman, A.: The NMC Horizon Report: 2015 Higher Education Edition. The New Media Consortium, Austin (2015)

    Google Scholar 

  11. Juan, C., Beatrice, F., Cano, J.: An augmented reality system for learning the interior of the human body. In: Proceedings of the 8th IEEE International Conference on Advanced Learning Technologies ICALT 2008, pp. 186–188 (2008)

    Google Scholar 

  12. Lu, J., Pan, Z., Lin, H., Zhang, M., Shi, J.: Virtual learning environment for medical education based on VRML and VTK. Comput. Graph. 29(2), 283–288 (2005)

    Article  Google Scholar 

  13. Ma, M., Fallavollita, P., Seelbach, I., Heide, A.M.V.D., Euler, E., Waschke, J., et al.: Personalized augmented reality for anatomy education. Clin. Anat. 29(4), 446–453 (2015)

    Article  Google Scholar 

  14. McHanwell, S.: Atlas of anatomy. J. Anat. 217(1), 83–83 (2010)

    Article  Google Scholar 

  15. McMenamin, P.G.: Body painting as a tool in clinical anatomy teaching. Anat. Sci. Educ. 1(4), 139–144 (2008)

    Article  Google Scholar 

  16. Meng, M., Fallavollita, P., Blum, T., Eck, U., Sandor, C., Weidert, S., Waschke, J., Navab, N.: Kinect for interactive AR anatomy learning. In: 2013 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2013, Adelaide, Australia, pp. 277–278, October 2013

    Google Scholar 

  17. Navab, N., Blum, T., Wang, L., Okur, A., Wendler, T.: First deployments of augmented reality in operating rooms. Comput. (Long. Beach. Calif) 45(7), 48–55 (2012)

    Google Scholar 

  18. Ni, T., Karlson, A.K., Wigdor, D.: AnatOnMe. In: Proceedings of 2011 Annual Conference on Human Factors in Computing Systems, CHI 2011, p. 3333 (2011)

    Google Scholar 

  19. Thomas, R.G., John, N.W., Delieu, J.M.: Augmented reality for anatomical education. J. Vis. Commun. Med. 33(1), 6–15 (2010)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Meng Ma .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Ma, M. et al. (2016). Interactive Mixed Reality for Muscle Structure and Function Learning. In: Zheng, G., Liao, H., Jannin, P., Cattin, P., Lee, SL. (eds) Medical Imaging and Augmented Reality. MIAR 2016. Lecture Notes in Computer Science(), vol 9805. Springer, Cham. https://doi.org/10.1007/978-3-319-43775-0_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-43775-0_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-43774-3

  • Online ISBN: 978-3-319-43775-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics