Skip to main content
SpringerLink
Log in

Developing Spatial Visualization Skills with Virtual Reality and Hand Tracking

  • Conference paper
  • First Online:
HCI International 2021 - Late Breaking Posters (HCII 2021)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1498))

Included in the following conference series:

Abstract

Spatial visualization skills are the cognitive skills required to mentally comprehend and manipulate 2D and 3D shapes. Spatial visualization skills are recognized as a crucial part of STEM education. Moreover, these skills have been linked to both students’ capacity for self-monitored learning and GPA in STEM programs. Also, many STEM fields have reported a correlation between spatial visualization skills and the level of academic success of students. Unfortunately, many students have significantly underdeveloped spatial visualization skills. Students traditionally learn spatial visualization skills via the manipulation of 3D objects and drawings. Because Virtual Reality (VR) facilitates the manipulation of 3D virtual objects, it is an effective medium to teach spatial visualization skills. In addition, it has been found that students are more motivated to learn and perform better when taught in an immersive VR environment. Several studies have presented promising results on leveraging VR to teach spatial visualization skills. However, in most of these studies, the users are not able to naturally interact with the 3D virtual objects. Additionally, many of the current VR applications fail to implement spatial presence for the user, which would lead to more effective instruction. The level of immersivity a VR application offers can have a direct impact on the users’ “first-person” experience and engagement. In light of this, a VR application integrated with hand tracking technology designed to develop spatial visualization skills of STEM students is presented. The inclusion of a user’s hand in the virtual environment could increase the users’ sense of spatial presence and first-person experience. In addition, this could act as an intuitive input method for beginners. The objective of this work is to introduce this VR application as well as future work on how to leverage Reinforcement Learning to automatically generate new 3D virtual objects [github.com/lopezbec/VR_SpatialVisualizationApp].

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

1. References

  1. Sorby, S.A., Duffy, G., Loney, N., Perez, L.: Spatial skills and their correlation with engineering problem-solving. In: 29th Australasian Association for Engineering Education Conference 2018 (AAEE 2018), p. 10. Engineers Australia

    Google Scholar 

  2. Sorby, S., Veurink, N., Streiner, S.: Does spatial skills instruction improve STEM outcomes? The answer is ‘yes.’ Learn. Individ. Differ. 67, 209–222 (2018). https://doi.org/10.1016/j.lindif.2018.09.001

    Article  Google Scholar 

  3. Roca-González, C., Martin-Gutierrez, J., García-Dominguez, M., Mato Carrodeguas, M.D.C.: Virtual technologies to develop visual-spatial ability in engineering students. Eurasia Journal of Mathematics, Science and Technology Education, 13(2), 441–468 (2017). https://doi.org/10.12973/eurasia.2017.00625a.

  4. Parkinson, J., Cutts, Q.: Investigating the relationship between spatial skills and computer science. In: ICER 2018 of the Proceedings of the 2018 ACM Conference on International Computing Education Research, pp. 106–114, (2018). https://doi.org/10.1145/3230977.3230990.

  5. Verdine, B.N., Golinkoff, R.M., Hirsh‐Pasek, K., Newcombe, N.S.: I. spatial skills, their development, and their links to mathematics. Monographs Soc. Res. Child Develop.82(1), 7-30 (2017). https://doi.org/10.1111/mono

  6. Makransky, G., Lilleholt, L.: A structural equation modeling investigation of the emotional value of immersive virtual reality in education. Education Tech. Res. Dev. 66(5), 1141–1164 (2018). https://doi.org/10.1007/s11423-018-9581-2

    Article  Google Scholar 

  7. Makransky, G., Borre-Gude, S., Mayer, R.E.: Motivational and cognitive benefits of training in immersive virtual reality based on multiple assessments. J. Comput. Assist. Learn. 35(6), 691–707 (2019). https://doi.org/10.1111/jcal.12375

    Article  Google Scholar 

  8. Guzsvinecz, T., Orbán-Mihálykó, É., Perge, E., Sik-Lányi, C.: Analyzing the Spatial Skills of University Students with a Virtual Reality Application using a Desktop Display and the Gear VR. Acta Polytech. Hungarica 17(2), 35–56 (2020)

    Article  Google Scholar 

  9. Seibert, J., Shafer, D.M.: Control mapping in virtual reality: effects on spatial presence and controller naturalness. Virtual Reality 22(1), 79–88 (2017). https://doi.org/10.1007/s10055-017-0316-1

    Article  Google Scholar 

  10. Coxon, M., Kelly, N., Page, S.: Individual differences in virtual reality: are spatial presence and spatial ability linked? Virtual Reality 20(4), 203–212 (2016). https://doi.org/10.1007/s10055-016-0292-x

    Article  Google Scholar 

  11. Huang, W., Roscoe, R., Johnson, M., Craig, S.: Investigating the Novelty Effect in Virtual Reality on STEM Learning (2020).

    Google Scholar 

  12. Gold, Z.S., Elicker, J., Kellerman, A.M., Christ, S., Mishra, A.A., Howe, N.: Engineering play, mathematics, and spatial skills in children with and without disabilities. Early Educ. Dev. 32(1), 49–65 (2021). https://doi.org/10.1080/10409289.2019.1709382

    Article  Google Scholar 

  13. Lee, M.J.W.: Institute of Electrical and Electronics Engineers. New South Wales Section, IEEE Education Society, University of Wollongong, Charles Sturt University, and Institute of Electrical and Electronics Engineers. In: Proceedings of 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE) : date and venue, 4–7 December, Novotel Wollongong Northbeach Hotel, Wollongong, NSW, Australia.

    Google Scholar 

  14. Atit, K., Miller, D.I., Newcombe, N.S., Uttal, D.H.: Teachers’ spatial skills across disciplines and education levels: exploring nationally representative data. Arch. Sci. Psychol. 6(1), 130–137 (2018). https://doi.org/10.1037/arc0000041

    Article  Google Scholar 

  15. Radianti, J., Majchrzak, T.A., Fromm, J., Wohlgenannt, I.: A systematic review of immersive virtual reality applications for higher education: design elements, lessons learned, and research agenda. Comput. Educ. 147, 103778 (2020). https://doi.org/10.1016/j.compedu.2019.103778

    Article  Google Scholar 

  16. Vergara, D., Rubio, M.P., Lorenzo, M.: On the design of virtual reality learning environments in engineering. Multimodal Tech. Inter. 1(2), 11 (2017). https://doi.org/10.3390/mti1020011

    Article  Google Scholar 

  17. Román-Ibáñez, V., Pujol-López, F.A., Mora-Mora, H., Pertegal-Felices, M.L., Jimeno-Morenilla, A.: A low-cost immersive virtual reality system for teaching robotic manipulators programming. Sustainability 10(4), 1102 (2018). https://doi.org/10.3390/su10041102

    Article  Google Scholar 

  18. Molina-Carmona, R., Pertegal-Felices, M.L., Jimeno-Morenilla, A., Mora-Mora, H.: Virtual reality learning activities for multimedia students to enhance spatial ability. Sustainability 10(4), 1074 (2018). https://doi.org/10.3390/su10041074

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer and Electrical Engineering, Lafayette College, Easton, PA, 18042, USA

    Liam Stewart

  2. Department of Computer Science, Lafayette College, Easton, PA, 18042, USA

    Christian Lopez

Authors
  1. Liam Stewart
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christian Lopez
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Christian Lopez .

Editor information

Editors and Affiliations

  1. University of Crete and Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Constantine Stephanidis

  2. Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Margherita Antona

  3. Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Stavroula Ntoa

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Stewart, L., Lopez, C. (2021). Developing Spatial Visualization Skills with Virtual Reality and Hand Tracking. In: Stephanidis, C., Antona, M., Ntoa, S. (eds) HCI International 2021 - Late Breaking Posters. HCII 2021. Communications in Computer and Information Science, vol 1498. Springer, Cham. https://doi.org/10.1007/978-3-030-90176-9_51

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-90176-9_51

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-90175-2

  • Online ISBN: 978-3-030-90176-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation