A 3D Virtual Learning System for STEM Education

  • Tao Ma
  • Xinhua Xiao
  • William Wee
  • Chia Yung Han
  • Xuefu Zhou
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8526)


A recent boom has been seen in 3D virtual worlds for entertainment, and this in turn has led to a surge of interest in their educational applications. Although booming development has been seen, most of them only strengthen the traditional teaching methods using a new platform without changing the nature of how to teach and learn. Modern computer science technology should be applied in STEM education for the purpose of rising learning efficiency and interests. In this paper, we focus on the reasoning, design, and implementation of a 3D virtual learning system that merges STEM experiments into virtual laboratory and brings entertainment to knowledge learning. An advanced hand gesture interface was introduced to enable flexible manipulation on virtual objects with two hands. The recognition ability of single hand grasping-moving-rotating activity (SH-GMR) allows single hand to move and rotate a virtual object at the same time. We implemented several virtual experiments in the VR environment to demonstrate to the public that the proposed system is a powerful tool for STEM education. The benefits of this system are evaluated followed by two virtual experiments in STEM field.


3D virtual learning Human machine interface (HCI) hand gesture interaction single hand grasping-moving-rotating (SH-GMR) STEM education 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Mohan, B.: Language and content, reading, p. 146. Addison-Wesley, MA (1986)Google Scholar
  2. 2.
    Gibbs, G., Simpson, C.: Conditions under which assessment supports students’ learning. Learning and Teaching in Higher Education 1(1), 3–31 (2004)Google Scholar
  3. 3.
    Mansureh, K., Atsusi, H.: Examining the Pedagogical Foundations of Modern Educational Computer Games. Computers & Education 51(4), 1729–1743 (2008)CrossRefGoogle Scholar
  4. 4.
    Pantelidis, V.S.: Virtual Reality in the Classroom. Educational Technology 3(4), 23–27 (1993)Google Scholar
  5. 5.
    Psotka, J.: Immersive Training Systems: Virtual Reality and Education and Training. Instructional Science 23(5-6), 405–431 (1995)CrossRefGoogle Scholar
  6. 6.
    Gibbs, G., Simpson, C.: Conditions Under Which Assessment Supports Students’ Learning. Learning and Teaching in Higher Education 1(1), 3–31 (2004)Google Scholar
  7. 7.
    Peter, W.: Airasian, Classroom Assessment. McGraw-Hill, Inc., (1991)Google Scholar
  8. 8.
    Hinckley, K., Pausch, R., Proffitt, D., Kassell, N.F.: Two-Handed Virtual Manipulation. In: ACM Trans. Computer-Human Interaction, pp. 260–302 (1998)Google Scholar
  9. 9.
    Ma, T., Wee, W., Han, C., Zhou, X.: A Method for Single Hand Fist Gesture Input to Enhance Human Computer Interaction. In: Intl. Conf. on HCI, vol. 5, pp. 291–300 (2013)Google Scholar
  10. 10.
    Ma, T., Wee, W., Han, C., Zhou, X.: A Study of Hand Fist Kinematics and Its Detection Method That Enhances Human-Machine Interaction. In: In Proceeding of International Conference on Multimedia and Human Computer Interaction (MHCI), Toronto, Canada (July 2013)Google Scholar
  11. 11.
    Heikkila, J., Silven, O.: A four-step camera calibration procedure with implicit image correction. In: Proceedings of the Conference on Computer Vision and Pattern Recognition, pp. 1106–1112 (1997)Google Scholar
  12. 12.
    Fusiello, A., Trucco, E., Verri, A., Verri, R.: A Compact Algorithm for Rectification of Stereo Pairs. Journal Machine Vision and Applications 12(1), 16–22 (2000)CrossRefGoogle Scholar
  13. 13.
    Charles, P.: Digital Video and HDTV, ch. 24, pp. 291–292. Morgan Kaufmann (2003)Google Scholar
  14. 14.
    Phung, S.L., Bouzerdoum, A., Chai, D.: Skin segmentation using color pixel classification: analysis and comparison. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(1), 148–154 (2005)CrossRefGoogle Scholar
  15. 15.
    Bradski, G., Kaehler, A.: Learning OpenCV. O’Reilly Media (2008)Google Scholar
  16. 16.
    Kim, T.K., Wong, S.F., Cipolla, R.: Tensor Canonical Correlation Analysis for Action Classification. In: IEEE Conference of Computer Vision and Pattern Recognition, pp. 1–8 (2007)Google Scholar
  17. 17.
    Haralick, R., Shapiro, L.: Computer and Robot Vision, vol. 1, pp. 346–351. Addison-Wesley Publishing Company (1992)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Tao Ma
    • 1
  • Xinhua Xiao
    • 1
  • William Wee
    • 1
  • Chia Yung Han
    • 1
  • Xuefu Zhou
    • 1
  1. 1.Department of Electrical Engineering and Computing SystemsUniversity of CincinnatiUSA

Personalised recommendations