The Usability of Hand Pose and Gestures for Spaceflight Training System

  • Wanhong LinEmail author
  • Jiangang Chao
  • Jin Yang
  • Ying Xiong
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9741)


Virtual hand pose and gestures for manipulation is one of the hardest interactive problem in Spaceflight Training System. This paper researched the usability of hand pose and gestures, proposed a couple of non-contact action determining rules and an action states transition method based on finite state machine (FSM) to control the manipulation process of virtual hand. Meanwhile, a gesture recognition method based on hand pose data was proposed. The experiment result shows that the proposed method has a high success rate and efficiency for manipulation. It can be used for the way of manipulation in Spaceflight Training System.


Usability Hand pose and gestures Spaceflight training system 



This work was supported by China Astronaut Research and Training Center within the following research programs: Advanced Space Medico-Engineering Research Project of China (2013SY54A1303, 9140c770204150c77318, 2013SY54B1301, FTKY201302).


  1. 1.
    Sen, F., Diaz, L., Horttana, T.: A novel gesture-based interface for a VR simulation: Re-discovering Vrouw Maria. In: 2012 18th International Conference on Virtual Systems and Multimedia (VSMM), pp. 323–330 (2012)Google Scholar
  2. 2.
    Sato, Y., Saito, M., Koike, H.: Real-time input of 3D pose and gestures of a user’s hand and its applications for HCI. In: Virtual Reality, 2001. Proceedings, pp. 79–86. IEEE (2003)Google Scholar
  3. 3.
    Lee, C.-S., Oh, K.-M., Park, C.-J.: Virtual environment interaction based on gesture recognition and hand cursor. Electron. Resour. (2008)Google Scholar
  4. 4.
    Nasser, N.H., Alhaj, M.: Hand gesture interaction with a 3D virtual environment. Res. Bull. Jordan ACM II(III), 186–193 (2011)Google Scholar
  5. 5.
    Ming, A., Yuqing, L., Bohe, Z., Fuchao, H.: Study on real-time interactive simulation of rotating top in weightlessness. Manned Spaceflight (2014)Google Scholar
  6. 6.
    Chen, Y., Lin, F.: Safety control of discrete event systems using finite state machines with parameters. In: Proceedings of the American Control Conference. Arlington: American Auotmatic Control Council, pp. 975–980 (2001)Google Scholar
  7. 7.
    Feng, Z., Yan, B., Xu, T., et al.: 3D direct human-computer interface paradigm based on free hand tracking. Chin. J. Comput. 37(6), 1309–1323 (2014)Google Scholar
  8. 8.
    Hu, H., Chao, J.G., Liu, J.G.: Grab simulation based on FSM for astronaut virtual training. In: 3rd International Conference on Mechatronics, Robotics and Automation (ICMRA 2015), pp. 1060–1064 (2015)Google Scholar
  9. 9.
    Weichert, F., Bachmann, D., Rudak, B., Fisseler, D.: Analysis of the accuracy and robustness of the leap motion controller. Sensors 13(5), 6380–6393 (2013)CrossRefGoogle Scholar
  10. 10.
    Marin, G., Dominio, F., Zanuttigh, P.: Hand gesture recognition with jointly calibrated Leap Motion and depth sensor. Multimedia Tools Appl., 1–25 (2015)Google Scholar
  11. 11.
    Chang, C.-C., Lin, C.-J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2, 27:1–27:27 (2011)CrossRefGoogle Scholar
  12. 12.
    Vaillancourt, D.E., Newell, K.M.: Amplitude changes in the 8-12, 20-25, and 40 Hz oscillations in finger tremor. Clin. Neurophysiol. 111(10), 1792–1801 (2000)CrossRefGoogle Scholar
  13. 13.
    Casiez, G., Roussel, N., Vogel, D.: 1€ filter: a simple speed-based low-pass filter for noisy input in interactive systems. In: Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems, pp. 2527–2530 (2012)Google Scholar
  14. 14.
    Ledda, P., Chalmers, A., Troscianko, T.: Evaluation of tone mapping operators using a high dynamic range display. ACM Trans. Graph. 24(3), 640–648 (2005)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Wanhong Lin
    • 1
    • 2
    Email author
  • Jiangang Chao
    • 1
    • 2
  • Jin Yang
    • 2
  • Ying Xiong
    • 2
  1. 1.National Key Laboratory of Human Factors Engineering, China Astronaut Research and Training CenterBeijingPeople’s Republic of China
  2. 2.China Astronaut Research and Training CenterBeijingPeople’s Republic of China

Personalised recommendations