Abstract
This paper presents a vision-based approach for hand gesture recognition which combines both trajectory recognition and hand posture recognition. With two calibrated cameras, the 3D hand motion trajectory can be reconstructed. The reconstructed trajectory is then modeled by dynamic movement primitives (DMP) and a support vector machine (SVM) is trained to recognize five classes of gestures trajectories. Scale-invariant feature transform (SIFT) is used to extract features on segmented hand postures taken from both camera views. Based on various hand appearances captured by the two cameras, the proposed hand posture recognition method has shown a very good success rate. A gesture vector is proposed to combine the recognition result from both trajectory and hand postures. For our experimental set-up, it was shown that it is possible to accomplish a good overall accuracy for gesture recognition.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Stokoe, W.C.: Sign language structure (1978)
Elmezain, M., Al-Hamadi, A., Appenrodt, J., Michaelis, B.: A hidden markov model-based continuous gesture recognition system for hand motion trajectory. In: 19th International Conference on Pattern Recognition, 2008. ICPR 2008, pp. 1–4. IEEE (2008)
Bashir, F., Qu, W., Khokhar, A., Schonfeld, D.: Hmm-based motion recognition system using segmented pca. In: IEEE International Conference on Image Processing, 2005. ICIP 2005. vol. 3, pp. III-1288. IEEE (2005)
Bashir, F.I., Khokhar, A.A., Schonfeld, D.: Object trajectory-based activity classification and recognition using hidden markov models. IEEE Trans. Image Process. 16(7), 1912–1919 (2007)
Mitra, S., Acharya, T.: Gesture recognition: A survey. IEEE Trans. Syst., Man, Cybern., Part C: Appl. Rev. 37(3), 311–324 (2007)
Hong, P., Turk, M., Huang, T.S.: Gesture modeling and recognition using finite state machines. In: 2000 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 410–415. IEEE (2000)
Schaal, S.: Dynamic movement primitives -a framework for motor control in humans and humanoid robotics. In: Kimura, H., Tsuchiya, K., Ishiguro, A., Witte, H. (eds.) Adaptive Motion of Animals and Machines, pp. 261–280. Springer, Heidelberg (2006)
Li, Y.: Hand gesture recognition using kinect. In: 2012 IEEE 3rd International Conference on Software Engineering and Service Science (ICSESS), pp. 196–199. IEEE (2012)
Letessier, J., Bérard, F.: Visual tracking of bare fingers for interactive surfaces. In: Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology, pp. 119–122. ACM (2004)
Fang, Y., Wang, K., Cheng, J., Lu, H.: A real-time hand gesture recognition method. In: 2007 IEEE International Conference on Multimedia and Expo, pp. 995–998. IEEE (2007)
Phung, S.L., Bouzerdoum, A., Chai Sr, D.: Skin segmentation using color pixel classification: analysis and comparison. IEEE Trans.Pattern Anal. Mach. Intell. 27(1), 148–154 (2005)
Chai, D., Ngan, K.N.: Face segmentation using skin-color map in videophone applications. IEEE Trans. Circ. Syst. Video Technol. 9(4), 551–564 (1999)
Welch, G., Bishop, G.: An introduction to the kalman filter (1995)
Bradski, G., Kaehler, A.: Learning OpenCV: Computer vision with the OpenCV library. O’Reilly Media, Inc. (2008)
Ijspeert, A.J., Nakanishi, J., Hoffmann, H., Pastor, P., Schaal, S.: Dynamical movement primitives: learning attractor models for motor behaviors. Neural Comput. 25(2), 328–373 (2013)
Liu, Z., Hu, F., Luo, D., Wu, X.: Visual gesture recognition for human robot interaction using dynamic movement primitives. In: 2014 IEEE International Conference on Systems, Man and Cybernetics (SMC), pp. 2094–2100. IEEE (2014)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
Csurka, G., Dance, C., Fan, L., Willamowski, J., Bray, C.: Visual categorization with bags of keypoints. In: Workshop on Statistical Learning in Computer Vision, ECCV. vol. 1, pp. 1–2. Prague (2004)
Bishop, C.M., et al.: Pattern recognition and machine learning. Springer, New York (2006)
Chang, C.C., Lin, C.J.: LIBSVM: A library for support vector machines. ACM Trans. Intell. Syst. Technol. 2, 27:1–27:27 (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Wang, J., Payandeh, S. (2015). A Study of Hand Motion/Posture Recognition in Two-Camera Views. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2015. Lecture Notes in Computer Science(), vol 9475. Springer, Cham. https://doi.org/10.1007/978-3-319-27863-6_29
Download citation
DOI: https://doi.org/10.1007/978-3-319-27863-6_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-27862-9
Online ISBN: 978-3-319-27863-6
eBook Packages: Computer ScienceComputer Science (R0)