Abstract
In this paper we present a robust motion recognition framework for both motion capture and RGB-D sensor data. We extract four different types of features and apply a temporal difference operation to form the final feature vector for each frame in the motion sequences. The frames are classified with the extreme learning machine, and the final class of an action is obtained by majority voting. We test our framework with both motion capture and Kinect data and compare the results of different features. The experiments show that our approach can accurately classify actions with both sources of data. For 40 actions of motion capture data, we achieve 92.7% classification accuracy with real-time performance.
Chapter PDF
References
Adistambha, K., Ritz, C., Burnett, I.: Motion classification using dynamic time warping. In: IEEE 10th Workshop on Multimedia Signal Processing (2008)
CHALEARN: Gesture challenge, http://www.kaggle.com/c/GestureChallenge
CMU: Carnegie-mellon mocap database (2003), http://mocap.cs.cmu.edu
Ferrari, V., Marin-Jimenez, M., Zisserman, A.: Progressive search space reduction for human pose estimation. In: Proc. CVPR (June 2008)
Huang, G., Zhou, H., Ding, X., Zhang, R.: Extreme learning machine for regression and multiclass classification. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 42(2), 513–529 (2012)
Kawashima, M., Shimada, A., Taniguchi, R.-I.: Early recognition of gesture patterns using sparse code of self-organizing map. In: Príncipe, J.C., Miikkulainen, R. (eds.) WSOM 2009. LNCS, vol. 5629, pp. 116–123. Springer, Heidelberg (2009)
Menache, A.: Understanding motion capture for computer animation and video games. Morgan Kaufmann Pub. (2000)
Müller, M., Roder, T.: Motion templates for automatic classification and retrieval of motion capture data. In: Proceedings of the Eurographics/ACM SIGGRAPH Symposium on Computer Animation, Vienna, Austria, vol. 2, pp. 137–146 (2006)
Müller, M., Röder, T., Clausen, M., Eberhardt, B., Krüger, B., Weber, A.: Documentation mocap database HDM05. Tech. Rep. CG-2007-2, U. Bonn (June 2007)
Raptis, M., Wnuk, K., Soatto, S., et al.: Flexible dictionaries for action classification. In: Proc. MLVMA 2008 (2008)
Raptis, M., Kirovski, D., Hoppe, H.: Real-time classification of dance gestures from skeleton animation. In: Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 147–156. ACM (2011)
Shimada, A., Taniguchi, R.: Gesture recognition using sparse code of hierarchical som. In: Proc. ICPR (2008)
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., Blake, A.: Real-time human pose recognition in parts from single depth images. In: Proc. Computer Vision and Pattern Recognition (June 2011)
Vieira, A., Lewiner, T., Schwartz, W., Campos, M.: Distance matrices as invariant features for classifying MoCap data. In: 21st International Conference on Pattern Recognition (ICPR), Tsukuba, Japan (2012)
Wang, J., Lee, H.: Recognition of human actions using motion capture data and support vector machine. In: Proc. WCSE, vol. 1, pp. 234–238. IEEE (2009)
Xia, L., Chen, C.C., Aggarwal, J.K.: Human detection using depth information by Kinect. In: Workshop on Human Activity Understanding from 3D Data in conjunction with CVPR (HAU3D), Colorado Springs, USA (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chen, X., Koskela, M. (2013). Classification of RGB-D and Motion Capture Sequences Using Extreme Learning Machine. In: Kämäräinen, JK., Koskela, M. (eds) Image Analysis. SCIA 2013. Lecture Notes in Computer Science, vol 7944. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38886-6_60
Download citation
DOI: https://doi.org/10.1007/978-3-642-38886-6_60
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-38885-9
Online ISBN: 978-3-642-38886-6
eBook Packages: Computer ScienceComputer Science (R0)