Abstract
Predicting accurately and in real-time 3D body joint positions from a depth image is the cornerstone for many safety, biomedical, and entertainment applications. Despite the high quality of the depth images, the accuracy of existing human pose estimation methods from single depth images remains insufficient for some applications. In order to enhance the accuracy, we suggest to leverage a rough orientation estimation to dynamically select a 3D joint position prediction model specialized for this orientation. This orientation estimation can be obtained in real-time either from the image itself, or from any other clue like tracking. We demonstrate the merits of this general principle on a pose estimation method similar to the one used with Kinect cameras. Our results show that the accuracy is improved by up to 45.1 %, with respect to a method using the same model for all orientations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Carnegie Mellon University: Motion capture database. http://mocap.cs.cmu.edu
Geurts, P., Ernst, D., Wehenkel, L.: Extremely randomized trees. Mach. Learn. 63(1), 3–42 (2006)
Girshick, R., Shotton, J., Kohli, P., Criminisi, A., Fitzgibbon, A.: Efficient regression of general-activity human poses from depth images. In: International Conference on Computer Vision (ICCV), Barcelona, Spain, pp. 415–422, November 2011
Kerl, C., Souiai, M., Sturm, J., Cremers, D.: Towards illumination-invariant 3D reconstruction using ToF RGB-D cameras. In: International Conference on 3D Vision (3DV), Tokyo, Japan, vol. 1, pp. 39–46, December 2014
Piérard, S., Leroy, D., Hansen, J.-F., Van Droogenbroeck, M.: Estimation of human orientation in images captured with a range camera. In: Blanc-Talon, J., Kleihorst, R., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2011. LNCS, vol. 6915, pp. 519–530. Springer, Heidelberg (2011)
Piérard, S., Pierlot, V., Barnich, O., Van Droogenbroeck, M., Verly, J.: A platform for the fast interpretation of movements and localization of users in 3D applications driven by a range camera. In: 3DTV Conference, Tampere, Finland, June 2010
Piérard, S., Van Droogenbroeck, M.: On the human pose recovery based on a single view. In: International Conference on Pattern Recognition Applications and Methods (ICPRAM), Vilamoura, Portugal, vol. 2, pp. 310–315, February 2012
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., Blake, A.: Real-time human pose recognition in parts from single depth images. In: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Providence, Rhode Island, USA, pp. 1297–1304, June 2011
Shotton, J., Girshick, R., Fitzgibbon, A., Sharp, T., Cook, M., Finocchio, M., Moore, R., Kohli, P., Criminisi, A., Kipman, A., Blake, A.: Efficient human pose estimation from single depth images. IEEE Trans. Pattern Anal. Mach. Intell. 35(12), 2821–2840 (2013)
Wei, X., Zhang, P., Chai, J.: Accurate realtime full-body motion capture using a single depth camera. ACM Trans. Graph 31(6), 188.1–188.12 (2012)
Yeung, K.-Y., Kwok, T.-H., Wang, C.: Improved skeleton tracking by duplex Kinects: a practical approach for real-time applications. J. Comput. Inf. Sci. Eng. 13(4), 041007-1–041007-10 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Azrour, S., Piérard, S., Van Droogenbroeck, M. (2016). Leveraging Orientation Knowledge to Enhance Human Pose Estimation Methods. In: Perales, F., Kittler, J. (eds) Articulated Motion and Deformable Objects. AMDO 2016. Lecture Notes in Computer Science(), vol 9756. Springer, Cham. https://doi.org/10.1007/978-3-319-41778-3_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-41778-3_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-41777-6
Online ISBN: 978-3-319-41778-3
eBook Packages: Computer ScienceComputer Science (R0)