Abstract
Taken it into consideration that human has a great deal of experiences and knowledge of hand postures, if these operating skills of postures are applied to HCI, the simple and convenient human-computer interface can be expected. In fact, tracking, recognition and interaction based on 3D freehand are a part of the cores in our virtual assembly system, but it is a challenging task to track 3D freehand in real-time because of high dimensionality of 3D full hand model. A novel framework for 3D freehand tracking is put forward in this paper. Firstly, we model and investigate this problem under our virtual assembly system (VAS), so as to decrease the arbitrariness and complexity of this issue. Secondly, we put emphasis on building cognitive and behavioral model (CBM) for users in VAS. Thirdly, we research on the way to track 3D freehand based on CBM. The main contributions of this paper are that we propose a new CBM, TPTM model, provide a way to connect users and computer for effective interaction, and present a real-time freehand tracking algorithm. Based on TPTM model, the prediction, the number of particles, the way and scope of sampling, are optimized. TPTM model not only explain behavioral characteristics for users but also can effectively guide the design of freehand tracking algorithm. TPTM model also provides a data structure that can facilitate the implementation of the tracking algorithm. Our experimental results show that the proposed approach raises the quality of each sampled particle or avoid sampling “poor” particles which appear with low probability in each frame, and it tracks 3D freehand in real-time with high accuracy. The number of the drawn particles is reduced up to 5 and the tracking speed increase up to 81 ms per frame.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Agarwal, A., Triggs, B.: Tracking Articulated Motion Using a Mixture of Autoregressive Models. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004, Part III. LNCS, vol. 3023, pp. 54–65. Springer, Heidelberg (2004)
Anderson, J.R., Corbett, A.T., Koedinger, K.R., Pelletier, R.: Cognitive tutors: Lessons learned. J. Learn. Sci. 4, 167–207 (1995)
Erol, A., Bebis, G., Nicolescu, M., Boyle, R.D., Twombly, X.: A Review on Vision-Based Full DOF Hand Motion Estimation. In: IEEE Computer Society Conference on Computer Vision And Pattern Recognition, San Diego, CA, USA, pp. 15–22 (2005)
Bray, B., Koller-Meier, E., Muller, M., Van Gool, L., Schraudolph, N.N.: 3D Hand Tracking By Rapid Stochastic Gradient Descent Using A Skinning Model. In: 1st European Conference on Visual Media Production, London, pp. 231–237 (2004)
Bray, M., Koller-Meier, E., Van Gool, L.: Smart Particle Filtering for High-dimensional Tracking. Computer Vision and Image Understanding 106, 116–129 (2007)
von Hardenberg, C., Brard, F.: Bare-Hand Human-Computer Interaction. In: Proceedings of the ACM Workshop on Perceptive User Interfaces, pp. 1–8. ACM Press, New York (2001)
Cipolla, R., Ollinghurst, N.J.: Human Robot Interface by ointing with Uncalibrated Stereo Vision. Image and Vision Computing 14, 171–178 (1996)
Wang, C., Gao, W., Shan, S.: An approach based on phonemes to large vocabulary Chinese sign language recognition. In: Proceedings of the 5th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 393–398. IEEE Press, New York (2002)
Deutscher, J., Blake, A., Reid, I.: Articulated Body Motion Capture By Annealed Particle Filtering. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1144–1149. IEEE Press, New York (2000)
Deutscher, J., Davison, A., Reid, I.: Automatic Partitioning of High Dimensional Search Spaces Associated With Articulated Body Motion Capture. In: Proceedings of Conference on Computer Vision and Pattern Recognition, pp. 187–193. IEEE Press, New York (2001)
Daubney, B., Gibson, D., Campbell, N.: Real-time Pose Estimation of Articulated Objects Using Low-level Motion. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. IEEE Press, New York (2008)
Erol, A., Bebis, G., Nicolescu, M., Boyle, R., Twombly, R.: Vision-based Hand Pose Estimation: A Review. Computer Vision and Image Understanding 108, 52–73 (2007)
Hix, D., Hartson, R.H.: Developing User Interfaces - Ensuring Usability Through Product and Process. John Wiley & Sons, New York (1993)
Huttenlocher, D.P., Klanderman, G.A., Rucklidge, W.J.: Comparing Images Using the Hausdorff Distance. IEEE Trans. Pattern Analysis and Machine Intelligence 15, 850–863 (1993)
Zhou, H., Huang, T.S.: Tracking Articulated Hand Motion with Eigen Dynamics Analysis. In: International Conference on Computer Vision, Nice, France, pp. 1102–1109 (2003)
John, B.E.: Cognitive modeling in human-computer interaction. In: Proceedings of Graphics Interface, pp. 161–167 (1998)
Kato, M., Chen, Y.W., Xu, G.: Articulated Hand Tracking by PCA-ICA Approach. In: Proceedings of IEEE Conference on Automatic Face and Gesture Recognition, pp. 329–334. IEEE Press, New York (2006)
Lenman, S., Bretzner, L., Thuresson, B.: Computer Vision Based Hand posture Interfaces for Human–Computer Interaction. Department of Numerical Analysis and Computer Science, Sweden (2002)
Lee, M.S., Weinshall, D., Cohen Solal, E., Colmenarez, A., Lyons, D.: Computer Vision System for On-screen Item Selection by Finger Pointing. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 329–334. IEEE Press, New York (2001)
Lin, J., Wu, Y., Huang, T.S.: Capturing Human Hand Motion In Image Sequences. In: Workshop on Motion and Video Computing, pp. 99–104 (2002)
McAllister, G.: Hand tracking for behaviour understanding. Image and Vision Computing 20, 827–840 (2002)
Mental models and usability, http://www.lauradove.Info/reports/mentalTechnicalreport
Stefanov, N., Galata, A., Hubbold, R.: A real-time hand tracker using variable-length Markov models of behaviour. Computer Vision and Image Understanding 108, 98–115 (2007)
Oka, K., Sato, Y., Koike, H.: Real-time tracking of multiple fingertips and gesture recognition for augmented desk interface systems. In: Fifth IEEE International Conference on In Automatic Face and Gesture Recognition, pp. 411–416. IEEE Press, New York (2002)
Chen, Q., Emil Petriu, M., Nicolas Georganas, D.: 3D Hand Tracking and Motion Analysis with a Combination Approach of Statistical and Syntactic Analysis. In: IEEE International Workshop on Haptic Audio Visual Environments and their Applications, pp. 56–61. IEEE Press, New York (2007)
Wang, R.Y., Popović, J.: Real-Time Hand-Tracking with a Color Glove. ACM Transactions on Graphics 28, 1–8 (2009)
Raskin, R.L., Rudzsky, E.: Dimensionality Reduction for Articulated Body Tracking. In: 3DTV Conference, Kos Island, pp. 1–4 (2007)
Stenger, B.: The Grid: Model-Based Hand Tracking Using A Hierarchical Bayesian Filter. PhD Thesis, Department of Engineering, University of Cambridge (2004)
Lin, T., Zha, H., Lee, S.U.: Riemannian Manifold Learning for Nonlinear Dimensionality Reduction. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part I. LNCS, vol. 3951, pp. 44–55. Springer, Heidelberg (2006)
Vaswani, N.: Particle Filtering For Large Dimensional State Spaces with Multimodal Observation Likelihoods. IEEE Transactions on Signal Processing 56, 4583–4597 (2008)
Wu, Y., Lin, J.Y., Huang, T.S.: Capturing Freehand Articulation. In: IEEE International Conference On Computer Vision, Vancouver, Canada, vol. 2, pp. 426–432 (2001)
Xu, X., Li, B.: Rao-Blackwellised: Particle Filter For Tracking with Application in Visual Surveillance. In: The 2nd Joint IEEE International Workshop, pp. 17–24 (2005)
Wu, X., Liang, W., Jia, Y.: Tracking articulated objects by learning intrinsic structure of motion. Pattern Recognition Letters 30, 267–274 (2009)
Feng, Z., Yang, B., Zheng, Y.: Research on features extraction from frame image. sequences. In: International Symposium on Computer Science and Computational Technology, pp. 762–766 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Feng, Z. et al. (2012). 3D Articulated Hand Tracking Based on Behavioral Model. In: Pan, Z., Cheok, A.D., Müller, W., Chang, M., Zhang, M. (eds) Transactions on Edutainment VIII. Lecture Notes in Computer Science, vol 7220. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31439-1_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-31439-1_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-31438-4
Online ISBN: 978-3-642-31439-1
eBook Packages: Computer ScienceComputer Science (R0)