Abstract
We describe a robust real-time 3D tracking system of the extreme limbs of the upper human body, i.e., the hands and the face. The goal of the system is that it can be used as a perceptual interface for virtual reality activities in a workbench environment. The whole system includes an input capture and calibration module, a real time color segmentation module, a data association and tracking module and finally a visualization VRML and H-ANIM procedure. The results of our probabilistically skin-color segmentation are skin-color blobs. Then, for each frame of the sequence our algorithm labels the blobs’ pixels using a set of object state hypothesis. This set of hypothesis is built from the results of previous frames. The 2D tracking results are used for the 3D reconstruction of limbs position in order to obtain the H-ANIM visualization results. Several results are presented to show the algorithm performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bradski, G.R.: Computer video face tracking for use in a perceptual user interface. Intel Technology Journal, Q2 1998 (1998)
Comaniciu, D., Ramesh, V.: Robust detection and tracking of human faces with an active camera. In: Proceedings of the Third IEEE International Workshop on Visual Surveillance, pp. 11–18 (2000)
Bretzner, L., Laptev, I., Lindeberg, T.: Hand Gesture Recognition using Multi-Scale Colour Features, Hierarchical Models and Particle Filtering. In: Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition (FGR 2002), IEEE, Los Alamitos (2002) 0-7695-1602-5/02 ©
Cheng, H.D., Jiang, X.H., Sun, Y., Wang, J.: Color Image Segmentation: Advances and Prospects. Journal of Pattern Recognition 34, 2259–2281 (2001)
Gonzalez, M.: Segmentación de imágenes en Color por método variacional. In: Proc. Del XIV C.E.D.Y.A. y IV C.M.A., pp. 287–288 (1995)
Haritaoglu, I.: W4: Real-Time Surveillance of People and Their Activities. IEEE. Transactions on Pattern Analysis and Machine Intelligence 22(8), 809–830 (2000)
Sidenbladh, H., Black, M.J., Fleet, D.J.: Stochastic Tracking of 3D Human Fig.s Using 2D Image Motion. In: Vernon, D. (ed.) ECCV 2000. LNCS, vol. 1843, pp. 702–718. Springer, Heidelberg (2000)
Okay, K., Satoy, Y., Koikez, H.: Real-time Tracking of Multiple Fingertips and Gesture Recognition for Augmented Desk Interface Systems. In: Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition (FGR 2002), IEEE, Los Alamitos (2002) 0-7695-1602-5/02
Ogawara, K., Hashimoto, K., Takamatsu, J., Ikeuchi, K.: Grasp Recognition using a 3D Articulated Model and Infrared Images, Institute of Industrial Science, Univ. of Tokyo, Tokyo, Japan, Institute of Industrial Science, Univ. of Tokyo, Tokyo, Japan, Fuji Xerox Information Systems Co.,Ltd. Tokyo, 150–0031, Japan
Buades, J.M., Gonzalez, M., Perales, F.J.: A New Method for Detection and Initial Pose Estimation based on Mumford-Shah Segmentation Functional. In: Perales, F.J., Campilho, A.C., Pérez, N., Sanfeliu, A. (eds.) IbPRIA 2003. LNCS, vol. 2652, pp. 117–125. Springer, Heidelberg (2003)
Buades, J.M., Gonzalez, M., Perales, F.J.: Face and Hands Segmentation in Color Images and Initial Matching. In: International Workshop on Computer Vision and Image Analysis, December 2003, pp. 43–48. Palmas de Gran Canaria (2003)
HANIM 1.1 Compliant VRML97, http://ece.uwaterloo.ca/~h-anim/index.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Buades, J.M., Perales, F.J., Varona, J. (2004). Real Time Segmentation and Tracking of Face and Hands in VR Applications. In: Perales, F.J., Draper, B.A. (eds) Articulated Motion and Deformable Objects. AMDO 2004. Lecture Notes in Computer Science, vol 3179. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30074-8_25
Download citation
DOI: https://doi.org/10.1007/978-3-540-30074-8_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22958-2
Online ISBN: 978-3-540-30074-8
eBook Packages: Springer Book Archive