Abstract
Hand is a very convenient interface for immersive human-computer interaction. Users can give commands to a computer by hand signs (hand postures, hand shapes) or hand movements (hand gestures). Such a hand interface system can be realized by using cameras as input devices, and software for analyzing the images. In this hand interface system, commands are recognized by analyzing the hand shapes and its trajectories in the images. Therefore, success of the recognition of hand shape is vital and depends on the discriminative power of the hand shape representation. There are many shape representation techniques in the literature. However, none of them are working properly for all shapes. While a representation leads to a good result for a set of shapes, it may fail in another one. Therefore, our aim is to find the most appropriate shape representation technique for hand shapes to be used in hand interfaces. Our candidate representations are Fourier Descriptors, Hu Moment Invariant, Shape Descriptors and Orientation Histogram. Based on widely-used hand shapes for an interface, we compared the representations in terms of their discriminative power and speed.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
La Viola, J.J.: A Survey of Hand Posture and Gesture Recognition Techniques and Technology. Technical Report CS-99-11, Department of Computer Science, Brown University (1999)
Erol, A., Bebis, G., Nicolescu, M., Boyle, R.D., Twombly, X.: A Review on Vision Based Full DOF Hand Motion Estimation. In: IEEE Workshop on Vision for Human-Computer Interaction (in conjunction with CVPR 2005), San Diego, CA, June 21 (2005)
Wu, Y., Huang, T.S.: Hand Modeling, Analysis and Recognition. IEEE Signal Processing Magazine, 51–58 (May 2001)
Quek, F.K.H., Mysliwiec, Y., Zhao, M.: FingerMouse: a Freehand Pointing Interface. In: Proc. of Int. Workshop on Automatic Face and Gesture Recognition, pp. 372–377 (1995)
Genc, S., Atalay, V.: ITouch: Vision-based Intelligent Touch Screen in a Distributed Environment. In: Int. Conf. on Multimodal Interfaces (ICMI), Doctoral Spotlight (October 2005)
Licsar, A., Sziranyi, T.: Dynamic Training of Hand Gesture Recognition System. In: Proc. Intl. Conf. on Pattern Recognition, ICPR 2004, vol. 4, pp. 971–974 (2004)
Freeman, W.T., Anderson, D., Beardsley, P., Dodge, C., Kage, H., Kyuma, K., Miyake, Y., Roth, M., Tanaka, K., Weissman, C., Yerazunis, W.: Computer Vision for Interactive Computer Graphics. IEEE Computer Graphics and Applications 18(3), 42–53 (1998)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. Wiley-Interscience, Hoboken (2000)
Zhang, D., Lu, G.: Review of shape representation and description techniques. Pattern Recognition 37(1), 1–19 (2004)
Zhang, D., Lu, G.: Content-Based Shape Retrieval Using Different Shape Descriptors: A Comparative Study. In: Proc. of IEEE Conference on Multimedia and Expo., Tokyo, August 2001, pp. 317–320 (2001)
Freeman, W.T., Roth, M.: Orientation Histograms for Hand Gesture Recognition. In: Intl. Workshop on Automatic Face and Gesture Recognition (1995)
Peura, M., Livarinen, J.: Efficiency of Simple Shape Descriptors. In: Aspects of Visual Form, pp. 443–451. World Scientific, Singapore (1997)
Flusser, J.: Moment Invariants in Image Analysis. In: Proceedings of World Academy of Science, Engineering and Technology, February 2006, vol. 11 (2006) ISSN 1307-6884
Fitzgibbon, A., Pilu, M., Fisher, R.B.: Direct Least Square Fitting of Ellipses. Pattern Analysis and Machine Intelligence 21(5) (May 1999)
Zhang, D., Lu, G.: A Comparative Study on Shape Retrieval Using Fourier Descriptors with Different Shape Signatures. In: Proc. of International Conference on Intelligent Multimedia and Distance Education, Fargo, ND, USA, pp. 1–9 (2001)
Hu, M.K.: Visual Pattern Recognition by Moment Invariants. IRE Transactions on Information Theory IT-8, 179–187 (1962)
Gary, K.A.: Learning OpenCV. O’Reilly, Sebastopol (2008) (first print)
Chen, F.S., Fu, C.M., Huang, C.L.: Hand Gesture Recognition Using a Real-time Tracking Method and Hidden Markov Models. Image and Vision Computing 21, 745–758 (2003)
Kolb, A., Barth, E., Koch, R.: ToF-sensors: New dimensions for realism and interactivity. In: IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Workshop on ToF Camera based Computer Vision (TOF-CV), pp. 1–6 (2008), doi:10.1109/CVPRW
Gvili, R., Kaplan, A., Ofek, E., Yahav, G.: Depth Keying, http://www.3dvsystems.com/technology/DepthKey.pdf
Microsoft Natal Project: http://www.xbox.com/en-US/live/projectnatal
Nakagawa, S., Nakanishi, H.: Speaker-Independent English Consonant and Japanese word recognition by a Stochastic Dynamic Time Warping Method. Journal of Institution of Electronics and Telecommunication Engineers 34(1), 87–95 (1988)
Stauffer, C., Grimson, W.E.L.: Adaptive Background Mixture Models for Real-Time Tracking. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149), pp. 246–252 (1999)
Jones, M.J., Rehg, J.M.: Statistical Color Models with Application to Skin Detection. Int. J. of Computer Vision 46(1), 81–96 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Genç, S., Atalay, V. (2009). Which Shape Representation Is the Best for Real-Time Hand Interface System?. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2009. Lecture Notes in Computer Science, vol 5875. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-10331-5_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-10331-5_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-10330-8
Online ISBN: 978-3-642-10331-5
eBook Packages: Computer ScienceComputer Science (R0)