Abstract
Facial recognition is the process of identifying and/or verifying distinct facial characteristics of an individual in an image or a video stream, pre-recorded or in real time. Hand gesture recognition refers to the process of identifying the configuration of an individual’s hand posture in an image and can be used to verify concurrency of it with respect to a pre-set randomized prompt example to use it in a way similar to CAPTCHA. This paper aims to unify these two similar, yet varying image processing technologies in order to be able to provide a multi-factor authentication system for web applications which cannot be tricked using pre-recorded footage. The face would be identified in the image using convolutional neural networks and then be masked from the image for the hand to be isolated by identifying them using the skin tone. Once the hand has been isolated, SIFT points identified would determine the gesture being performed by the subject, followed by matching the face with the requested credentials if approved. The facial recognition would act like a password and the hand gesture recognition as a means to verify the authenticity of the facial credentials provided.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Chen G, Shao Y, Tang C, Jin Z, Zhang J (2018) Deep transformation learning for face recognition in the unconstrained scene. Mach Vis Appl 1–11
Abdalmageed W, Wu Y, Rawls S, Harel S, Hassner T, Masi I, Choi J, Lekust J, Kim J, Natarajan P (2016) Face recognition using deep multi-pose representations. In: WACV, pp 1–9
Bansal A, Castillo C, Ranjan R, Chellappa R (2017) The dos and donts for cnn-based face verification. arXiv preprint, arXiv:1705.07426, p 5
Bansal A, Nanduri A, Castillo C, Ranjan R, Chellappa R (2016) Umdfaces: an annotated face dataset for training deep networks. arXiv preprint, arXiv:1611.01484
Bodla N, Zheng J, Xu H, Chen J-C, Castillo C, Chellappa R (2017) Deep heterogeneous feature fusion for template-based face recognition. In: WACV. IEEE, pp 586–595
Cao Z, Yin Q, Tang X, Sun J (2010) Face recognition with learning based descriptor. In: CVPR. IEEE, pp 2707–2714
Chen B, Deng W, Du J (2017) Noisy softmax: improving the generalization ability of dcnn via postponing the early softmax saturation. arXiv preprint, arXiv:1708.03769
Agarwal A, Singh R, Vatsa M, Ratha N (2018) Are imageagnostic universal adversarial perturbations for face recognition difficult to detect. IEEE BTAS
Bowyer KW, Chang K, Flynn P (2006) A survey of approaches and challenges in 3d and multi-modal 3d + 2d face recognition. Comput Vis Image Underst 101(1):1–15
Dorner B (1993) Hand shape identification and tracking for sign language interpretation. In: IJCAI workshop on looking at people
Cui Y, Weng JJ (1996) Hand segmentation using learning based prediction and verification for hand sign recognition. In: Proceedings of international conference on automatic face and gesture recognition, Killington, Vt., pp 88–93, Oct 1996
Olszewska, JI (2018) Chapter 4: Automated face recognition: challenges and solutions. Pattern recognition-analysis and applications. IntechOpen, pp 59–79. https://doi.org/10.5772/66013
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Pandey, A.N., Singh, A.V. (2020). A Model for Real-Time Biometric Authentication Using Facial and Hand Gesture Recognition. In: Saini, H., Sayal, R., Buyya, R., Aliseri, G. (eds) Innovations in Computer Science and Engineering. Lecture Notes in Networks and Systems, vol 103. Springer, Singapore. https://doi.org/10.1007/978-981-15-2043-3_12
Download citation
DOI: https://doi.org/10.1007/978-981-15-2043-3_12
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-2042-6
Online ISBN: 978-981-15-2043-3
eBook Packages: EngineeringEngineering (R0)