Abstract
Automatic Person Recognition and Authentication faces a huge challenge especially in high risk environment. Multimodal Biometrics do address this issue up to a certain extent. Voice is the simplest and distinct single modality and lip movement is unique for each speaker. Dynamic movement of the lips if tracked online while a Speaker is speaking can authenticate a speaker in real time and the imposter can be identified thus making the biometric system robust and secure. This paper detects the lip movement of a Speaker, creates contours around the mouth region in real time and creates data base for a Speaker. Using the USB webcam, face detection was done from which the mouth region was segmented and contours were created around the lip area with the help of random points selected on both the upper and lower lips which were mathematically obtained. Based on these points of movement, a database was created for an individual. The time taken to create the speaker’s lip contour database takes hardly a few seconds which is the advantage and requirement for Real time applications which we have achieved.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Nainan, S., Kulkarni, V.: A comparison of performance evaluation of ASR for noisy and enhanced signal using GMM. In: International Conference on Computing and Security Trends. IEEE, Pune (2016)
Wang, C., Xuebin, L.: A new spectral image assessment based on energy of structural distortion. In: IEEE International Conference on Image Analysis and Signal Processing (2009)
Matsui, T., Furui, S.: Concatenated phoneme models for text-variable speaker recognition. In: Proceedings International Conference on Acoustics, Speech and Signal Processing, ICSLP, pp. 391–394 (1993)
Chetty, G., Wagner, M.: Automated lip feature extraction for liveness verification in audio-video authentication. HCC laboratory University of Canberra, Australia (2004)
Shen, X.-G., Wu, W.: An algorithm of lips secondary positioning and feature extraction based on YCbCr color space. In: International Conference on advances in Mechanical Engineering and Industrial Informatics. AMEII (2015)
Shiraishi, J., Saitoh, T.: Optical flow based lip reading using non rectangular ROI and head motion reduction. IEEE (2015). 971-1-4799-6026-2
John Hubert, P., Sheeba, M.S.: Lip and head gesture recognition based PC interface using image processing. Biomed. J. Pharm. J. 8(1), 77–82 (2015)
Gurumurthy, S., Tripathy, B.K.: Design and implementation of face recognition system in matlab using the features of lips. IJISA 4(8), 30 (2012)
Mehrotra, H., Agrawal, G.: Automatic lip contour tracking and visual character recognition for computerized lip reading. Int. J. Electr. Comput. Energ. Electron. Commun. Eng. 3(4), 62–71 (2009)
Wang, L. Wang, X.: Lip detection and tracking using variance based Harr-like features and Kalman filter. In: Fifth International Conference on Frontier of computer Science and Technology. IEEE (2010). 978-0-7695-4139-6/10
Craig, B., Harte, N.: Region of interest extraction using colour based methods on the CUAVE database ISSC, Dublin (2009)
Ooi, W.C., Jeon, C.: Effective lip localization and tracking and achieving multimodal speech recognition. In: International Conference on Multisensor Fusion and Integration for Intelligent Systems, Seoul Korea (2008)
Morade, S., Patnaik, S.: Automatic lip tracking and extraction of lip geometric features for lip reading. Int. J. Mach. Learn. Comput. 3(2), 168 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Nainan, S., Kulkarni, V., Srivastava, A. (2018). Computer Vision Based Real Time Lip Tracking for Person Authentication. In: Satapathy, S., Joshi, A. (eds) Information and Communication Technology for Intelligent Systems (ICTIS 2017) - Volume 1. ICTIS 2017. Smart Innovation, Systems and Technologies, vol 83. Springer, Cham. https://doi.org/10.1007/978-3-319-63673-3_73
Download citation
DOI: https://doi.org/10.1007/978-3-319-63673-3_73
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-63672-6
Online ISBN: 978-3-319-63673-3
eBook Packages: EngineeringEngineering (R0)