Identification Approach Lip-Based Biometric

  • Carlos M. Travieso
  • Juan C. Briceño
  • Jesús B. Alonso
Part of the Studies in Computational Intelligence book series (SCI, volume 378)


A robust biometric identification approach based on lip shape is presented in this chapter. Firstly, we have built an image processing step in order to detect the face of an user, and to enhance the lips area based on a color transformation. This step is ended detecting the lip on the enhanced image. A shape coding has been built to extract features of the lip shape image with original and reduced images. Those reductions have been applied with reduction scale of 3:1, 4:1 and 5:1. The shape coding points have been transformed by a Hidden Markov Model (HMM) Kernel, using a minimization of Fisher Score. Finally, a one-versus-all multiclass supervised approach based on Support Vector Machines (SVM) with RBF kernel is applied as a classifier. A database with 50 users and 10 samples per class has been built (500 images). A cross-validation strategy have been applied in our experiments, reaching success rates up to 99.6% and 99.9% for original and reduced size of lip shape, respectively; using four lip training samples per class and two lip training samples, respectively; and evaluating with six lip test samples and eight lip test samples, respectively. Those success rates were found using a lip shape of 150 shape coding points with 40 HMM states and 100 shape coding points with 40 HMM states in Hidden Markov Model, respectively, reaching with reduced lip shape image our best success, and finally, our proposal.


Support Vector Machine Hide Markov Model Speech Recognition Visual Speech Motion History Image 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Acuite Market Intelligence: Categories: Authentication, Identity & Access Management, Manufacturers, TechNews, Trends Tags: biometrics, facial recognition, fingerprint reader, hand geometry, retinal scanning (2011) (accesed March 14, 2011); Slifka, M.K., Whitton, J.L.: Clinical implications of dysregulated cytokine production. J. Mol. Med (2000), doi:10.1007/s001090000086
  2. 2.
    Briceño, J.C., Travieso, C.M., Alonso, J.B., Ferrer, M.A.: Robust Identification of persons by Lips Contour using Shape Transformation. In: 14th IEEE International Conference on Intelligent Engineering Systems, pp. 203–207 (2010)Google Scholar
  3. 3.
    Burges, C.: A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowlshape Discovery 2(2), 121–167 (1998)CrossRefGoogle Scholar
  4. 4.
    Coianiz, T., Torresan, L., Massaro, D.: 2D deformable models for visual speech analysis. In: NATO Advanced in Speechreading by Humans and Machines, pp. 391–398. Springer, Heidelberg (1996)Google Scholar
  5. 5.
    David, S., Ferrer, M.A., Travieso, C.M., Alonso, J.B.: gpdsHMM: A Hidden Markov Model Toolbox in the Matlab Environment. Complex Systems Intelligence and Modern Technological Applications, 476–479 (2004)Google Scholar
  6. 6.
    De la Cuesta, A., Zhang, J., Miller, P.: Biometric Identification Using Motion History Images of a Speaker’s Lip Movements. In: Machine Vision and Image Processing International Conference, pp. 83–88 (2008)Google Scholar
  7. 7.
    Faraj, M.I., Bigun, J.: Motion Features from Lip Movement for Person Authentication. In: 18th International Conference on Pattern Recognition, vol. 3, pp. 1059–1062 (2006)Google Scholar
  8. 8.
    Gastelum, A., Krueger, M., Marquez, J., Gimel’farb, G., Delmas, P.: Automatic 3D lip shape segmentation and modeling. In: 23rd International Conference Image and Vision Computing, New Zealand, pp. 1–6 (2008)Google Scholar
  9. 9.
    Goudelis, G., Zafeiriou, S., Tefas, A., Pitas, I.: Class-Specific Kernel-Discriminant Analysis for Face Verification. IEEE Transactions on Information Forensics and Security 2(3) Part 2, 570–587 (2007); doi:10.1109/TIFS.2007.902915CrossRefGoogle Scholar
  10. 10.
    Hernando, J., Nadeu, C., Marińo, J.B.: Speech recognition in a noisy environment based on LP of the one-sided autocorrelation sequence and robust similarity measuring techniques. Speech communications 21, 17–31 (1997)CrossRefGoogle Scholar
  11. 11.
    Jaakkola, T., Diekhans, M., Haussler, D.: A discriminative framework for detecting remote protein homologies. Journal of Computational Biology 7(1-2), 95–114 (2000)CrossRefGoogle Scholar
  12. 12.
    Jain, A.K., Flynn, P., Ross, A.A.: Flipbook of Biometrics. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  13. 13.
    Joachims, T.: SVMlight Support Vector Machine (2008), (accessed November 2, 2009)
  14. 14.
    Otsu, N.: A thresholding selection method from gray-level histogram. IEEE Transactions on Systems, Man, and Cybernetics 9(1), 62–66 (1979)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Rabiner, L.R.: A tutorial on Hidden Markov models and Selected Applications in Speech Recognition. Proceedings of the IEEE 77(2), 257–286 (1989)CrossRefGoogle Scholar
  16. 16.
    Rabiner, L., Juang, B.H.: Fundamentals of Speech Recognition. Prentice-Hall, Englewood Cliffs (1993)Google Scholar
  17. 17.
    Rao, R.A., Mersereau, R.: Lip modeling for visual speech recognition. In: Eighth Asilomar Conference on Signals, Systems and Computers, vol. 1, pp. 587–590 (1994)Google Scholar
  18. 18.
    Sohail, A.S.M., Bhattacharya, P.: Automated Lip Contour Detection Using the Level Set Segmentation Method. In: 14th International Conference on Image Analysis and Processing, pp. 425–430 (2007)Google Scholar
  19. 19.
    Steifelhagen, R., Yang, J., Meier, U.: Real time lip tracking for lipreading. In: Proceedings of Eurospeech (1997)Google Scholar
  20. 20.
    Stillittano, S., Girondel, V., Caplier, A.: Inner and outer lip contour tracking using cubic curve parametric models. In: 16th IEEE International Conference on Image Processing, pp. 2469–2472 (2009)Google Scholar
  21. 21.
    Yaling, L., Minghui, D.: Lip Contour Extraction Based on Manifold. In: International Conference on MultiMedia and Information Technology, pp. 229–232 (2008)Google Scholar
  22. 22.
    Yan, X., Guangda, S.: Multi-parts and Multi-feature Fusion in Face Verification. In: Conference on Computer Vision and Pattern Recognition, pp. 1–6 (2008)Google Scholar
  23. 23.
    Viola, P., Jones, M.: Robust Real-time Object Detection. International Journal of Computer Vision 57(2), 137–154 (2004)CrossRefGoogle Scholar
  24. 24.
    Wark, T., Sridharan, S., Clipran, V.: An approach to statistical lip modelling for speaker identification via chromatic feature extraction. In: IEEE International Conference on Pattern Recognition. pp.123–125 (1998)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Carlos M. Travieso
    • 1
  • Juan C. Briceño
    • 1
  • Jesús B. Alonso
    • 2
  1. 1.Signals and Communications Department Institute for Technological Development and Innovation in Communications University of Las Palmas de Gran Canaria CampusUniversity of TafiraLas Palmas de Gran CanariaSpain
  2. 2.Computer Science DepartmentUniversidad de Costa RicaCosta Rica

Personalised recommendations