Skip to main content

Visual Speech: A Physiological or Behavioural Biometric?

  • Conference paper
  • First Online:
Audio- and Video-Based Biometric Person Authentication (AVBPA 2001)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2091))

Abstract

This paper addresses an issue concerning the current classification of biometrics into either physiological or behavioural. We offer clarification on this issue and propose additional qualifications for a biometric to be classedas behavioural. It is observedth at dynamics play a key role in the qualification of these terminologies. These are illustratedby practical experiments baseda round visual speech. Two sets of speaker recognition experiments are considered: the first uses lip profiles as both a physiological anda behavioural biometric, the second uses the inherent dynamics of visual speech to locate key facial features. Experimental results using short, consistent test andt raining segments from video recordings give recognition error rates as: physiological - lips 2% and face circles 11%; behavioural - lips 15% andv oice 11%.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. G. Roethenbaugh. Biometrics Explained. http://www.icsa.net/services/consortia/cbdc/explained.shtml, 1999.

  2. R. Auckenthaler, E. Parris, and M. Carey. Improving a GMM Speaker Verification System by Phonetic Weighting. ICASSP, page 1440, 1999.

    Google Scholar 

  3. C.C. Chibelushi, J.S. Mason, and F. Deravi. Integration of acoustic and visual speech for speaker recognition. In Proc. EuroSpeech, volume 1, pages 157–160, Berlin, 1993.

    Google Scholar 

  4. P. Jourlin, J. Luettin, D. Genoud, and H. Wassner. Acoustic Labial Speaker Verification. Proc AVBPA, Lecture Notes in Computer Science 1206, pages 319–334, 1997.

    Google Scholar 

  5. R. Auckenthaler, J. Brand, J.S.D. Mason, C. Chibelushi, and F. Deravi. Lip Signatures for Speaker Recognition. AVBPA, pages 142–147, Washington, 1999.

    Google Scholar 

  6. A. Rogozan and P. Deleglise. Continuous Visual Speech Recognition Using Geometric Lip-Shape Models and Neural Networks. Proc 5 th Conf. Speech Communication and Technology, page 1999–2000, 1997.

    Google Scholar 

  7. I. Matthews, J. Bangham, R. Harvey, and S. Cox. Nonlinear Scale Decomposition Based Features for Visual Speech Recognition. EUSIPCO98, pages 303–305, 1998.

    Google Scholar 

  8. I. Matthews, J. Bangham, R. Harvey, and S. Cox. A Comparison of Active Shape Model and Scale Decomposition Based Features for Visual Speech Recognition. ECCV, pages 514–528, 1998.

    Google Scholar 

  9. R. Goecke, J.B. Millar, A. Zelinsky, and J. Robert-Ribes. Automatic Extraction of Lip Feature Points. In Australian Conference on Robotics and Automation, pages 31–36, 2000.

    Google Scholar 

  10. S. Furui. Speaker-Independent IsolatedWord Recognition using Dynamic Features of speech spectrum. IEEE Trans. on ASSP, 34:52–59, 1986.

    Article  Google Scholar 

  11. J. Thompson and J.S. Mason. Effects of Anxiety in Visual and Audio Speech Databases. ESCA, pages 21–24, 1995.

    Google Scholar 

  12. R. Auckenthaler, J. Brand, J.S.D. Mason, C. Chibelushi, and F. Deravi. Lip Signatures for Automatic Person Recognition. In IEEE Workshop, MMSP, pages 457–462, 1999.

    Google Scholar 

  13. T. Sakai, M. Nagao, and T. Kanade. Computer analysis and classification of photographs of human faces. First U.S.A.-Japan Computer Conf. Proc., pages 55–62, 1972.

    Google Scholar 

  14. M. Kirby and L. Sirovich. Application of the Karhunen-Lo`eve Procedure for the Characterization of Human Faces. IEEE Trans. Pattern Analysis and Machine Intelligence, pages 103–108, 1990.

    Google Scholar 

  15. M. Turk and A. Pentland. Eigenfaces for recognition. Journal of Cognitive Neuroscience, pages 98–113, 1991.

    Google Scholar 

  16. S. Lawrence, C. Giles, A. Tsoi, and A. Back. Face Recognition: A Convolutional Neural Network Approach. IEEE Trans. Neural Networks, pages 98–113, 1997.

    Google Scholar 

  17. H. Rowley, S. Baluja, and T. Kanade. Neural Network-based Face Detection. IEEE Conf. on CVPR, pages 203–207, 1996.

    Google Scholar 

  18. F. Samaria. Face Segmentation for Identification using Hidden Markov Models. In Proceedings of 1993 British Machine Vision Conference, pages 399–408, 1993.

    Google Scholar 

  19. A. Lantis, C.J. Taylor, and T.F. Cootes. An Automatic Face Identification System using Flexible Appearance Models. Image and Vision Computing, pages 393–401, 1995.

    Google Scholar 

  20. J. Hu, H. Yan, and M. Sakalli. Locating head and face boundaries for head-shoulder images. PR, 32:1317–1333, 1999.

    Google Scholar 

  21. A. Pentlandan and M. Turk. Eigenfaces for recognition. Journal of Cognitive Neuroscience, pages 71–86, 1991.

    Google Scholar 

  22. J.L. Crowley and F. Bérard. Multi-Modal Tracking of Faces for Video Communications. IEEE Comp. Soc. Conf. CVPR, pages 640–645, 1997.

    Google Scholar 

  23. Francois Bérard, Joëlle Coutaz, and James L. Crowley. Robust Computer Vision for Computer Mediated Communication. INTERACT’97, pages 581–582, 1997.

    Google Scholar 

  24. R.C. Gonzalez and R.E. Woods. Digital Image Processing. Addison-Wesley Publishing Company, 1993.

    Google Scholar 

  25. K. Sobottka and Ioannis Pitas. Looking for Faces and Facial Features in Colour Images. Pattern Recognition and Image Analysis: Advances in Mathematical Theory and Applications, 1996.

    Google Scholar 

  26. C.C. Chibelushi, F. Deravi, and J.S. Mason. BT DAVID Database-Internal Report. Speech and Image Processing Research Group, Dept. of Electrical and Electronic Engineering, University of Wales Swansea URL: http://www-ee.swan.ac.uk/SIPL/david/survey.html, 1996.

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Brand, J.D., Mason, J.S.D., Colomb, S. (2001). Visual Speech: A Physiological or Behavioural Biometric?. In: Bigun, J., Smeraldi, F. (eds) Audio- and Video-Based Biometric Person Authentication. AVBPA 2001. Lecture Notes in Computer Science, vol 2091. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45344-X_23

Download citation

  • DOI: https://doi.org/10.1007/3-540-45344-X_23

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42216-7

  • Online ISBN: 978-3-540-45344-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics