Skip to main content
SpringerLink
Log in

Real-Time Lip Contour Extraction and Tracking Using an Improved Active Contour Model

  • Conference paper
Advances in Visual Computing (ISVC 2008)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 5359))

Included in the following conference series:

Abstract

We present an automatic lip contour extraction and tracking method based on an improved active contour model, which introduces a novel image gradient detection based on the segmented lip, tongue and oral cavity image obtained using a nonlinear transformation of the YCbCr color space and a novel entropy analysis based segmentation. The proposed method provides encouraging results with different mouth shapes (with the appearance of teeth, tongue and oral cavity) under various illuminations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Fu, Y., Li, R., Huang, T., Danielsen, M.: Real-Time Humanoid Avatar for Multimodal Human-Machine Interaction. In: Proceedings of the IEEE International Conference on Multimedia and Expo, Beijing, July, pp. 991–994 (2007)

    Google Scholar 

  2. Fasel, B., Luettin, J.: Automatic Facial Expression Analysis: A Survey. Pattern Recognition 36(1), 259–275 (2003)

    Article  MATH  Google Scholar 

  3. Tiddeman, B., Perrett, D.: Moving Facial Image Transformations using Static 2D Prototypes. In: Proceedings of the 9-th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision 2001 (W S C G 2001), Plzen, Czech Republic, February 5-9 (2001)

    Google Scholar 

  4. Matthews, I., Cootes, T.F., Bangham, J.A., Cox, S., Harvey, R.: Extraction of visual features for lipreading. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(2), 198–213 (2002)

    Article  Google Scholar 

  5. Kass, M., Witkin, A., Terzopoulos, D.: Snake: active contour models. International Journal of Computer Vision 1(4), 321–331 (1987)

    Article  Google Scholar 

  6. Cohen, L.: On active contour models and balloons. CVGIP: Image Understanding 53(2), 211–218 (1991)

    Article  MathSciNet  MATH  Google Scholar 

  7. Sugahara, K., Kishino M., Konishi, R.: Personal computer based real time lip reading system. In: Proceedings of Signal Processing, WCCC-ICSP, vol. 2, pp. 1341–1346 (2000)

    Google Scholar 

  8. Bernard, M., Holden, E., Owens, R.: Lip tracking using pattern matching snakes. In: Proceedings of the 5th Asian Conference on Computer Vision ACCV, pp. 273–278 (2002)

    Google Scholar 

  9. Jang, K.: Lip contour extraction based on active shape model and snakes. International Journal of Computer Science and Network Security 7(10), 148–153 (2007)

    Google Scholar 

  10. Seo, K., Kim, W., Oh, C., Lee, J.: Face detection and facial feature extraction using color snake. In: Proceedings of the 2002 IEEE International Symposium on Industrial Electronics, pp. 457–462 (2002)

    Google Scholar 

  11. Schaub, H., Smith, C.: Color snakes for dynamic lighting conditions on mobile manipulation platforms. In: Proceedings of the IEEE International Conference on Intelligent Robots and Systems, US, pp. 1272–1277 (2003)

    Google Scholar 

  12. Kou, P., Hillman, P., Hannah, J.: Improved lip fitting and tracking for model-based multimedia and coding. In: Proceedings of the IEE International Conference on Visual Information Engineering (VIE), UK, pp. 251–258 (2005)

    Google Scholar 

  13. Wakasugi, T., Nishiura, M., Fukui, K.: Robust lip contour extraction using separability of multi-dimensional distributions. In: Proceedings of the 6th IEEE International Conference on Automatic Face and Gesture Recognition, May, pp. 415–420 (2004)

    Google Scholar 

  14. Hsu, R.L., Abdel-Mottaleb, M., Jain, A.K.: Face detection in color image. IEEE transactions on Pattern Analysis and Machine Intelligence 24(5), 696–706 (2002)

    Article  Google Scholar 

  15. Viola, P., Jones, M.: Robust real time object detection. In: Proceedings of the 2nd International Workshop on Statistical and Computational Theories of Vision-Modeling, Learning, Computing and Sampling, Vancouver, Canada (July 2001)

    Google Scholar 

  16. Teh, C.H., Chin, R.T.: On the detection of dominant points on digital curve. IEEE transactions on Pattern Analysis and Machine Intelligence 11(8), 859–872 (1989)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Engineering and Research Centre for Information Technology on Education, Huazhong Normal University, Wuhan, P.R. China

    Jingying Chen & Gang Zhao

  2. School of Computer Science, University of St Andrews, UK

    Jingying Chen & Bernard Tiddeman

Authors
  1. Jingying Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bernard Tiddeman
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gang Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, University of Nevada, Reno, USA

    George Bebis

  2. NASA Ames Research Center, Moffett Field, CA, USA

    Richard Boyle

  3. Lawrence Berkeley National Laboratory, Berkeley, CA, USA

    Bahram Parvin

  4. Desert Research Institute, Reno, NV, USA

    Darko Koracin

  5. Digital Image Research Center, Kingston University, London, UK

    Paolo Remagnino

  6. Mitsubishi Electric Research Laboratories, P.O. Box 02139, Cambridge, MA, USA

    Fatih Porikli

  7. Computer and Information Science and Engineering, University of Florida, P.O. Box, FL 32611-6120, Gainsville, USA

    Jörg Peters

  8. IBM T.J. Watson Research Center, 19 Skyline Drive, NY 10532, Hawthorne, USA

    James Klosowski

  9. 128 Memorial Mall, Stewart B001, IN 47907, West Lafayette, USA

    Laura Arns

  10. Denver Museum of Nature and Space, 2001 Colorade Blvd. Denver,, CO 80205, USA

    Yu Ka Chun

  11. Departmen of Computer Science,, NC State University, Campus Box 8206, NC 27695-8206, Raleigh, USA

    Theresa-Marie Rhyne

  12. Los Alamos National Labs, P.O. Box 1663, NM 87545, Los Alamos, USA

    Laura Monroe

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Chen, J., Tiddeman, B., Zhao, G. (2008). Real-Time Lip Contour Extraction and Tracking Using an Improved Active Contour Model. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2008. Lecture Notes in Computer Science, vol 5359. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89646-3_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-89646-3_23

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-89645-6

  • Online ISBN: 978-3-540-89646-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation