Skip to main content
SpringerLink
Log in

Facial Image Processing

  • Chapter
Applied Pattern Recognition

Part of the book series: Studies in Computational Intelligence ((SCI,volume 91))

Faces are among the most important classes of objects computers have to deal with. Consequently, automatic processing and recognition of facial images have attracted considerable attention in the last decades. In this chapter we focus on a strict view of facial image processing, i.e. transforming an input facial image into another and involving no high-level semantic classification like face recognition. A brief overview of facial image processing techniques is presented. Typical applications include removal of eyeglasses, facial expression synthesis, red-eye removal, strabismus simulation, facial weight-change simulation, caricature generation, and restoration of facial images.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. B. Abboud, F. Davoine, and M. Dang. Facial expression recognition and synthesis based on an appearance model. Signal Processing: Image Communication, 19(8):723–740, 2004

    Article  Google Scholar 

  2. B. Abboud and F. Davoine. Bilinear factorisation for facial expression analysis and synthesis. IEE Proceedings of the Vision Image and Signal Processing, 152(3):327–333, 2005

    Article  Google Scholar 

  3. V. Blanz, C. Basso, T. Poggio, and T. Vetter. Reanimating faces in images and video. Computer Graphics Forum, 22(3):641–650, 2003

    Article  Google Scholar 

  4. V. Blanz, K. Scherbaum, T. Vetter, and H.-P. Seidel. Exchanging faces in images. Computer Graphics Forum, 23(3):669–676, 2004

    Article  Google Scholar 

  5. F. Bookstein. Principal warps: Thin-plate splines and the decomposition of deformations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 11(6):567–585, 1989

    Article  Google Scholar 

  6. C. Bregler, M. Covell, and M. Slaney. Video rewrite: Driving visual speech with audio. In Proceedings of SIGGRAPH, pages 353–360, 1997

    Google Scholar 

  7. N.P. Chandrasiri, T. Naemura, and H. Harashima. Interactive analysis and synthesis of facial expressions based on personal facial expression space. In Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition, pages 105–110, 2004

    Google Scholar 

  8. K. Chang, K. Bowyer, and P. Flynn. A survey of approaches and challenges in 3D and multi-modal 2D+3D face recognition. Computer Vision and Image Understanding, 101(1):1–15, 2006

    Article  Google Scholar 

  9. H. Chen, Y.-Q. Xu, H.-Y. Shum, S.-C. Zhu, and N.-N. Zheng. Example-based facial sketch generation with non-parametric sampling. In Proceedings of International Conference on Computer Vision, volume 2, pages 433–438, 2001

    Google Scholar 

  10. P.-Y. Chiang, W.-H. Liao, and T.-Y. Li. Automatic caricature generation by analyzing facial features. In Proceedings of Asian Conference on Computer Vision, 2004

    Google Scholar 

  11. D.K. Coats, E.A. Paysse, A.J. Towler, and R.L. Dipboye. Impact of large angle horizontal strabismus on ability to obtain employment. Ophthalmology, 107(2):402–405, 2000

    Article  Google Scholar 

  12. U. Danino, N. Kiryati, and M. Furst. Algorithm for facial weight-change. Proceedings of International Conference on Electronics, Circuits and Systems, pages 318–321, 2004

    Google Scholar 

  13. Y. Du and Y. Lin. Emotional facial expression model building. Pattern Recognition Letters, 24(16):2923–2934, 2003

    Article  Google Scholar 

  14. P. Eisert. Analysis and synthesis of facial expressions. In N. Sarris and G.M. Strintzis, editors, 3D Modeling and Animation: Synthesis and Analysis Techniques for the Human Body, pages 235–265, Idea Group Inc., 2004

    Google Scholar 

  15. B. Fasel and J. Luettin. Automatic facial expression analysis: A survey. Pattern Recognition, 36(1):259–275, 2003

    Article  Google Scholar 

  16. F. Gasparini, R. Schettini. Automatic redeye removal for smart enhancement of photos of unknown origin. In Proceedings of the International Conference on Visual Information Systems, 2005

    Google Scholar 

  17. M. Gaubatz and R. Ulichney. Automatic red-eye detection and correction. In Proceedings of International Conference on Image Processing, volume I, pages 804–807, 2002

    Google Scholar 

  18. J. Ghent and J. McDonald. Photo-realistic facial expression synthesis. Image and Vision Computing, 23(12):1041–1050, 2005

    Article  Google Scholar 

  19. E. Hjelmas and B.K. Low. Face detection: A survey. Computer Vision and Image Understanding, 83:237–274, 2001

    Article  Google Scholar 

  20. A. Hoover, G. Jean-Baptiste, X. Jiang, P.J. Flynn, H. Bunke, D. Goldgof, K. Bowyer, D. Eggert, A. Fitzgibbon, and R. Fisher. An experimental comparison of range image segmentation algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(7):673–689, 1996

    Article  Google Scholar 

  21. B.-W. Hwang and S.-W. Lee. Reconstruction of partially damaged face images based on a morphable face model. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(3):365–372, 2003

    Article  Google Scholar 

  22. X. Jiang, M. Binkert, B. Achermann, and H. Bunke. Towards detection of glasses in facial images. Pattern Analysis and Applications, 3(1):9–18, 2000

    Article  Google Scholar 

  23. X. Jiang, S. Rothaus, K. Rothaus, and D. Mojon. Synthesizing face images by iris replacement: Strabismus simulation. In Proceedings of first International Conference on Computer Vision Theory and Applications, pages 41–47, 2006

    Google Scholar 

  24. Z. Jing and R. Mariani. Glasses detection and extraction by deformable contour. In Proceedings of International Conference on Pattern Recognition, 933–936, 2000

    Google Scholar 

  25. B. Kamgar-Parsi and A.K. Jain. Synthetic eyes. In J. Kittler and M.S. Nixon, editors, Audio- and Video-Based Biometric Person Authentication, pages 412–420. Springer, Berlin Heidelberg New York, 2003

    Chapter  Google Scholar 

  26. S. Kong, J. Heo, B. Abidi, J. Paik, and M. Abidi. Recent advances in visual and infrared face recognition – A review. Computer Vision and Image Understanding, 97(1), 103–135, 2005

    Article  Google Scholar 

  27. H. Koshimizu, M. Tominaga, T. Fujiwara, and K. Murakami. On KANSEI facial image processing for computerized facialcaricaturing system PICASSO. In Proceedings of Conference on Systems, Man, and Cybernetics, volume 6, pages 294–299, 1999

    Google Scholar 

  28. S. Krinidis, I. Buciu, and I. Pitas. Facial expression analysis and synthesis: A survey. In Proceedings of International Conference on Human–Machine Interaction, pages 1432–1436, 2003

    Google Scholar 

  29. A. Lanitis, C.J. Taylor, and T.F. Cootes. Toward automatic simulation of aging effects on face images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(4):442–455, 2002

    Article  Google Scholar 

  30. S.Z. Li and A.K. Jain, editors. Handbook of Face Recognition. Springer, Berlin Heidelberg New York, 2005

    Google Scholar 

  31. L. Liang, H. Chen, Y.Q. Xu, and H.Y. Shum. Example-based caricature generation with exaggeration. In Proceedings of 10th Pacific Conference on Computer Graphics and Applications, 2002

    Google Scholar 

  32. P. Litwinowicz and L. Williams. Animating images with drawings. In Proceedings of SIGGRAPH, pages 409–412, 1994

    Google Scholar 

  33. Q. Liu, X. Tang, H. Jin, H. Lu, and S. Ma. A nonlinear approach for face sketch synthesis and recognition. In Proceedings of Conference on Computer Vision and Pattern Recognition, volume 1, pages 1005–1010, 2005

    Google Scholar 

  34. Z. Liu, Y. Shan, and Z. Zhang. Expressive expression mapping with ratio images. In Proceedings of SIGGRAPH, pages 271–276, 2001

    Google Scholar 

  35. Z. Liu, Z. Zhang, and Y. Shan. Image-based surface detail transfer. IEEE Computer Graphics and Applications, 24(3):30–35, 2004

    Article  Google Scholar 

  36. S. Loffe. Red eye detection with machine learning. In Proceedings of International Conference on Image Processing, volume II, pages 871–874, 2003

    Google Scholar 

  37. H. Luo, J. Yen, and D. Tretter. An efficient automatic redeye detection and correction algorithm. In Proceedings of International Conference on Pattern Recognition, volume 2, pages 883–886, 2004

    Google Scholar 

  38. X.P. Miao and T. Sim. Automatic red-eye detection and removal. In Proceedings of International Conference on Multimedia and Expo, pages 1195–1198, 2004

    Google Scholar 

  39. A. Nikolaidis and I. Pitas. Robust watermarking of facial images based on salient geometric pattern matching. IEEE Transactions on Multimedia, 2(3):172–184, 2000

    Article  Google Scholar 

  40. K.-I. Okada, F. Maeda, Y. Ichikawaa, and Y. Matsushita. Multiparty videoconferencing at virtual social distance: MAJIC design. In Proceedings of ACM Conference on Computer Supported Cooperative Work, pages 385–393, 1994

    Google Scholar 

  41. J.-S. Park and S.-W. Lee. Reconstruction of high-resolution facial images for visual surveillance. In C.H. Chen and P.S.P. Wang, editors, Handbook of Pattern Recognition and Computer Vision, 3rd edn., pages 445–459. World Scientific, Singapore, 2005

    Google Scholar 

  42. J.-S. Park, Y.-H. Oh, S.-C. Ahn, and S.-W. Lee. Glasses removal from face image using recursive error compensation. IEEE Transactions Pattern Analysis and Machine Intelligence, 27(5):805–811, 2005

    Article  Google Scholar 

  43. F.I. Parke and K. Waters. Computer Facial Animation. A.K. Peters Ltd., 1996

    Google Scholar 

  44. P.J. Phillips, H. Moon, S.A. Rizvi, and P.J. Rauss. The FERET evaluation methodology for face-recognition algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(10):1090–1104, 2000

    Article  Google Scholar 

  45. F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D. Salesin. Synthesizing realistic facial expressions from photographs. In Proceedings of SIGGRAPH, pages 75–84, 1998

    Google Scholar 

  46. Y. Saito, Y. Kenmochi, and K. Kotani. Estimation of eyeglassless facial images using principal component analysis. In Proceedings of International Conference on Image Processing, volume 4, pages 197–201, 1999

    Google Scholar 

  47. J.S. Schildkraut and R.T. Gray. A fully automatic redeye detection and correction algorithm. In Proceedings of International Conference on Image Processing, volume I, pages 801–803, 2002

    Google Scholar 

  48. A. Sellen. Remote conversations: The effects of mediating talk with technology. Human Computer Interaction, 10(4):401–444, 1995

    Article  Google Scholar 

  49. S.M. Seitz and C.R. Dyer. View morphing. In Proceedings of SIGGRAPH, pages 21–30, 1996

    Google Scholar 

  50. T.K. Shih and R.-C. Chang. Digital inpainting – survey and multilayer image inpainting algorithms. In Proceedings of International Conference on Information Technology and Applications, volume 1, pages 15–24, 2005

    Google Scholar 

  51. B. Smolka, K. Czubin, J.Y. Hardeberg, K.N. Plataniotis, M. Szczepanski, and K. Wojciechowski. Towards automatic redeye effect removal. Pattern Recognition Letters, 24:1767–1785, 2003

    Article  Google Scholar 

  52. X. Tang and X. Wang. Face sketch recognition. IEEE Transactions Circuits and Systems for Video Technology, 14(1):50–57, 2004

    Article  Google Scholar 

  53. P. Thompson. Margaret Thatcher: A new illusion. Perception, 9:483–484, 1980

    Article  Google Scholar 

  54. R. Ulichney and M. Gaubatz. Perceptual-based correction of photo red-eye. In Proceedings of IASTED International Conference on Signal and Image Processing, 2005

    Google Scholar 

  55. J. Wan and X.P. Ren. Automatic red-eyes detection based on AAM. In Proceedings of International Conference on Systems, Man and Cybernetics, volume 7, pages 6337–6341, 2004

    Google Scholar 

  56. D. Weiner and N. Kiryati. Virtual gaze redirection in face images. In Proceedings of International Conference on Image Analysis and Processing, pages 76–81, 2003

    Google Scholar 

  57. Z. Wen, Z. Liu, and T.S. Huang. Face relighting with radiance environment maps. In Proceedings of Conference on Computer Vision and Pattern Recognition, volume 2, pages 158–165, 2003

    Google Scholar 

  58. C. Wu, C. Liu, and J. Zhou. Eyeglasses verification by support vector machine. In Proceedings of IEEE Pacific Rim Conference on Multimedia, pages 1126–1131, 2001

    Google Scholar 

  59. H. Wu, G. Yoshikawa, T. Shioyama, T. Lao, and T. Kawade. Glasses frame detection with 3D Hough transform. In Proceedings of International Conference on Pattern Recognition, volume 2, pages 346–349, 2002

    Google Scholar 

  60. Y. Xiao and H. Yan. Extraction of glasses in human face images. In Proceedings of International Conference on Biometric Authentication, pages 214–220, 2004

    Google Scholar 

  61. M.-H. Yang, D. Kriegman, and N. Ahuja. Detecting faces in images: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(1):34–58, 2002

    Article  Google Scholar 

  62. L. Yin and A. Basu. Generating realistic facial expressions with wrinkles for model-based coding. Computer Vision and Image Understanding, 84(2):201–240, 2001

    Article  Google Scholar 

  63. Q. Zhang, Z. Liu, B. Guo, D. Terzopoulos, and H.-Y. Shum. Geometry-driven photorealistic facial expression synthesis. IEEE Transactions Visualization and Computer Graphics, 12(1):48–60, 2006

    Article  Google Scholar 

  64. L. Zhang, Y. Sun, M. Li, and H. Zhang. Automated red-eye detection and correction in digital photographs. In Proceedings of International Conference on Image Processing, volume IV, pages 2363–2366, 2004

    Google Scholar 

  65. W. Zhao, R. Chellappa, J. Phillips, and A. Rosenfeld. Face recognition: A literature survey. ACM Computing Surveys, 35(4):399–458, 2003

    Article  Google Scholar 

  66. C. Zhou and X. Lin. Facial expressional image synthesis controlled by emotional parameters. Pattern Recognition Letters, 26(16):2611–2627, 2005

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics and Computer Science, University of M¨unster, Germany

    Xiaoyi Jiang

  2. Department of Health Services Administration, China Medical University, Taiwan, Japan

    Yung-Fu Chen

Authors
  1. Xiaoyi Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yung-Fu Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institute of Computer Science and Applied Mathematics, Neubrückstrasse 10, CH-3012, Bern, Switzerland

    Horst Bunke

  2. University of South Florida, 4202 E. Fowler Ave, 33620, Tampa, FL, USA

    Abraham Kandel

  3. Ben-Gurion University of the Negev, 84105, Beer-Sheva, Israel

    Mark Last

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Jiang, X., Chen, YF. (2008). Facial Image Processing. In: Bunke, H., Kandel, A., Last, M. (eds) Applied Pattern Recognition. Studies in Computational Intelligence, vol 91. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76831-9_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-76831-9_2

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-76830-2

  • Online ISBN: 978-3-540-76831-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation