Multimedia Tools and Applications

, Volume 74, Issue 20, pp 8821–8830 | Cite as

Facial landmarks detection using improved active shape model on android platform

  • Yong-Hwan Lee
  • Cheong Ghil KimEmail author
  • Youngseop Kim
  • Taeg Keun Whangbo


Detection of facial feature is fundamental for applications such as security, biometrics, 3D face modeling and personal authentication. Active Shape Model (ASM) is one of the most popular local texture models for face detection. This paper presents an issue related to face detection based on ASM, and proposes an efficient extraction algorithm for facial landmarks suitable for use on mobile devices. We modifies the original ASM to improve its performance with three changes; (1) Improving the initialization model using the center of the eyes by using a feature map of color information, (2) Constructing modified model definition and fitting more landmarks than the classical ASM, and (3) Extending and building a 2-D profile model for detecting faces in input image. The proposed method is evaluated on dataset containing over 700 images of faces, and experimental results reveal that the proposed algorithm exhibited a significant improvement of over 10.2 % in average success ratio, compared to the classic ASM, clearly outperforming on success rate and computing time.


Facial feature points Face analysis Active shape model (ASM) Facial landmarks 



This research is supported by Ministry of Culture, Sports and Tourism (MCST) and Korea Creative Content Agency (KOCCA) in the Culture Technology (CT) Research & Development Program 2013.


  1. 1.
    Cootes T (2000) An Introduction to Active Shape Models. Image Processing and Analysis: A Practical Approach. Oxford University Press, pp. 223–248Google Scholar
  2. 2.
    Cootes TF, Edwards GJ, Taylor CJ (2001) Active Appearance Models. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(6):681–685Google Scholar
  3. 3.
    Cootes TF, Edwards GJ, Taylor CJ (1999) Comparing active shape models with active appearance models. 10th British Machine Vision Conference, pp.173–182Google Scholar
  4. 4.
    Dailey MN, Joyce C, Lyons MJ, Kamachi M, Ishi H, Gyoba J, Cottrell GW (2010) Evidence and a computational explanation of cultural differences in facial expression recognition. Emotion 10(6):874–893CrossRefGoogle Scholar
  5. 5.
    Ginneken B, Frangi AF, Stall JJ, Romeny BH (2002) Active shape model segmentation with optimal features. IEEE-TMI 21:924–933Google Scholar
  6. 6.
    Hsu R-L, Abdel-Mottaleb M, Jain AK (2002) Face Detection in Color Images. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(5):696–706Google Scholar
  7. 7.
    Kobayashi S, Hashimoto S (1995) Automated feature extraction of face image and its applications. 4th IEEE International Workshop on Robot and Human Communication, pp. 164–169Google Scholar
  8. 8.
    Le HT, Vo NT (2011) Face alignment using active shape model and support vector machine. International Journal of Biometrics and Bioinformatics 4(6):224–234Google Scholar
  9. 9.
    Masip D, Vitria J (2004) Real Time Face Detection and Verification for Uncontrolled Environments. 2nd COST Workshop—Biometrics on the Internet: Fundamentals, Advances and Applications, pp. 55–58Google Scholar
  10. 10.
    Seshadri K, Savvides M (2009) Robust Modified Active Shape Model for Automatic Facial Landmark Annotation of Frontal Faces. 3rd IEEE International Conference on Biometrics: Theory, Applications and Systems, pp. 1–8Google Scholar
  11. 11.
    Thomaz CE, Giraldi GA (2010) A new ranking method for principal components analysis and its application of face image analysis. Image Vis Comput 28(6):902–913CrossRefGoogle Scholar
  12. 12.
    Yagi Y (2000) Facial feature extraction from frontal face image. 5th International Conference on Signal Processing, WCCC-ICSP, pp. 1225–1232Google Scholar
  13. 13.
    Zhao W, Chellappa R, Phillips P, Rosenfeld A (2003) Face recognition: a literature survey. ACM Comput Surv 35(4):399–458CrossRefGoogle Scholar
  14. 14.
    Zhou Y, Gu L, Zhang HJ (2003) Bayesian Tangent Shape Model: Estimating Shape and Pose Parameters via Bayesian Inference. IEEE Computer Society Conference on Computer Vision and Pattern Recognition. pp. 109–116Google Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • Yong-Hwan Lee
    • 1
  • Cheong Ghil Kim
    • 2
    Email author
  • Youngseop Kim
    • 3
  • Taeg Keun Whangbo
    • 4
  1. 1.Department of Applied Computer EngineeringDankook UniversityYongin-siSouth Korea
  2. 2.Department of Computer ScienceNamseoul UniversityCheonanSouth Korea
  3. 3.Department of Electronic EngineeringDankook UniversityCheonanSouth Korea
  4. 4.Department of Interactive MediaGachon UniversitySeongnam-siSouth Korea

Personalised recommendations