Skip to main content
SpringerLink
Log in

Evaluation of Smile Detection Methods with Images in Real-World Scenarios

  • Conference paper
  • First Online:
Computer Vision - ACCV 2014 Workshops (ACCV 2014)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 9010))

Included in the following conference series:

  • 1361 Accesses

Abstract

Discriminative methods such as SVM, have been validated extremely efficient in pattern recognition issues. We present a systematic study on smile detection with different SVM classifiers. We experimented with linear SVM classifier, RBF kernel SVM classifier and a recently-proposed local linear SVM (LL-SVM) classifier. In this paper, we focus on smile detection in face images captured in real-world scenarios, such as those in GENKI4K database. In the meantime, illumination normalization, alignment and feature representation methods are also taken into consideration. Compared with the commonly used pixel-based representation, we find that local-feature-based methods achieve not only higher detection performance but also better robustness against misalignment. Almost all the illumination normalization methods have no effect on the detection accuracy. Among all the SVM classifiers, the novel LL-SVM is verified to find a balance between accuracy and efficiency. And among all the features including pixel value intensity, Gabor, LBP and HOG features, we find that HOG features are the most appropriate features to detect smiling faces, which, combined with RBF kernel SVM, achieve an accuracy of \(93.25\,\%\) on GENKI4K database.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Pantic, M., Rothkrantz, L.J.: Facial action recognition for facial expression analysis from static face images. IEEE Trans. Syst. Man Cybern. Part B Cybern. 34, 1449–1461 (2004)

    Article  Google Scholar 

  2. Tian, Y.L., Kanade, T., Cohn, J.F.: Recognizing action units for facial expression analysis. IEEE Trans. Pattern Anal. Mach. Intell. 23, 97–115 (2001)

    Article  Google Scholar 

  3. Kapoor, A., Qi, Y., Picard, R.W.: Fully automatic upper facial action recognition. In: IEEE International Workshop on Analysis and Modeling of Faces and Gestures, 2003, AMFG 2003, pp. 195–202. IEEE (2003)

    Google Scholar 

  4. Wen, Z., Huang, T.S.: Capturing subtle facial motions in 3D face tracking. In: Proceedings of the Ninth IEEE International Conference on Computer Vision, 2003, pp. 1343–1350. IEEE (2003)

    Google Scholar 

  5. Sebe, N., Sun, Y., Bakker, E., Lew, M.S., Cohen, I., Huang, T.S.: Towards authentic emotion recognition. In: IEEE International Conference on Systems, Man and Cybernetics, 2004, vol. 1, pp. 623–628. IEEE (2004)

    Google Scholar 

  6. Cohn, J.F., Schmidt, K.L.: The timing of facial motion in posed and spontaneous smiles. Int. J. Wavelets Multiresolut. Inf. Process. 2, 121–132 (2004)

    Article  Google Scholar 

  7. Cohen, I., Sebe, N., Garg, A., Chen, L.S., Huang, T.S.: Facial expression recognition from video sequences: temporal and static modeling. Comput. Vis. Image Underst. 91, 160–187 (2003)

    Article  Google Scholar 

  8. Zhang, Y., Ji, Q.: Active and dynamic information fusion for facial expression understanding from image sequences. IEEE Trans. Pattern Anal. Mach. Intell. 27, 699–714 (2005)

    Article  Google Scholar 

  9. Shinohara, Y., Otsu, N.: Facial expression recognition using fisher weight maps. In: Proceedings of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004, pp. 499–504. IEEE (2004)

    Google Scholar 

  10. Deniz, O., Castrillon, M., Lorenzo, J., Anton, L., Bueno, G.: Smile detection for user interfaces. In: Bebis, G., et al. (eds.) ISVC 2008, Part II. LNCS, vol. 5359, pp. 602–611. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  11. Deng, W., Hu, J., Guo, J.: Extended SRC: undersampled face recognition via intraclass variant dictionary. IEEE Trans. Pattern Anal. Mach. Intell. 34, 1864–1870 (2012)

    Article  Google Scholar 

  12. Deng, W., Hu, J., Lu, J., Guo, J.: Transform-invariant PCA: a unified approach to fully automatic face alignment, representation, and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 36, 1275–1284 (2014)

    Article  Google Scholar 

  13. Deng, W., Hu, J., Guo, J.: Linear ranking analysis. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE (2014)

    Google Scholar 

  14. Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24, 971–987 (2002)

    Article  Google Scholar 

  15. Ahonen, T., Hadid, A., Pietikäinen, M.: Face recognition with local binary patterns. In: Pajdla, T., Matas, J.G. (eds.) ECCV 2004. LNCS, vol. 3021, pp. 469–481. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  16. Deng, W., Hu, J., Guo, J., Cai, W., Feng, D.: Emulating biological strategies for uncontrolled face recognition. Pattern Recogn. 43, 2210–2223 (2010)

    Article  MATH  Google Scholar 

  17. Deng, W., Hu, J., Guo, J., Cai, W., Feng, D.: Robust, accurate and efficient face recognition from a single training image: a uniform pursuit approach. Pattern Recogn. 43, 1748–1762 (2010)

    Article  MATH  Google Scholar 

  18. Zhang, Z., Ladicky, L., Torr, P., Saffari, A.: Learning anchor planes for classification. In: Advances in Neural Information Processing Systems, pp. 1611–1619 (2011)

    Google Scholar 

  19. Kanade, T., Cohn, J.F., Tian, Y.: Comprehensive database for facial expression analysis. In: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, 2000, pp. 46–53. IEEE (2000)

    Google Scholar 

  20. Sim, T., Baker, S., Bsat, M.: The CMU pose, illumination, and expression database. IEEE Trans. Pattern Anal. Mach. Intell. 25, 1615–1618 (2003)

    Article  Google Scholar 

  21. Wang, H., Li, S.Z., Wang, Y.: Generalized quotient image. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004, CVPR 2004, vol. 2, p. II-498. IEEE (2004)

    Google Scholar 

  22. Chen, W., Er, M.J., Wu, S.: Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain. IEEE Trans. Syst. Man Cybern. B Cybern. 36, 458–466 (2006)

    Article  Google Scholar 

  23. Baluja, S., Rowley, H.A.: Boosting sex identification performance. Int. J. Comput. Vision 71, 111–119 (2007)

    Article  Google Scholar 

  24. Shan, C.: Smile detection by boosting pixel differences. IEEE Trans. Image Process. 21, 431–436 (2012)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgement

This work was partially sponsored by National Natural Science Foundation of China (NSFC) under Grant No. 61375031, No. 61471048, and No. 61273217. This work was also supported by the Fundamental Research Funds for the Central Universities, Beijing Higher Education Young Elite Teacher Project, and the Program for New Century Excellent Talents in University.

Author information

Authors and Affiliations

  1. Beijing University of Posts and Telecommunications, Beijing, China

    Zhoucong Cui, Shuo Zhang, Jiani Hu & Weihong Deng

Authors
  1. Zhoucong Cui
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shuo Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jiani Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Weihong Deng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Weihong Deng .

Editor information

Editors and Affiliations

  1. Center for Visual Information Technology, International Institute of Information Technology, Hyderabad, India

    C. V. Jawahar

  2. Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China

    Shiguang Shan

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Cui, Z., Zhang, S., Hu, J., Deng, W. (2015). Evaluation of Smile Detection Methods with Images in Real-World Scenarios. In: Jawahar, C., Shan, S. (eds) Computer Vision - ACCV 2014 Workshops. ACCV 2014. Lecture Notes in Computer Science(), vol 9010. Springer, Cham. https://doi.org/10.1007/978-3-319-16634-6_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-16634-6_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-16633-9

  • Online ISBN: 978-3-319-16634-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation