Human Facial Expression Recognition Using Wavelet Transform and Hidden Markov Model

  • Muhammad Hameed Siddiqi
  • Sungyoung Lee
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8277)


The accuracy of the Facial Expression Recognition (FER) system is completely reliant on the extraction of the informative features. In this work, a new feature extraction method is proposed that has the capability to extract the most prominent features from the human face. The proposed technique has been tested and validated in order to achieve the best accuracy for FER systems. There are some regions in the face that have much contribution in achieving the best accuracy. Therefore, in this work, the human face is divided into number of regions and in each region the movement of pixels have been traced. For this purpose, one of the wavelet families named symlet wavelet is used and individual facial frame is decomposed up to 2 levels. In each decomposition level, the distances between the pixels is found by using the distance formula and by this way some of the informative coefficients are extracted and hence the feature vector has been created. Moreover, the dimension of the feature space is reduced by employing a well-known statistical technique such as Linear Discriminant Analysis (LDA). Finally, Hidden Markov Model (HMM) is exploited for training and testing the system in order to label the expressions. The proposed FER system has been tested and validated on Cohn-Kanade dataset. The resulting recognition accuracy of 94% illustrates the success of employing the proposed technique for FER.


Facial Expression Recognition Wavelet Transform LDA HMM 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bartlett, M.S., Donato, G., Movellan, J.R., Hager, J.C., Ekman, P., Sejnowski, T.J.: Face image analysis for expression measurement and detection of deceit. In: Proceedings of the 6th Annual Joint Symposium on Neural Computation (1999)Google Scholar
  2. 2.
    Baum, L.E.: An equality and associated maximization technique in statistical estimation for probabilistic functions of markov processes. Inequalities 3, 1–8 (1972)Google Scholar
  3. 3.
    Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(7), 711–720 (1997)CrossRefGoogle Scholar
  4. 4.
    Chuang, C.-F., Shih, F.Y.: Recognizing facial action units using independent component analysis and support vector machine. Pattern Recognition 39(9), 1795–1798 (2006)CrossRefzbMATHGoogle Scholar
  5. 5.
    Donato, G., Bartlett, M.S., Hager, J.C., Ekman, P., Sejnowski, T.J.: Classifying facial actions. IEEE Transactions on Pattern Analysis and Machine Intelligence 21(10), 974–989 (1999)CrossRefGoogle Scholar
  6. 6.
    Fasel, B., Luettin, J.: Automatic facial expression analysis: a survey. Pattern Recognition 36(1), 259–275 (2003)CrossRefzbMATHGoogle Scholar
  7. 7.
    Feng, G.C., Yuen, P.C., Dai, D.Q.: Human face recognition using pca on wavelet subband. Journal of Electronic Imaging 9(2), 226–233 (2000)CrossRefGoogle Scholar
  8. 8.
    Kanade, T., Cohn, J.F., Tian, Y.: Comprehensive database for facial expression analysis. In: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 46–53. IEEE (2000)Google Scholar
  9. 9.
    Kaur, M., Vashisht, R.: Comparative study of facial expression recognition techniques. International Journal of Computer Applications 13(1) (2011)Google Scholar
  10. 10.
    Kim, J., Choi, J., Yi, J., Turk, M.: Effective representation using ica for face recognition robust to local distortion and partial occlusion. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(12), 1977–1981 (2005)CrossRefGoogle Scholar
  11. 11.
    Li, S.Z., Hou, X.W., Zhang, H.J., Cheng, Q.S.: Learning spatially localized, parts-based representation. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 1, p. I-207. IEEE (2001)Google Scholar
  12. 12.
    Lin, D.-T.: Facial expression classification using pca and hierarchical radial basis function network. Journal of Information Science and Engineering 22(5), 1033–1046 (2006)Google Scholar
  13. 13.
    Lin, D.-T.: Human facial expression recognition using hybrid network of PCA and RBFN. In: Kollias, S.D., Stafylopatis, A., Duch, W., Oja, E. (eds.) ICANN 2006. LNCS, vol. 4132, pp. 624–633. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  14. 14.
    Mehrabian, A.: Communication without words. Psychological Today 2, 53–55 (1968)Google Scholar
  15. 15.
    Penev, P.S., Atick, J.J.: Local feature analysis: A general statistical theory for object representation. Network: Computation in Neural Systems 7(3), 477–500 (1996)CrossRefzbMATHGoogle Scholar
  16. 16.
    Samaria, F.S.: Face recognition using hidden Markov models. PhD thesis, University of Cambridge (1994)Google Scholar
  17. 17.
    Turunen, J., et al.: A wavelet-based method for estimating damping in power systems (2011)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2013

Authors and Affiliations

  • Muhammad Hameed Siddiqi
    • 1
  • Sungyoung Lee
    • 1
  1. 1.Department of Computer EngineeringKyung Hee UniversitySuwonRep. of Korea

Personalised recommendations