Skip to main content

Emotion Recognition from Images Under Varying Illumination Conditions

  • Conference paper
  • First Online:
Soft Computing Applications

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 357))

Abstract

Facial expressions are one of the most powerful and immediate means for human beings to communicate their emotions. Recognizing human emotion has varied range of applications in humanoid robots, animation industry, psychology, forensic analysis, medical aid, automotive industry, etc. This work focuses on emotion recognition under various illumination conditions using images from CMU-MultiPIE database. The database is provided with five basic expressions like neutral, happiness, anger, disgust and surprise with varying pose and illuminations. The experiment has been conducted on images with varying illuminations initially without pre-processing and also by applying a proposed ratio-based pre-processing method followed by feature extraction and classification. Dual—Tree-Complex Wavelet Transform (DT-CWT) was applied for the formation of feature vectors along with K-Nearest Neighbour (KNN) as the classifier. The result shows that pre-processed images give better results than original images. It is thus concluded that varying illumination has effect on emotion recognition and the pre-processing algorithm demonstrates improvement in accuracy of recognition. Future work may include a broader perspective of using body language and speech data for emotion recognition.

Retired BARC Scientist

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Liu WF, Wang Y-J (2008) Expression feature extraction based on difference of local binary pattern histogram sequences. In: ICSP2008 proceedings

    Google Scholar 

  2. Jabid T Md, Kabir H, Chae O (2010) Robust facial expression recognition based on local directional pattern. ETRI J 32(5)

    Google Scholar 

  3. Adin RR, Jorge RC, Oksam C (2013) Local directional number pattern for face analysis: face and expression recognition. IEEE Trans Image Process 22(5)

    Google Scholar 

  4. Wang S, Liu Z, Lv S, Lv Y, Wu G, Peng P, Chen F, Wang X (2010) A natural visible and infrared facial expression database for expression recognition and emotion inference. IEEE Trans Multimedia 12(7)

    Google Scholar 

  5. Suja P, Tripathi S, Keerthana DN (2013) Emotion recognition using DWT, KL transform and neural network. In: Second international conference on advances in signal processing and communications (SPC2013), Lucknow, India, June 2013. Proceedings of mobile communications II, Springer, pp 360–367. ACEEE conference proceedings series 01, Elsevier pp 834–839

    Google Scholar 

  6. Lajevardi SM, Wu HR (2012) Facial expression recognition in perceptual color space. IEEE Trans Image Process 21(8)

    Google Scholar 

  7. Li Y, Ruan Q, Li X (2010) Facial expression recognition based on complex wavelet transform. In: IET 3rd international conference on wireless, mobile and multimedia network, IEEE

    Google Scholar 

  8. Sanghoon KIM, Chung S-T, Jung S, Cho S (2008) An improved illumination normalization based on anisotropic smoothing for face recognition. World Acad Sci Eng Technol 2:01–21

    Google Scholar 

  9. Stratou G, Ghosh A, Debevec P, Morency L-P (2011) Effect of illumination on automatic expression recognition:a novel 3D relightable facial database. In: IEEE international conference on automatic face and gesture recognition and workshops (FG 2011), pp 611–618

    Google Scholar 

  10. Suja P, Tripathi S, Deepthy J (2014) Emotion recognition from facial expressions using frequency domain techniques. In: First international symposium on signal processing and intelligent recognition systems—SIRS 2014, Trivandrum, India, March 2014. Proceedings of advances in intelligent systems and computing, vol 264. Springer, pp 299–310

    Google Scholar 

  11. González RC, Woods RE (2007) Digital image processing. Prentice Hall

    Google Scholar 

  12. Selsnick W, Baraniuk RG, Kingsburg NG (2005) The dual—tree complex wavelet transform—a coherent framework for multiscale signal and image processing. IEEE Sign Process Mag 22(6):123–151

    Google Scholar 

  13. Gross R, Matthews I, Cohn J, Kanade T, Baker S (2010) Guide to the CMU multi-PIE face database. The Robotics Institute, Carnegie Mellon University

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shikha Tripathi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Suja, P., Thomas, S.M., Tripathi, S., Madan, V.K. (2016). Emotion Recognition from Images Under Varying Illumination Conditions. In: Balas, V., Jain, L., Kovačević, B. (eds) Soft Computing Applications. Advances in Intelligent Systems and Computing, vol 357. Springer, Cham. https://doi.org/10.1007/978-3-319-18416-6_72

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-18416-6_72

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-18415-9

  • Online ISBN: 978-3-319-18416-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics