Abstract
In recent years, thermal image has extensively been used in many fields such as military (e.g., target acquisition, surveillance, night vision, homing and tracking) and civilian purposes (e.g., medical diagnosis, thermal efficiency analysis, environmental monitoring). It may be a promising alternative for investigation of facial expression and emotion. Currently there are very few database to support the research in facial expression and emotion, however most of them either only include posed thermal expression images or lack thermal information. For these reasons, we propose and establish a natural visible and thermal facial emotion database. The database contains seven spontaneous emotions of 26 subjects. We also analyze a visible database, a thermal database to recognize expression and thermal information to recognize emotion.
Chapter PDF
Similar content being viewed by others
Keywords
References
Darwin, C.: The expression of the emotions in man and animals. Oxford University, New York (1872)
Tian, Y., Kanade, T., Cohn, J.: Facial Expression Analysis, Handbook of Face Recognition, pp. 247–275. Springer, New York (2005)
Zeng, Z., Pantic, M., Roisman, G.T., Huang, T.S.: A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Trans. Pattern Anal. Mach. Intell. 31(1), 39–58 (2009)
Fasel, B., Luettin, J.: Automatic facial expression analysis: a survey. Pattern Recognition 36, 259–275 (2003)
Khan, M.M., Ward, R.D., Ingleby, M.: Classifying pretended and evoked facial expression of positive and negative affective states using infrared measurement of skin temperature. Trans. Appl. Percept. 6(1), 1–22 (2009)
Nakanishi, R., Matsumura, K.I.: Facial skin temperature decreases in infants with joyful expression. Infant Behavior and Development 31, 137–144 (2008)
Kanade, T., Cohn, J., Tian, Y.: Comprehensive database for facial expression analysis. In: Proc. IEEE Intl. Conf. Face and Gesture Recognition, pp. 46–53 (2000)
Sebe, N., Lew, M.S., Cohen, I., Sun, Y., Gevers, T., Huang, T.S.: Authentic Facial Expression Analysis. In: Proc. IEEE Intl. Conf. Automatic Face and Gesture Recognition, AFGR (2004)
Pantic, M., Bartlett, M.S.: Machine Analysis of Facial Expressions, Face Recognition, pp. 377–416. I-Tech Education and Publishing, Vienna (2007)
O’Toole, A.J., Harms, J., Snow, S.L., Hurst, D.R., Pappas, M.R., Ayyad, J.H., Abdi, H.: A video database of moving faces and people. IEEE Trans. Pattern Anal. Mach. Intell. 27(5), 812–816 (2005)
Douglas-Cowie, E., Cowie, R., Schroeder, M.: The description of naturally occurring emotional speech. In: Proc. 15th Int. Conf. Phonetic Sciences, Barcelona, Spain, pp. 2877–2880 (2003)
Roisman, G.I., Tsai, J.L., Chiang, K.S.: The emotional integration of childhood experience: Physiological, facial expressive, and self-reported emotional response during the adult attachment interview. Development Psychol. 40(5), 776–789 (2004)
NIST Equinox database, http://www.equinoxsensors.com/products/HID.html
IRIS database, http://www.cse.ohio-state.edu/otcbvs-bench/Data/02/download.html
Wang, S., Liu, Z., Lv, S., Lv, Y., Wu, G., Peng, P., Chen, F., Wang, X.: A Natural Visible and Infrared Facial Expression Database for Expression Recognition and Emotion Inference. IEEE Transactions on Multimedia 12(7), 682–691 (2010)
Lin, D.T.: Facial Expression Classification Using PCA and Hierarchical Radial Basis Function Network. Journal of Information Science and Engineering 22, 1033–1046 (2006)
Kurozumi, T., Shinza, Y., Kenmochi, Y., Kotani, K.: Facial Individuality and Expression Analysis by Eigenspace Method Based on Class Features or Multiple Discriminant Analysis. In: ICIP (1999)
Yabui, T., Kenmochi, Y., Kotani, K.: Facial expression analysis from 3D range images; comparison with the analysis from 2D images and their integration. In: ICIP (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nguyen, H., Kotani, K., Chen, F., Le, B. (2014). A Thermal Facial Emotion Database and Its Analysis. In: Klette, R., Rivera, M., Satoh, S. (eds) Image and Video Technology. PSIVT 2013. Lecture Notes in Computer Science, vol 8333. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-53842-1_34
Download citation
DOI: https://doi.org/10.1007/978-3-642-53842-1_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-53841-4
Online ISBN: 978-3-642-53842-1
eBook Packages: Computer ScienceComputer Science (R0)