Skip to main content
SpringerLink
Log in

Classifier Fusion Method Based Emotion Recognition for Mobile Phone Users

  • Conference paper
  • First Online:
Broadband Communications, Networks, and Systems (Broadnets 2019)

Abstract

With the development of modern society, people are paying more and more attention to their mental situation. An emotion is an external reaction of people’s psychological state. Therefore, emotion recognition has attached widespread attention and become a hot research topic. Currently, researchers identify people’s emotion mainly based on their facial expression, human behavior, physiological signals, etc. These traditional methods usually require some additional ancillary equipment to obtain information. This always inevitably makes trouble for users. At the same time, ordinary smart-phones are equipped with a lot of sensor devices nowadays. This enables researchers to collect emotion-related information of mobile users just using their mobile phones. In this paper, we track daily behavior data of 50 student volunteers using sensors on their smart-phones. Then a machine learning based classifier pool is constructed with considering diversity and complementary. Base classifiers with high inconsistent are combined using a dynamic adaptive fusion strategy. The weights of base classifiers are learned based on their prior probabilities and class-conditional probabilities. Finally, the emotion status of mobile phone users are predicted.

Supported by the Fundamental Research Funds for Central Universities (JB161004).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Gross, J.J., Muñoz, R.F.: Emotion regulation and mental health. Clin. Psychol.: Sci. Pract. 2(2), 151–164 (1995)

    Google Scholar 

  2. Valstar, M., et al.: Avec 2016: depression, mood, and emotion recognition workshop and challenge. In: Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge, pp. 3–10. ACM (2016)

    Google Scholar 

  3. Trigeorgis, G., et al.: Adieu features? End-to-end speech emotion recognition using a deep convolutional recurrent network. In: 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5200–5204. IEEE (2016)

    Google Scholar 

  4. Zhao, M., Adib, F., Katabi, D.: Emotion recognition using wireless signals. In: Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking, pp. 95–108. ACM (2016)

    Google Scholar 

  5. Ko, B.: A brief review of facial emotion recognition based on visual information. Sensors 18(2), 401 (2018)

    Article  Google Scholar 

  6. Baur, D.: AI-based emotion detection has become a 20B industry (2019). https://www.theguardian.com/technology/2019/mar/06/facial-recognition-software-emotional-science/. Accessed 01 July 2019

  7. Li, M., et al.: Facial expression recognition with identity and emotion joint learning. IEEE Trans. Affect. Comput. (2018)

    Google Scholar 

  8. Greco, A., et al.: Skin admittance measurement for emotion recognition: a study over frequency sweep. Electronics 5(3), 46 (2016)

    Article  Google Scholar 

  9. Zhao, B., et al.: EmotionSense: emotion recognition based on wearable wristband. In: 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), pp. 346–355. IEEE (2018)

    Google Scholar 

  10. Vijayan, A.E., Sen, D., Sudheer, A.P.: EEG-based emotion recognition using statistical measures and auto-regressive modeling. In: 2015 IEEE International Conference on Computational Intelligence & Communication Technology, pp. 587–591. IEEE (2015)

    Google Scholar 

  11. Farhan, A.A.: Modeling Human Behavior using Machine Learning Algorithms (2016)

    Google Scholar 

  12. Deng, Z.-H., Luo, K.-H., Yu, H.-L.: A study of supervised term weighting scheme for sentiment analysis. Expert Syst. Appl. 41(7), 3506–3513 (2014)

    Article  Google Scholar 

  13. Khan, F.H., Qamar, U., Bashir, S.: Lexicon based semantic detection of sentiments using expected likelihood estimate smoothed odds ratio. Artif. Intell. Rev. 48(1), 113–138 (2017)

    Article  Google Scholar 

  14. Baccianella, S., Esuli, A., Sebastiani, F.: SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Lrec, vol. 10, pp. 2200–2204 (2010)

    Google Scholar 

  15. Cambria, E., et al.: New avenues in opinion mining and sentiment analysis. IEEE Intell. Syst. 28(2), 15–21 (2013)

    Article  Google Scholar 

  16. McDu, D., et al.: Affectiva-mit facial expression dataset (AM-FED): naturalistic and spontaneous facial expressions collected. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 881–888 (2013)

    Google Scholar 

  17. Martini, N., et al.: The dynamics of EEG gamma responses to unpleasant visual stimuli: from local activity to functional connectivity. NeuroImage 60(2), 922–932 (2012)

    Article  Google Scholar 

  18. Frantzidis, C.A., et al.: Toward emotion aware computing: an integrated approach using multichannel neurophysiological recordings and affective visual stimuli. IEEE Trans. Inf. Technol. Biomed. 14(3), 589–597 (2010)

    Article  Google Scholar 

  19. Balconi, M., Mazza, G.: Brain oscillations and BIS/BAS (behavioral inhibition/activation system) effects on processing masked emotional cues: ERS/ERD and coherence measures of alpha band. Int. J. Psychophysiol. 74(2), 158–165 (2009)

    Article  Google Scholar 

  20. Jenke, R., Peer, A., Buss, M.: Feature extraction and selection for emotion recognition from EEG. IEEE Trans. Affect. Comput. 5(3), 327–339 (2014)

    Article  Google Scholar 

  21. Khezri, M., Firoozabadi, M., Sharafat, A.R.: Reliable emotion recognition system based on dynamic adaptive fusion of forehead biopotentials and physiological signals. Comput. Methods Programs Biomed. 122(2), 149–164 (2015)

    Article  Google Scholar 

  22. Liu, Y.-J., et al.: Real-time movie-induced discrete emotion recognition from EEG signals. IEEE Trans. Affect. Comput. 9(4), 550–562 (2017)

    Article  MathSciNet  Google Scholar 

  23. Wang, X.-W., Nie, D., Lu, B.-L.: Emotional state classification from EEG data using machine learning approach. Neurocomputing 129, 94–106 (2014)

    Article  Google Scholar 

  24. Balconi, M., Lucchiari, C.: EEG correlates (event-related desynchronization) of emotional face elaboration: a temporal analysis. Neurosci. Lett. 392(1–2), 118–123 (2006)

    Article  Google Scholar 

  25. Iacoviello, D., et al.: A real-time classification algorithm for EEGbased BCI driven by self-induced emotions. Comput. Methods Programs Biomed. 122(3), 293–303 (2015)

    Article  Google Scholar 

  26. Yang, R., Xi, C., Xi, S.: J. Front. Comput. Sci. Technol. 10(6), 751–760 (2016)

    Google Scholar 

  27. Breiman, L.: Bias, variance, and arcing classifiers. Technical report, 460, Statistics Department, University of California, Berkeley (1996)

    Google Scholar 

  28. Bowes, D., Randall, D., Hall, T.: The inconsistent measurement of message chains. In: 2013 4th International Workshop on Emerging Trends in Software Metrics (WETSoM), pp. 62–68. IEEE (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Xidian University, Xi’an, 710071, Shaanxi, China

    Luobing Dong, Yueshen Xu & Shijun He

  2. National Key Laboratory of Science and Technology on ATR, College of Electronic Science National University of Defense Technology, Changsha, 410073, Hunan, China

    Luobing Dong & Ping Wang

Authors
  1. Luobing Dong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yueshen Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ping Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shijun He
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Luobing Dong .

Editor information

Editors and Affiliations

  1. Xidian University, Xi'an, China

    Qingshan Li

  2. Xidian University, Xi'an, China

    Shengli Song

  3. Xidian University, Xi'an, China

    Rui Li

  4. Xidian University, Xi'an, China

    Yueshen Xu

  5. Xi’an Jiaotong University, Xi'an, Shaanxi, China

    Wei Xi

  6. Shanghai University, Shanghai, China

    Honghao Gao

Rights and permissions

Reprints and permissions

Copyright information

© 2019 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Dong, L., Xu, Y., Wang, P., He, S. (2019). Classifier Fusion Method Based Emotion Recognition for Mobile Phone Users. In: Li, Q., Song, S., Li, R., Xu, Y., Xi, W., Gao, H. (eds) Broadband Communications, Networks, and Systems. Broadnets 2019. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 303. Springer, Cham. https://doi.org/10.1007/978-3-030-36442-7_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-36442-7_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-36441-0

  • Online ISBN: 978-3-030-36442-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation