Prosodic Feature Selection of Personality Traits for Job Interview Performance

  • Rohit MishraEmail author
  • Santosh Kumar Barnwal
  • Shrikant Malviya
  • Prasoon Mishra
  • Uma Shanker Tiwary
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 940)


In this work, we perform feature selection on fifty-six prosodic features (such as intensity, formants, pause) extracted from the MIT-interview dataset. These features help in rating the various personality traits (Engaged, Excited, Friendly, Speaking Rate) which in turn help to determine an interviewee performance. First, we have demonstrated how the top few prosodic features are selected based upon the mutual information gain that gives better performance for rating personality trait rather than taking all fifty-six prosodic features. Second, a set of experiments has been conducted under various regression models of different parameter settings, and their performances are compared. At last, we have listed top selected prosodic features for each personality trait that give better results compared to total fifty-six prosodic features. It is found out that for rating personality trait such as ‘Engaged’ and ‘Excited’, prosodic features related to intensity and pitch plays a major role while for ‘Friendly’, prosodic features such as maximum-duration of pause and percentage-breaks, take a major role apart from intensity and pitch. Similarly, for rating personality trait ‘Speaking Rate’, prosodic features computed related to first formant, third formant, total pause duration, percentage-breaks are more relevant.


Nonverbal behavior prediction Job interviews Prosodic features Regression 


  1. 1.
    Ambady, N., Rosenthal, R.: Half a minute: predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness. J. Pers. Soc. Psychol. 64(3), 431 (1993)CrossRefGoogle Scholar
  2. 2.
    Gottman, J., Markman, H., Notarius, C.: The topography of marital conflict: a sequential analysis of verbal and nonverbal behavior. J. Marriage Fam. 39, 461–477 (1977)CrossRefGoogle Scholar
  3. 3.
    Gottman, J.M.: The Mathematics of Marriage: Dynamic Nonlinear Models. MIT Press, Cambridge (2002)CrossRefGoogle Scholar
  4. 4.
    Hall, J.A., Roter, D.L., Blanch, D.C., Frankel, R.M.: Non-verbal sensitivity in medical students: implications for clinical interactions. J. Gen. Intern. Med. 24(11), 1217–1222 (2009)CrossRefGoogle Scholar
  5. 5.
    Huffcutt, A.I., Conway, J.M., Roth, P.L., Stone, N.J.: Identification and meta-analytic assessment of psychological constructs measured in employment interviews. J. Appl. Psychol. 86(5), 897 (2001)CrossRefGoogle Scholar
  6. 6.
    Posthuma, R.A., Morgeson, F.P., Campion, M.A.: Beyond employment interview validity: a comprehensive narrative review of recent research and trends over time. Pers. Psychol. 55(1), 1–81 (2002)CrossRefGoogle Scholar
  7. 7.
    Macan, T.: The employment interview: a review of current studies and directions for future research. Hum. Resour. Manage. Rev. 19(3), 203–218 (2009)CrossRefGoogle Scholar
  8. 8.
    Kapoor, A., Picard, R.W.: Multimodal affect recognition in learning environments. In: ACM Multimedia, pp. 677–682. ACM (2005)Google Scholar
  9. 9.
    Ambady, N., Rosenthal, R.: Thin slices of expressive behavior as predictors of interpersonal consequences: a meta-analysis. Psychol. Bull. 111, 256–274 (1992)CrossRefGoogle Scholar
  10. 10.
    Nass, C., Brave, S.: Voice activated: how people are wired for speech and how computers will speak with us. MIT Press (2004)Google Scholar
  11. 11.
    Gladwell, M.: The Tipping Point: How Little Things Can Make a Big Difference. Little Brown, New York (2006)Google Scholar
  12. 12.
    Khilnani, R.: Temporal Analysis of Stages in Negotiation. MEng Project, Advisor: A. Pentland (2004)Google Scholar
  13. 13.
    Sapir, E.: Selected Writings of Edward Sapir in Language, Culture and Personality, vol. 342. University of California Press, Berkeley (1985)Google Scholar
  14. 14.
    Vrij, A., Edward, K., Roberts, K.P., Bull, R.: Detecting deceit via analysis of verbal and nonverbal behavior. J. Nonverbal Behav. 24, 239 (2000)CrossRefGoogle Scholar
  15. 15.
    Hoque, M.E., Courgeon, M., Martin, J.-C., Mutlu, B., Picard, R.W.: MACH: my automated conversation coach. In: Ubicomp. ACM, pp. 697–706 (2013)Google Scholar
  16. 16.
    Sanchez-Cortes, D., Biel, J.-I., Kumano, S., Yamato, J., Otsuka, K., Gatica-Perez, D.: Inferring mood in ubiquitous conversational video. In: MUM, pp. 1–22. ACM (2013)Google Scholar
  17. 17.
    Ranganath, R., Jurafsky, D., McFarland, D.: It’s not you, it’s me: detecting flirting and its misperception in speeddates. In: Proceedings of EMNLP 2009, pp. 334–342. ACL (2009)Google Scholar
  18. 18.
    Ranganath, R., Jurafsky, D., McFarland, D.A.: Detecting friendly, flirtatious, awkward, and assertive speech in speeddates. Comput. Speech Lang. 27(1), 89–115 (2013)CrossRefGoogle Scholar
  19. 19.
    Zechner, K., Higgins, D., Xi, X., Williamson, D.M.: Automatic scoring of non-native spontaneous speech in tests of spoken English. Speech Commun. 51(10), 883–895 (2009)CrossRefGoogle Scholar
  20. 20.
    Boersma, P., Weenink, D.: Praat: doing phonetics by computer (version 5.1. 05) [bibcomputer program] (2009). Retrieved may 1, 2009Google Scholar
  21. 21.
    Shannon, C.E., Weaver, W.: The Mathematical Theory of Communication. University of Illinois Press, Urbana (1949)zbMATHGoogle Scholar
  22. 22.
    Naim, I., Iftekhar, T.M., Gildea, D., Hoque, M.E.: Automated analysis and prediction of job interview performance. IEEE Trans. Affect. Comput. 9(2), 191–204 (2018)CrossRefGoogle Scholar
  23. 23.
    Raykar, V.C., Yu, S., Zhao, L.H., Valadez, G.H., Florin, C., Bogoni, L., Moy, L.: Learning from crowds. J. Mach. Learn. Res. 11, 1297–1322 (2010)MathSciNetGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Rohit Mishra
    • 1
    Email author
  • Santosh Kumar Barnwal
    • 1
  • Shrikant Malviya
    • 1
  • Prasoon Mishra
    • 2
  • Uma Shanker Tiwary
    • 1
  1. 1.Indian Institute of Information Technology, AllahabadAllahabadIndia
  2. 2.Indian Institute of Information Technology Design and ManufacturingKurnoolIndia

Personalised recommendations