An Interacting Decision Support System to Determine a Group-Member’s Role Using Automatic Behaviour Analysis

  • Basmah AlKadhiEmail author
  • Sharifa Alghowinem
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 858)


Group members have different attitudes and behavioural patterns that can be characterized using behavior analysis. Group managers and leaders at work, school, college and healthcare facilities are obligated to understand Group Dynamics in order to form the right productive team. In this research, we study the feasibility of automatically analyzing an individual’s behavior during an interaction setting using body language cues, in order to determine their best role in a team context. We approach this issue by obtaining non-verbal cues and using them as indicators to assess the widely used Big-Five personality traits. Our aim is to build a Decision Support System (DSS) that assists group and team leaders in allocating the members’ roles according to their behavioral characteristics. With the advancement on affective computing technologies, we believe that our work could achieve high performance accuracies that could then result in a generalized method to be later adopted in other relevant contexts.


Artificial intelligence (AI) Human-computer-interaction (HCI) Decision support system (DSS) Non-verbal behavior analysis 



This work was supported by the Human Computer Interaction Research Group; Prince Sultan University, Riyadh, Saudi Arabia [RG-CCIS-2017-06-01].


  1. 1.
    Admoni, H.: Nonverbal Communication for Human-Robot Interaction, vol. x, no. x, pp. 1–3 (2014)Google Scholar
  2. 2.
    Donnellan, M.B., Oswald, F.L., Baird, B.M., Lucas, R.E.: The mini-IPIP scales: tiny-yet-effective measures of the Big Five factors of personality. Psychol. Assess. 18(2), 192–203 (2006)CrossRefGoogle Scholar
  3. 3.
    Pal, M., Saha, S., Konar, A.: Distance Matching Based Gesture Recognition For Healthcare Using Microsoft’s Kinect Sensor, pp. 0–5 (2016)Google Scholar
  4. 4.
    Pease, A., Pease, B.: The Definitive Book of Body Language, p. 400. Bantam, New York (2006)Google Scholar
  5. 5.
    Heylen, D.: Challenges Ahead: head movements and other social acts in conversations. In: Virtual Social Agents, pp. 45–52 (2005)Google Scholar
  6. 6.
    Cassell, J., Stone, M., Steedman, M., Becket, T., Prevost, S.: Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents. In: Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, no. May, pp. 413–420 (1994)Google Scholar
  7. 7.
    McNeill, D.: Guide to Gesture Classification, Transcription and Distribution, pp. 75–104 (1992)Google Scholar
  8. 8.
    Burgoon, J., Buller, D., David, B., Hale, J., Turck, M.: Relational messages associated with nonverbal behaviors. Hum. Commun. Res. 10(3), 351–378 (1984)CrossRefGoogle Scholar
  9. 9.
    Givens, D.: The Nonverbal Dictionary of Gestures, Signs, and Body Language Cues (2002)Google Scholar
  10. 10.
    Ekman, P., Friesen, W.V.: The repertoire of nonverbal behavior: categories, origins, usage, and coding, pp. 49–98 (1969)Google Scholar
  11. 11.
    Naim, I., Tanveer, M.I., Gildea, D., Hoque, M.E.: Automated prediction and analysis of job interview performance: the role of what you say and how you say it. In: 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015 (2015)Google Scholar
  12. 12.
    Nguyen, L.S., Frauendorfer, D., Mast, M.S., Gatica-Perez, D.: Hire me: computational inference of hirability in employment interviews based on nonverbal behavior. IEEE Trans. Multimed. 16(4), 1018–1031 (2014)CrossRefGoogle Scholar
  13. 13.
    Batrinca, L.M., Mana, N., Lepri, B., Pianesi, F., Sebe, N.: Please, tell me about yourself. In: Proceedings of the 13th International Conference on Multimodal Interfaces - ICMI 2011, p. 255 (2011)Google Scholar
  14. 14.
    Pianesi, F., Mana, N., Cappelletti, A., Lepri, B., Zancanaro, M.: Multimodal recognition of personality traits in social interactions. In: Proceedings of the 10th International Conference on Multimodal Interfaces, pp. 53–60 (2008)Google Scholar
  15. 15.
    Zen, G., Lepri, B., Ricci, E., Lanz, O.: Space speaks – towards socially and personality aware visual surveillance. In: ACM International Workshop on Multimodal Pervasive Video Analysis, pp. 37–42 (2010)Google Scholar
  16. 16.
    Park, S., Gratch, J., Morency, L.-P.: I already know your answer: using nonverbal behaviors to predict immediate outcomes in a dyadic negotiation. In: The 14th ACM International Conference, pp. 19–22 (2012)Google Scholar
  17. 17.
    Lun, R., Zhao, W.: A survey of applications and human motion recognition with Microsoft Kinect. Int. J. Pattern Recognit. Artif. Intell. 29(05), 1555008 (2015)CrossRefGoogle Scholar
  18. 18.
    Liu, L., Mehrotra, S.: Patient walk detection in hospital room using Microsoft Kinect V2, pp. 4395–4398 (2016)Google Scholar
  19. 19.
    Patwardhan, A., Knapp, G.: Aggressive actions and anger detection from multiple modalities using Kinect (2016)Google Scholar
  20. 20.
    Ballester, J., Pheatt, C.: Using the Xbox Kinect sensor for positional data acquisition. Am. J. Phys. 81(1), 71 (2013)CrossRefGoogle Scholar
  21. 21.
    Vijendra, S., Shivani, P.: Robust Outlier Detection Technique in Data Mining: A Univariate Approach, arXiv preprint arXiv:1406.5074 (2014)
  22. 22.
    Hoeting, J., Raftery, A.E., Madigan, D.: A method for simultaneous variable selection and outlier identification in linear regression. Comput. Stat. Data Anal. 22(3), 251–270 (1996)CrossRefGoogle Scholar
  23. 23.
    Chandrashekar, G., Sahin, F.: A survey on feature selection methods. Comput. Electr. Eng. 40(1), 16–28 (2014)CrossRefGoogle Scholar
  24. 24.
    Wang, X., Tian, J.: A gene selection method for cancer classification. Comput. Math. Methods Med. 2012, 389–422 (2012)MathSciNetzbMATHGoogle Scholar
  25. 25.
    Jayagopi, D., Sanchez-Cortes, D., Otsuka, K., Yamato, J., Gatica-Perez, D.: Linking speaking and looking behavior patterns with group composition, perception, and performance. In: ICMI, p. 433 (2012)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.College of Computer and Information SciencesPrince Sultan UniversityRiyadhSaudi Arabia

Personalised recommendations