Posture Based Detection of Attention in Human Computer Interaction

  • Patrick Heyer
  • Javier Herrera-Vega
  • Dan-El N. Vila Rosado
  • Luis Enrique Sucar
  • Felipe Orihuela-Espina
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8333)


Unacted posture conveys cues about people’s attentional disposition. We aim to identify robust markers of attention from posture while people carry out their duties seated in front of their computers at work. Body postures were randomly captured from 6 subjects while at work using a Kinect, and self-assessed as attentive or not attentive. Robust postural features exhibiting higher discriminative power across classification exercises with 4 well-known classifiers were identified. Average classification of attention from posture reached 76.47%±4.58% (F-measure). A total of 40 postural features were tested and those proxy of head tilt were found to be the most stable markers of attention in seated conditions based upon 3 class separability criteria. Unobtrusively monitoring posture of users while working in front of a computer can reliably be used to infer attentional disposition from the user. Human-computer interaction systems can benefit from this knowledge to customize the experience to the user changing attentional state.


attention human-computer interaction posture 


  1. 1.
    Ekman, P., Friesen, W.V.: The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica 1, 49–98 (1969)Google Scholar
  2. 2.
    Castellano, G., Villalba, S.D., Camurri, A.: Recognising Human Emotions from Body Movement and Gesture Dynamics. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 71–82. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  3. 3.
    Kapoor, A., Mota, S., Picard, R.W.: Towards a learning companion that recognizes affect. In: AAAI Fall Symposium (2001)Google Scholar
  4. 4.
    D’Mello, S., Jackson, T., Craig, S., Morgan, B., Chipman, P., White, H., Person, N., Kort, B., El-Kaliouby, R., Picard, R., Graesser, A.: AutoTutor Detects and Responds to Learners Affective and Cognitive States. In: Proceedings of the Workshop on Emotional and Cognitive Issues in ITS in Conjunction with the 9th International Conference on Intelligent Tutoring Systems, p. 13 (2008)Google Scholar
  5. 5.
    Escalante, H.J., Montes, M., Sucar, L.E.: Journal of Machine Learning Research 10, 405–440 (2009)Google Scholar
  6. 6.
    D’Mello, S.K., Graesser, A.C.: Mining Bodily Patterns of Affective Experience during Learning. In: de Baker, R.S.J., Merceron, A., Pavlik, P.I. (eds.) The 3rd International Conference on Educational Data Mining (EDM), Pittsburgh, PA, USA, June 11-13 (2010)Google Scholar
  7. 7.
    Mota, S., Picard, R.W.: Automated Posture Analysis for Detecting Learner’s Interest Level. In: Computer Vision and Pattern Recognition Workshop (2003)Google Scholar
  8. 8.
    Sanghvi, J., Castellano, G., Leite, I., Pereira, A., McOwan, P.W., Paiva, A.: Automatic analysis of affective postures and body motion to detect engagement with a game companion. In: Billard, A., Jr., P. H. K., Adams, J. A., Trafton, J. G (Eds.) Proceedings of the 6th International Conference on Human Robot Interaction (HRI) Lausanne, Switzerland, March 6-9, pp. 305–312 (2011)Google Scholar
  9. 9.
    Grafsgaard, J.F., Boyer, K.E., Wiebe, E.N., Lester, J.C.: Analyzing Posture and Affect in Task-Oriented Tutoring. In: Youngblood, G.M., McCarthy, P.M. (eds.) Proceedings of the Twenty-Fifth International Florida Artificial Intelligence Research Society Conference (FLAIRS), Marco Island, Florida, May 23-25. AAAI Press (2012)Google Scholar
  10. 10.
  11. 11.
    Weka Machine Learning Project Weka University of Waikato,
  12. 12.
    Hall, M.A.: Correlation-based Feature Subset Selection for Machine Learning. Hamilton, New Zealand (1998)Google Scholar
  13. 13.
    Liu, H., Setiono, R.: A probabilistic approach to feature selection - A filter solution. In: 13th International Conference on Machine Learning, pp. 319–327 (1996)Google Scholar
  14. 14.
    John, G.H., Langley, P.: Estimating Continuous Distributions in Bayesian Classifiers. In: Eleventh Conference on Uncertainty in Artificial Intelligence, San Mateo, pp. 338–345 (1995)Google Scholar
  15. 15.
    Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Machine Learning 29(2-3), 131–163 (1997)CrossRefzbMATHGoogle Scholar
  16. 16.
    Witten, I.H., Frank, E., Hall, M.A.: Data Mining: Practical Machine Learning Tools and Techniques, 3rd edn. Morgan Kaufmann, Burlington (2011)Google Scholar
  17. 17.
    Cortes, C., Vapnik, V.N.: Support-Vector Networks. Machine Learning 20 (1995)Google Scholar
  18. 18.
    R statistical package,

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  • Patrick Heyer
    • 1
  • Javier Herrera-Vega
    • 1
  • Dan-El N. Vila Rosado
    • 1
  • Luis Enrique Sucar
    • 1
  • Felipe Orihuela-Espina
    • 1
  1. 1.Optics and ElectronicsNational Institute for AstrophysicsSta. Maria TonantzintlaMexico

Personalised recommendations