Bro-cam: Improving Game Experience with Empathic Feedback Using Posture Tracking

  • Chiew Seng Sean Tan
  • Johannes Schöning
  • Jan Schneider Barnes
  • Kris Luyten
  • Karin Coninx
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7822)


In todays videogames user feedback is often provided through raw statistics and scoreboards. We envision that incorporating empathic feedback matching the player’s current mood will improve the overall gaming experience. In this paper we present Bro-cam, a novel system that provides empathic feedback to the player based on their body postures. Different body postures of the players are used as an indicator for their openness. From their level of openness, Bro-cam profiles the players into different personality types ranging from introvert to extrovert. Empathic feedback is then automatically generated and matched to their preferences for certain humoristic feedback statements. We use a depth camera to track the player’s body postures and movements during the game and analyze these to provide customized feedback. We conducted a user study involving 32 players to investigate their subjective assessment on the empathic game feedback. Semi-structured interviews reveal that participants were positive about the empathic feedback and Bro-cam significantly improves their game experience.


Affective State Personality Type Game Experience Kinect Sensor Depth Camera 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aviezer, H., Trope, Y., Todorov, A.: Body cues, not facial expressions, discriminate between intense positive and negative emotions. Science 338(6111), 1225–1229 (2012)CrossRefGoogle Scholar
  2. 2.
    Berkovsky, S., Bhandari, D., Kimani, S., Colineau, N., Paris, C.: Designing Games to Motivate Physical Activity. In: PERSUASIVE 2009 - Persuasive Technology, Fourth International Conference, pp. 37–40. Springer, Heidelberg (2009)Google Scholar
  3. 3.
    Bickmore, T., Gruber, A., Picard, R.: Establishing the computer-patient working alliance in automated health behavior change interventions. Patient Education and Counseling 59, 21–30 (2005)CrossRefGoogle Scholar
  4. 4.
    Blumenfeld, R.: Tools and Techniques for Character Interpretation: A Handbook of Psychology for Actors, Writers, and Directors, pp. 115–128. Limelight Editions (2006)Google Scholar
  5. 5.
    Csikszentmihalyi, M.: Flow: The Psychology of Optimal Experience. Harper Perennial, New York (1990)Google Scholar
  6. 6.
    Dekker, A., Champion, E.: Please Biofeed the Zombies: Enhancing the Gameplay and Display of a Horror Game Using Biofeedback. In: Proc. of DiGRA (2007)Google Scholar
  7. 7.
    Eysenck, S., Eysenck, H.J., Barrett, P.: A revised version of the psychoticism scale. Personality and Individual Differences 6, 21–29 (1985)CrossRefGoogle Scholar
  8. 8.
    Gamberini, L., Spagnolli, A., Corradi, N., Jacucci, G., Tusa, G., Mikkola, T., Zamboni, L., Hoggan, E.: Tailoring Feedback to Users’ Actions in a Persuasive Game for Household Electricity Conservation. In: Bang, M., Ragnemalm, E.L. (eds.) PERSUASIVE 2012. LNCS, vol. 7284, pp. 100–111. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  9. 9.
    Gaver, W.: Designing for emotion (among other things). Philosophical Transactions of the Royal Society 364, 3597–3604 (2009)CrossRefGoogle Scholar
  10. 10.
    Gilleade, K., Dix, A., Allanson, J.: Affective Videogames and Modes of Affective Gaming: Assist Me, Challenge Me, Emote Me. In: Proc. of DiGRA, pp. 16–20 (2005)Google Scholar
  11. 11.
    Höök, K.: Affective Loop Experiences – What Are They? In: Oinas-Kukkonen, H., Hasle, P., Harjumaa, M., Segerståhl, K., Øhrstrøm, P. (eds.) PERSUASIVE 2008. LNCS, vol. 5033, pp. 1–12. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  12. 12.
    Kuikkaniemi, K., Laitinen, T., Turpeinen, M., Saari, T., Kosunen, I., Ravaja, N.: The influence of implicit and explicit biofeedback in first-person shooter games. In: Proc. of CHI 2010, pp. 859–868. ACM Press (2010)Google Scholar
  13. 13.
    Pantic, M., Caridakis, G., André, E., Kim, J., Karpouzis, K., Kollias, S.: Multimodal emotion recognition from low-level cues. In: Cowie, R., Petta, P., Pelachaud, C. (eds.) Emotion-Oriented System, pp. 115–132. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  14. 14.
    Nacke, L.E., Kalyn, M., Lough, C., Mandryk, R.L.: Biofeedback game design: using direct and indirect physiological control to enhance game interaction. In: Proc. of CHI 2011, pp. 103–112. ACM Press (2011)Google Scholar
  15. 15.
    Pfeifer, B.: Narrative Combat: Using AI to enhance tension in an Action Game. In: Kirmse, A. (ed.) Game Programming Gems 4, pp. 315–324. Charles River Media (2004)Google Scholar
  16. 16.
    Picard, R.W.: Affective Computing. MIT Press, Cambridge (2000)Google Scholar
  17. 17.
    Picard, R.W.: Affective Computing: Challenges. International Journal of Human-Computer Studies 59(1-2), 55–64 (2003)CrossRefGoogle Scholar
  18. 18.
    Strapparava, C., Stock, O., Mihalcea, R.: Computational humour. In: Cowie, R., Petta, P., Pelachaud, C. (eds.) Emotion-Oriented Systems, pp. 609–634. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  19. 19.
    Tan, S., Schöning, J., Luyten, K., Coninx, K.: Informing Intelligent User Interfaces by Inferring Affective States from Body Postures in Ubiquitous Computing Environments. In: Proc. of IUI 2013. ACM Press (2013)Google Scholar
  20. 20.
    Tapus, A., Tapus, C., Matarić, M.J.: User-Robot Personality Matching and Robot Behavior Adaptation for Post-Stroke Rehabilitation Therapy. Intelligent Service Robotics Journal, 169–183 (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Chiew Seng Sean Tan
    • 1
  • Johannes Schöning
    • 1
  • Jan Schneider Barnes
    • 1
  • Kris Luyten
    • 1
  • Karin Coninx
    • 1
  1. 1.tUL – iMinds Expertise Centre for Digital MediaHasselt UniversityDiepenbeekBelgium

Personalised recommendations