Skip to main content
SpringerLink
Log in

Recommendations from a Study of a Multimodal Positive Computing System for Public Speaking

  • Conference paper
  • First Online:
Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2018)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 997))

  • 528 Accesses

Abstract

We review some existing multimodal systems for Public Speaking. We then present two versions of a multimodal system for Public Speaking based on Positive Computing. The system uses the Microsoft Kinect to detect voice, body pose, facial expressions and gestures. The system is a real-time system, which gives users feedback on their performance while they are rehearsing a speech. We discuss a study comparing two versions of the system. One version displays a live video-stream of the user. The other displays a computer-generated avatar, which represents the user’s body movements and facial expressions. We discuss user reactions to both versions of the system and make recommendations for future multimodal systems for public speaking.

This material is based upon works supported by Dublin City University under the Daniel O’Hare Research Scholarship scheme. System prototypes were developed in collaboration with interns from École Polytechnique de l’Université Paris-Sud and l’École Supérieure d’Informatique, Électronique, Automatique (ESIEA) France.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://sigmla.org/mla2015/ApplicationGuidelines.pdf accessed on January 2016.

References

  1. Dwyer, K.K., Davidson, M.M.: Is public speaking really more feared than death? Commun. Res. Rep. 29, 99–107 (2012)

    Article  Google Scholar 

  2. McCroskey, J.C., Booth-Butterfield, S., Payne, S.K.: The impact of communication apprehension on college student retention and success. Commun. Q. 37, 100–107 (1989)

    Article  Google Scholar 

  3. Harris, S.R., Kemmerling, R.L., North, M.M.: Brief virtual reality therapy for public speaking anxiety. Cyberpsychol. Behav.: Impact Internet Multimed. Virtual Reality Behav. Soc. 5, 543–550 (2002)

    Article  Google Scholar 

  4. Toastmasters International: Gestures: Your Body Speaks (2011)

    Google Scholar 

  5. Dermody, F., Sutherland, A.: evaluating user responses to avatar and video speaker representations a multimodal positive computing system for public speaking. In: Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2018), Volume HUCAPP, Madeira, pp. pp. 38–43. INSTICC (2018)

    Google Scholar 

  6. Bubel, M., Jiang, R., Lee, C.H., Shi, W., Tse, A.: AwareMe: addressing fear of public speech through awareness. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 68–73. ACM (2016)

    Google Scholar 

  7. Batrinca, L., Stratou, G., Shapiro, A., Morency, L.-P., Scherer, S.: Cicero - towards a multimodal virtual audience platform for public speaking training. In: Aylett, R., Krenn, B., Pelachaud, C., Shimodaira, H. (eds.) IVA 2013. LNCS (LNAI), vol. 8108, pp. 116–128. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-40415-3_10

    Chapter  Google Scholar 

  8. Chollet, M., Morency, L.P., Shapiro, A., Scherer, S., Angeles, L.: Exploring feedback strategies to improve public speaking: an interactive virtual audience framework. In: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2015, pp. 1143–1154 (2015)

    Google Scholar 

  9. Chollet, M., Stefanov, K., Prendinger, H., Scherer, S.: Public speaking training with a multimodal interactive virtual audience framework - demonstration. In: Proceedings of the 2015 ACM International Conference on Multimodal Interaction, ICMI 2015, pp. 367–368 (2015)

    Google Scholar 

  10. Barmaki, R., Hughes, C.E.: Providing real-time feedback for student teachers in a virtual rehearsal environment. In: Proceedings of the 2015 ACM International Conference on Multimodal Interaction, ICMI 2015, pp. 531–537 (2015)

    Google Scholar 

  11. Barmaki, R.: Improving social communication skills using kinesics feedback. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA 2016, pp. 86–91. ACM, New York (2016)

    Google Scholar 

  12. Schneider, J., Börner, D., Van Rosmalen, P., Specht, M.: Presentation trainer, your public speaking multimodal coach. In: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction, pp. 539–546. ACM (2015)

    Google Scholar 

  13. Calvo, R.A., Peters, D.: Introduction to positive computing: technology that fosters wellbeing. In: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA 2015, pp. 2499–2500. ACM, New York (2015)

    Google Scholar 

  14. Calvo, R.A., Peters, D.: Positive Computing: Technology for Wellbeing and Human Potential. MIT Press, Cambridge (2014)

    Book  Google Scholar 

  15. Calvo, R.A., Peters, D.: Designing technology to foster psychological wellbeing. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA 2016, pp. 988–991. ACM, New York (2016)

    Google Scholar 

  16. Toastmasters International: Competent Communication A Practical Guide to Becoming a Better Speaker (2008)

    Google Scholar 

  17. Dowrick, P.W., Biggs, S.J.: Using Video: Psychological and Social Applications. Wiley, Hoboken (1983)

    Google Scholar 

  18. Dowrick, P.W.: A review of self modeling and related interventions. Appl. Prevent. Psychol. 8, 23–39 (1999)

    Article  Google Scholar 

  19. Garau, M.: Selective fidelity: investigating priorities for the creation of expressive avatars. In: Schroeder, R., Axelsson, A.S. (eds.) Avatars at Work and Play: Collaboration and Interaction in Shared Virtual Environments. Computer Supported Cooperative Work, pp. 17–38. Springer, Dordrecht (2006). https://doi.org/10.1007/1-4020-3898-4_2

    Chapter  Google Scholar 

  20. Pertaub, D.P., Slater, M., Barker, C.: An experiment on public speaking anxiety in response to three different types of virtual audience. Presence: Teleoper. Virtual Environ. 11, 68–78 (2002)

    Article  Google Scholar 

  21. Dermody, F., Sutherland, A.: Multimodal system for public speaking with real time feedback: a positive computing perspective. In: Proceedings of the 18th ACM International Conference on Multimodal Interaction, pp. 408–409. ACM (2016)

    Google Scholar 

  22. Calvo, R.A., Peters, D.: Positive computing: technology for a wiser world. Interactions 19, 28–31 (2012)

    Article  Google Scholar 

  23. Calvo, R.A., Peters, D., Johnson, D., Rogers, Y.: Autonomy in technology design. In: Proceedings of the Extended Abstracts of the 32nd Annual ACM Conference on Human Factors in Computing Systems - CHI EA 2014, pp. 37–40 (2014)

    Google Scholar 

  24. Baylor, A.L.: Promoting motivation with virtual agents and avatars: role of visual presence and appearance. Philos. Trans. Roy. Soc. London B: Biol. Sci. 364, 3559–3565 (2009)

    Article  Google Scholar 

  25. Suh, K.S., Kim, H., Suh, E.K.: What if your avatar looks like you? Dual-congruity perspectives for avatar use. MIS Q. 35, 711–729 (2011)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dublin City University, Dublin, Ireland

    Fiona Dermody & Alistair Sutherland

Authors
  1. Fiona Dermody
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alistair Sutherland
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Fiona Dermody or Alistair Sutherland .

Editor information

Editors and Affiliations

  1. University of Strasbourg, Strasbourg, France

    Dominique Bechmann

  2. University of Genoa, Genoa, Italy

    Manuela Chessa

  3. University of Lisbon, Lisbon, Portugal

    Ana Paula Cláudio

  4. Research Innovation Center, Apple Inc., San Jose, CA, USA

    Francisco Imai

  5. Linnaeus University, Växjö, Kronobergs Län, Sweden

    Andreas Kerren

  6. LISA - ISTIA, University of Angers, Angers, France

    Paul Richard

  7. University of Groningen, Groningen, The Netherlands

    Alexandru Telea

  8. Jean Monnet University, Saint-Etienne, France

    Alain Tremeau

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Dermody, F., Sutherland, A. (2019). Recommendations from a Study of a Multimodal Positive Computing System for Public Speaking. In: Bechmann, D., et al. Computer Vision, Imaging and Computer Graphics Theory and Applications. VISIGRAPP 2018. Communications in Computer and Information Science, vol 997. Springer, Cham. https://doi.org/10.1007/978-3-030-26756-8_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-26756-8_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-26755-1

  • Online ISBN: 978-3-030-26756-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation