Skip to main content
SpringerLink
Log in
Book cover

International Conference on Intelligent Virtual Agents

IVA 2017: Intelligent Virtual Agents pp 315–324Cite as

Effect of Visual Feedback Caused by Changing Mental States of the Avatar Based on the Operator’s Mental States Using Physiological Indices

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10498))

Abstract

Use of a virtual environment allows rehearsal or practice in specialized situations, extraordinary environments, or circumstances in which mistakes are not allowed. However, virtual experiences often do not translate to the real world. We propose to regard a virtual avatar as an agent which mediates between virtual experiences and the real ones. The aim of this study is to investigate how to enhance the effect of virtual experiences. To achieve this, we propose a method of providing feedback on human mental state by using affective avatar expressions based on physiological indices. We conduct experiments to evaluate the effect of the method. As a result, we find that feedback from avatar expressions can increase participants’ physiological responses without reducing concentration on the task. We suggest that this feedback can enhance commitment to virtual-world experiences.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Graafland, M., Schraagen, J., Schijven, M.: Systematic review of serious games for medical education and surgical skills training. British Journal of Surgery 99(10), 1322–1330 (2012)

    Article  Google Scholar 

  2. Katmada, A., Mavridis, A., Apostolidis, H., Tsiatsos, T.: Developing an adaptive serious game based on students’ bio-feedback. In: 6th International Conference on Information, Intelligence, Systems and Applications (IISA), pp. 1–6 (2015)

    Google Scholar 

  3. Lin, T., Omata, M., Hu, W., Imamiya, A.: Do physiological data relate to traditional usability indexes? In: Proceedings of the 17th Australia Conference on Computer-Human Interaction: Citizens Online: Considerations for Today and the Future, pp. 1–10 (2005)

    Google Scholar 

  4. Mandryk, R.L., Inkpen, K.M.: Physiological indicators for the evaluation of co-located collaborative play. In: Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work, pp. 102–111 (2004)

    Google Scholar 

  5. Mokka, S., Väätänen, A., Heinilä, J., Välkkynen, P.: Fitness computer game with a bodily user interface. In: Proceedings of the Second International Conference on Entertainment Computing, pp. 1–3. Carnegie Mellon University (2003)

    Google Scholar 

  6. Ohmoto, Y., Kataoka, M., Nishida, T.: The effect of convergent interaction using subjective opinions in the decision-making process. In: Proc. the 36th Annual Conference of the Cognitive Science Society, pp. 2711–2716 (2014)

    Google Scholar 

  7. Ohmoto, Y., Takeda, S., Nishida, T.: Distinction of intrinsic and extrinsic stress in an exercise game by combining multiple physiological indices. In: 2015 7th International Conference on Games and Virtual Worlds for Serious Applications (VS-Games), pp. 1–4 (2015)

    Google Scholar 

  8. Rego, P., Moreira, P.M., Reis, L.P.: Serious games for rehabilitation: a survey and a classification towards a taxonomy. In: 5th Iberian Conference on Information Systems and Technologies (CISTI), pp. 1–6. IEEE (2010)

    Google Scholar 

  9. Rosenberg, R.S., Baughman, S.L., Bailenson, J.N.: Virtual superheroes: Using superpowers in virtual reality to encourage prosocial behavior. PloS One 8(1), e55003 (2013)

    Article  Google Scholar 

  10. Yucha, C., Montgomery, D.: Evidence-based practice in biofeedback and neurofeedback. AAPB, Wheat Ridge (2008)

    Google Scholar 

  11. Zotev, V., Phillips, R., Yuan, H., Misaki, M., Bodurka, J.: Self-regulation of human brain activity using simultaneous real-time fmri and eeg neurofeedback. NeuroImage 85, 985–995 (2014)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Graduate School of Infomatics, Kyoto University, Yoshidahonmachi, Sakyo-ku, Kyoto-shi, Kyoto-hu, Japan

    Yoshimasa Ohmoto, Seiji Takeda & Toyoaki Nishida

Authors
  1. Yoshimasa Ohmoto
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Seiji Takeda
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Toyoaki Nishida
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yoshimasa Ohmoto .

Editor information

Editors and Affiliations

  1. KTH Royal Institute of Technology, Stockholm, Sweden

    Jonas Beskow

  2. KTH Royal Institute of Technology, Stockholm, Sweden

    Christopher Peters

  3. Uppsala University, Uppsala, Sweden

    Ginevra Castellano

  4. Trinity College, Dublin, Ireland

    Carol O'Sullivan

  5. KTH Royal Institute of Technology, Stockholm, Sweden

    Iolanda Leite

  6. University of Bielefeld, Bielefeld, Germany

    Stefan Kopp

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Ohmoto, Y., Takeda, S., Nishida, T. (2017). Effect of Visual Feedback Caused by Changing Mental States of the Avatar Based on the Operator’s Mental States Using Physiological Indices. In: Beskow, J., Peters, C., Castellano, G., O'Sullivan, C., Leite, I., Kopp, S. (eds) Intelligent Virtual Agents. IVA 2017. Lecture Notes in Computer Science(), vol 10498. Springer, Cham. https://doi.org/10.1007/978-3-319-67401-8_40

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-67401-8_40

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-67400-1

  • Online ISBN: 978-3-319-67401-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation