Skip to main content
SpringerLink
Log in
Book cover

International Simulation and Gaming Association Conference

Annual Simulation Technology and Training Conference

ISAGA 2016, SimTecT 2016: Intersections in Simulation and Gaming pp 222–236Cite as

Making Virtual Sense: Display Type and Narrative Medium Influence Sensemaking in Virtual Environments

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10711))

Abstract

Virtual reality (VR) is being used for training and research in various industries due to its greater immersion relative to flat screen simulation technology. However, the effect of immersive VR displays and background storylines (i.e., narrative) on metacognitive skills, such as sensemaking, remains unexplored. The current study employed a 2  ×  2 between-subjects experimental design to investigate the influence of display type and narrative medium on sensemaking for an observation-based driving task. Sixty-eight adults were semi-randomly assigned to one of four conditions. Participants received a pre-mission narrative briefing (text or multimedia) and undertook two simulated driving missions (flat screen or VR display). A structured debriefing followed each mission to assess sensemaking in terms of frequency and type of explanation for mission events. The results indicate that both display type and narrative medium influence sensemaking in virtual environments. For explanations relating to previously encountered mission events, sensemaking frequency was higher in the VR conditions than the flat screen conditions (F(1) = 9.11, p = .004, partial η2 = .15). For explanations relating to the briefing materials, sensemaking frequency was higher in the multimedia narrative conditions than the text-based narrative conditions (F(1) = 8.38, p = .005, partial η2 = .14). Although the findings suggest that VR displays have cognitive benefits over traditional flat screen displays, the likelihood of VR-induced adverse effects (i.e., cybersickness) should be managed (e.g., limiting exposure). These results indicate that narrative medium and display type should be carefully considered by industries using virtual environments for training and research.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Ancona, D.: Sensemaking, framing and acting in the unknown. In: Snook, S., Norhia, N., Khurana, R. (eds.) The Handbook for Teaching Leadership: Knowing, Doing and Being, pp. 1–19. Sage Publications, Los Angeles, CA (2012)

    Google Scholar 

  2. Bambrick, S., Whitbred, R., Skalski, P., Bracken, C.: Is text always superior to video? Investigating the impact of moving images, standard video, and text on presence. In: Proceedings of the Presence Live! Conference. International Society for Presence Research, Philadelphia, USA (2012)

    Google Scholar 

  3. Belanich, J., Mullin, L.N., Dressel, J.D.: Symposium on PC-based simulations and gaming for military training (ARI Research Product 200–01). U.S. Army Research Institute for the Behavioral and Social Sciences, Arlington, V.A. (2004)

    Google Scholar 

  4. Bohemia Interactive Simulations. https://bisimulations.com/. Accessed 15 August 2015

  5. Bruck, S., Watters, P.A.: Estimating cybersickness of simulated motion using the simulator sickness questionnaire (SSQ): a controlled study. In: Proceedings of the 2009 Sixth International Conference on Computer Graphics, Imaging and Visualization, pp. 486–488. IEEE Computer Society, Los Alamitos, California (2009)

    Google Scholar 

  6. Brunner, C., Fidock, J.J.T., Temby, P., Whitney, S.J.: Examining the effect of simulator fidelity on task performance and training transfer with an ICT device. In: SimTecT 2015 Conference Proceedings, pp. 183–191. Simulation Australasia, Adelaide, SA (2015)

    Google Scholar 

  7. Chapman, P., Selvarajah, S., Webster, J.: Engagement in multimedia training systems. In: Proceedings of the 32nd Hawaii International Conference on System Sciences, pp. 1–9. IEEE Press, Washington, DC (1999)

    Google Scholar 

  8. Choi, S.S., Jung, K., Noh, S.D.: Virtual reality applications in manufacturing industries: past research, present findings, and future directions. Concur. Eng. Res. Appl. 23(1), 40–63 (2015)

    Article  Google Scholar 

  9. Cohen, J.: A coefficient of agreement for nominal scales. Educ. Psychol. Measur. 20, 37–46 (1960)

    Article  Google Scholar 

  10. Diemer, J., Alpers, G.W., Peperkorn, H.M., Shiban, Y., Műhlberger, A.: The impact of perception and presence on emotional reactions: a review of research in virtual reality. Front. in Psychol. 6(26), 1–9 (2015)

    Google Scholar 

  11. Dunston, P.S., Proctor, R.W., Wang, X.: Challenges in evaluating skill transfer from construction equipment simulators. Theor. Issues Ergon. Sci. 15(4), 354–375 (2014)

    Article  Google Scholar 

  12. Endsley, M.R.: Toward a theory of situation awareness in dynamic systems. Hum. Factors 37(1), 32–64 (1995)

    Article  Google Scholar 

  13. Endsley, M.R.: Situation awareness misconceptions and misunderstandings. J. Cogn. Eng. Decis. Making 9(1), 4–32 (2015)

    Article  Google Scholar 

  14. Endsley, M.R., Jones, D.G.: Designing for Situation Awareness: An Approach to Human-Centered Design, 2nd edn. Taylor and Francis, London (2012)

    Google Scholar 

  15. Fiore, S.M., Johnston, J., McDaniel, R.: Applying the narrative form and XML metadata to debriefing simulation-based exercises. In: Proceedings of the 49th Annual Meeting of the Human Factors and Ergonomics Society, pp. 2135–2139. Human Factors and Ergonomics Society, Santa Monica, CA (2005)

    Google Scholar 

  16. Gibson, R.: Narrative sense-making in complex scenarios seminar. In: Simulation Australasia, Canberra, ACT (2015)

    Google Scholar 

  17. Golding, J.F.: Predicting individual differences in motion sickness susceptibility by questionnaire. Pers. Individ. Differ. 41(2), 237–248 (2006)

    Article  Google Scholar 

  18. Grabowski, A., Jankowski, J.: Virtual reality-based pilot training for underground coal miners. Saf. Sci. 72, 310–314 (2015)

    Article  Google Scholar 

  19. Kennedy, R., Lane, N., Berbaum, K., Lilienthal, M.: Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. Int. J. Aviat. Psychol. 3(3), 203–220 (1993)

    Article  Google Scholar 

  20. Knerr, B.W.: Immersive simulation training for the dismounted soldier. U.S. Army Research Institute for the Behavioral and Social Sciences, Orlando, FL (2007)

    Google Scholar 

  21. Lee, E.A.-L., Wong, K.W.: Learning with desktop virtual reality: low spatial ability learners are more positively correlated. Comput. Educ. 79, 49–58 (2014)

    Article  Google Scholar 

  22. Maitlis, S., Christianson, M.: Sensemaking in organizations: taking stock and moving forward. Acad. Manag. Ann. 8(1), 57–125 (2014)

    Article  Google Scholar 

  23. Marion, N., Septseault, C., Boudinot, A., Querrec, R.: GASPAR: aviation management on aircraft carrier using virtual reality. In: 2007 International Conference on Cyberworlds, pp. 15–22. IEEE Computer Society, Hanover, Germany (2007)

    Google Scholar 

  24. Morris, C.S., Hancock, P.A., Shirkey, E.C.: Motivational effects of adding context relevant stress in PC-based game training. Mil. Psychol. 16(2), 135–147 (2004)

    Article  Google Scholar 

  25. Patrey, J., Breaux, R., Andrew, M., Sheldon, E.: What is essential for virtual reality to meet military performance goals? Performance measurement in VR. In: Research and Technology Organization Human Factors and Medicine Panel Workshop Meeting Proceedings. North Atlantic Treaty Organization, The Hague, The Netherlands (2001)

    Google Scholar 

  26. Riener, R., Harders, M.: Virtual reality in Medicine. Springer, London (2012). https://doi.org/10.1007/978-1-4471-4011-5

    Book  Google Scholar 

  27. Seitz, C.A., Poyrazli, S., Harrison, M.A., Flickinger, T., Turkson, M.: Virtual reality exposure therapy for military veterans with posttraumatic stress disorder: a systematic review. New Sch. Psychol. Bull. 11(1), 14–29 (2014)

    Google Scholar 

  28. Slater, M., Wilbur, S.: A framework for immersive virtual environments (FIVE): speculations on the role of presence in virtual environments. Presence: Teleoperators Virtual Environ. 6(6), 603–616 (1997)

    Article  Google Scholar 

  29. Stevens, J.A., Kincaid, J.P.: The relationship between presence and performance in virtual simulation training. Open J. Model. Simul. 3, 41–48 (2015)

    Article  Google Scholar 

  30. Stokes, M., Johnson, K., Fidock, J., Delfabbro, P.: The effect of accumulated sleep loss on usability of digital command and control technology. J. Battlefield Technol. 18(1), 31–38 (2015)

    Google Scholar 

  31. Stone, R.J.: Whatever happened to virtual reality? Inf. Prof. 1(4), 12–15 (2004)

    Article  Google Scholar 

  32. Taylor, G.S., Barnett, J.S.: Evaluation of wearable simulation interface for military training. Hum. Factors 55(3), 672–690 (2013)

    Article  Google Scholar 

  33. The OBS Project. https://obsproject.com/. Accessed 31 August 2015

  34. Weick, K.E.: The Social Psychology of Organizing, 2nd edn. McGraw-Hill, New York (1979)

    Google Scholar 

  35. Weick, K.E.: The collapse of sensemaking in organizations: the Mann Gulch disaster. Adm. Sci. Q. 38(4), 628–652 (1993)

    Article  Google Scholar 

  36. Weick, K.E.: Sensemaking in Organizations. Sage Publications, Thousand Oaks (1995)

    Google Scholar 

  37. Whitney, S.J., Fidock, J.J.T., Ferguson, N.: Assessing the effectiveness of simulation-based counter-IED training. J. Battlefield Technol. 15(1), 57–64 (2012)

    Google Scholar 

  38. Wiederhold, M.D.: Physiological monitoring during simulation training and testing. U.S. Army Research Office, Durham, NC (2005)

    Google Scholar 

  39. Youngblut, C., Huie, O.: The relationship between presence and performance in virtual environments: results of a VERTS study. In: Proceedings of IEEE Virtual Reality Conference 2003, pp. 277–278. IEEE Computer Society Press, Los Angeles, CA (2003)

    Google Scholar 

Download references

Acknowledgements

This research was funded by the Australian Army’s Land 400 Project. The research project was conducted by the first author at the Defence Science and Technology Group in partial fulfilment of the degree of Master of Psychology (Organisational and Human Factors) at the University of Adelaide. At the time of publication, the first author is now solely employed by Consilium Technology Pty Ltd. The authors would also like to acknowledge the study participants for their time and valuable contributions.

Author information

Authors and Affiliations

  1. Consilium Technology Pty Ltd, 1102/147 Pirie Street, Adelaide, SA, 5000, Australia

    Sarah J. Hibbard

  2. Defence Science and Technology Group, Third Avenue, Edinburgh, SA, 5111, Australia

    Susannah J. Whitney, Laura Carter, Justin J. T. Fidock & Philip Temby

  3. Rheinmetall Simulation Australia, 108 King William Street, Adelaide, SA, 5000, Australia

    Luke Thiele

Authors
  1. Sarah J. Hibbard
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Susannah J. Whitney
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Laura Carter
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Justin J. T. Fidock
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Philip Temby
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Luke Thiele
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sarah J. Hibbard .

Editor information

Editors and Affiliations

  1. Central Queensland University, Wayville, South Australia, Australia

    Anjum Naweed

  2. Kozminski University, Warsaw, Poland

    Marcin Wardaszko

  3. FutureSearch, Tempe, New South Wales, Australia

    Elyssebeth Leigh

  4. KTH Royal Institute of Technology, Stockholm, Sweden

    Sebastiaan Meijer

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hibbard, S.J., Whitney, S.J., Carter, L., Fidock, J.J.T., Temby, P., Thiele, L. (2018). Making Virtual Sense: Display Type and Narrative Medium Influence Sensemaking in Virtual Environments. In: Naweed, A., Wardaszko, M., Leigh, E., Meijer, S. (eds) Intersections in Simulation and Gaming. ISAGA SimTecT 2016 2016. Lecture Notes in Computer Science(), vol 10711. Springer, Cham. https://doi.org/10.1007/978-3-319-78795-4_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-78795-4_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-78794-7

  • Online ISBN: 978-3-319-78795-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation