Skip to main content

VR Invite: A Project-Independent Smartphone App for VR Observation and Interactivity

  • Conference paper
  • First Online:
Human-Computer Interaction – INTERACT 2021 (INTERACT 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12932))

Included in the following conference series:

Abstract

Virtual Reality (VR) is a promising immersive technology, which provides users with place and plausibility illusions in a virtual environment (VE). However, current immersive experiences are often limited to those users wearing a VR head-mounted display (HMD). In this paper we present VR Invite, a project-independent smartphone app, which allows multiple non-immersive bystanders to observe and interact with the VE and the HMD users. Our system renders multiple view ports of the scene on a host computer, and transmits the data via wireless local network to the mobile devices. Furthermore, the position and orientation of the smartphones is tracked to change the viewpoints accordingly.

We conducted a user study with 26 participants in the context of rehabilitation for older adults in retirement homes, with a focus on bystander integration. In the study, a VR user had to play multiple rounds of a memory game, while a bystander provided support. We compared VR Invite with a TV-gamepad-combination as interaction medium for the support role regarding sense of presence, social presence, workload and usability, both with purely verbal and active assistance capabilities. The results indicate that the opportunity for direct interaction positively influences the bystander’s sense of presence in the VE and the reported usability of the Smartphone app. However, social presence was rated higher in passive conditions in which the real person was the center of attention, as opposed to the avatar on the screen. Furthermore, users valued the comfort of sitting down over active participation and agency with room-scale movement.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Github: VR Invite Source Code (2021). https://github.com/uhhhci/VRInvite. accessed 18 Jan 2021

  2. Google: ARCore Overview (2021). https://developers.google.com/ar/discover. Accessed 18 Jan 2021

  3. Master of Shapes: Mobile Room Scale (2021). https://masterofshapes.com/work/cover-me/. Accessed 18 Jan 2021

  4. Owlchemy Labs: Mobile Spectator (2021). https://owlchemylabs.com/owlchemy-mobile-spectator-ar-spectator-camera/. Accessed 18 Jan 2021

  5. Bangor, A., Kortum, P., Miller, J.: Determining what individual SUS scores mean: adding an adjective rating scale. J. Usability Stud. 4(3), 114–123 (2009)

    Google Scholar 

  6. Billinghurst, M., Kato, H.: Collaborative augmented reality. Commun. ACM 45(7), 64–70 (2002). https://doi.org/10.1145/514236.514265

    Article  Google Scholar 

  7. Billinghurst, M., Poupyrev, I., Kato, H., May, R.: Mixing realities in shared space: an augmented reality interface for collaborative computing. In: 2000 IEEE International Conference on Multimedia and expo, ICME 2000, Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No. 00TH8532), vol. 3, pp. 1641–1644. IEEE (2000)

    Google Scholar 

  8. Biocca, F., Harms, C.: Networked minds social presence inventory:|(scales only, version 1.2) measures of co-presence, social presence, subjective symmetry, and intersubjective symmetry (2003)

    Google Scholar 

  9. Biocca, F., Harms, C., Gregg, J.: The networked minds measure of social presence: pilot test of the factor structure and concurrent validity. In: 4th Annual International Workshop on Presence, Philadelphia, PA, pp. 1–9 (2001)

    Google Scholar 

  10. Brooke, J., et al.: SUS-a quick and dirty usability scale. Usability Eval. Ind. 189(194), 4–7 (1996)

    Google Scholar 

  11. Carlsson, C., Hagsand, O.: Dive a multi-user virtual reality system. In: Proceedings of IEEE Virtual Reality Annual International Symposium, pp. 394–400. IEEE (1993)

    Google Scholar 

  12. Cecil, J., Ramanathan, P., Rahneshin, V., Prakash, A., Pirela-Cruz, M.: Collaborative virtual environments for orthopedic surgery. In: 2013 IEEE International Conference on Automation Science and Engineering (CASE), pp. 133–137. IEEE (2013)

    Google Scholar 

  13. Churchill, E.F., Snowdon, D.: Collaborative virtual environments: an introductory review of issues and systems. Virtual Reality 3(1), 3–15 (1998)

    Article  Google Scholar 

  14. Coninx, K., Van Reeth, F., Flerackers, E.: A hybrid 2D/3D user interface for immersive object modeling. In: Proceedings Computer Graphics International, pp. 47–55. IEEE (1997)

    Google Scholar 

  15. Dedual, N.J., Oda, O., Feiner, S.K.: Creating hybrid user interfaces with a 2D multi-touch tabletop and a 3D see-through head-worn display. In: 2011 10th IEEE International Symposium on Mixed and Augmented Reality, pp. 231–232. IEEE (2011)

    Google Scholar 

  16. Duval, T., Fleury, C.: An asymmetric 2D pointer/3D ray for 3D interaction within collaborative virtual environments. In: Proceedings of the 14th International Conference on 3D Web Technology, pp. 33–41 (2009)

    Google Scholar 

  17. Gugenheimer, J., Stemasov, E., Frommel, J., Rukzio, E.: ShareVR: enabling colocated experiences for virtual reality between HMD and Non-HMD users. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 4021–4033 (2017)

    Google Scholar 

  18. Gugenheimer, J., Stemasov, E., Sareen, H., Rukzio, E.: FaceDisplay: towards asymmetric multi-user interaction for nomadic virtual reality. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–13 (2018)

    Google Scholar 

  19. Hart, S.G., Staveland, L.E.: Development of NASA-TLX (task load index): results of empirical and theoretical research. Adv. Psychol. 52, 139–183 (1988)

    Article  Google Scholar 

  20. Hodge, E.M., Tabrizi, M., Farwell, M.A., Wuensch, K.L.: Virtual reality classrooms: strategies for creating a social presence. Int. J. Soc. Sci. 2(2), 105–109 (2008)

    Google Scholar 

  21. Holm, R., Stauder, E., Wagner, R., Priglinger, M., Volkert, J.: A combined immersive and desktop authoring tool for virtual environments. In: Proceedings IEEE Virtual Reality 2002, pp. 93–100. IEEE (2002)

    Google Scholar 

  22. Ibayashi, H., et al.: Dollhouse VR: a multi-view, multi-user collaborative design workspace with VR technology. In: SIGGRAPH Asia 2015 Emerging Technologies, pp. 1–2 (2015)

    Google Scholar 

  23. Jones, B., et al.: RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units. In: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, pp. 637–644 (2014)

    Google Scholar 

  24. Kallioniemi, P., Ronkainen, K., Karhu, J., Sharma, S., Hakulinen, J., Turunen, M.: CityCompass VR - a collaborative virtual language learning environment. In: Lamas, D., Loizides, F., Nacke, L., Petrie, H., Winckler, M., Zaphiris, P. (eds.) INTERACT 2019. LNCS, vol. 11749, pp. 540–543. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29390-1_33

    Chapter  Google Scholar 

  25. Lindley, S.E., Le Couteur, J., Berthouze, N.L.: Stirring up experience through movement in game play: effects on engagement and social behaviour. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 511–514 (2008)

    Google Scholar 

  26. Oda, O., Elvezio, C., Sukan, M., Feiner, S., Tversky, B.: Virtual replicas for remote assistance in virtual and augmented reality. In: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, pp. 405–415 (2015)

    Google Scholar 

  27. Oliveira, J.C., Shen, X., Georganas, N.D.: Collaborative virtual environment for industrial training and e-commerce. IEEE VRTS 288 (2000)

    Google Scholar 

  28. Passos, C., Da Silva, M.H., Mol, A.C., Carvalho, P.V.: Design of a collaborative virtual environment for training security agents in big events. Cogn. Technol. Work 19(2–3), 315–328 (2017)

    Article  Google Scholar 

  29. Rings, S., Steinicke, F., Dewitz, B., Büntig, F., Geiger, C.: EXGAVINE - exergames as novel form of therapy in virtual reality for the treatment of neurological diseases (2019)

    Google Scholar 

  30. Slater, M., Usoh, M., Steed, A.: Depth of presence in virtual environments. Presence Teleoperators Virtual Environ. 3(2), 130–144 (1994)

    Article  Google Scholar 

  31. Tsoupikova, D., Triandafilou, K., Solanki, S., Barry, A., Preuss, F., Kamper, D.: Real-time diagnostic data in multi-user virtual reality post-stroke therapy. In: SIGGRAPH ASIA 2016 VR Showcase, pp. 1–2 (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jann Philipp Freiwald .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Freiwald, J.P., Gollek, S., Steinicke, F. (2021). VR Invite: A Project-Independent Smartphone App for VR Observation and Interactivity. In: Ardito, C., et al. Human-Computer Interaction – INTERACT 2021. INTERACT 2021. Lecture Notes in Computer Science(), vol 12932. Springer, Cham. https://doi.org/10.1007/978-3-030-85623-6_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-85623-6_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-85622-9

  • Online ISBN: 978-3-030-85623-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics