Skip to main content
SpringerLink
Log in

Placement of Teleported Co-users in AR

  • Conference paper
  • First Online:
Human-Computer Interaction – INTERACT 2021 (INTERACT 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12932))

Included in the following conference series:

  • 2377 Accesses

Abstract

Teleportation and conversations with virtual representations of remote people have been made possible by recent developments in augmented reality (AR) technology. This paper aims at understanding how such AR telecommunication systems should be implemented by asking where to display 3D scans of potential remote users. As the perfect interaction design solution may be different while walking versus while staying in one place, we conducted a user study comparing both. We also varied the placement of the remote user in the co-user’s field of view (FoV) and where the coordinate system in which the 3D scan is visualized has its origin. We found that remote users we talk to should, in general, be visualized in AR in front of us, but in situations in which the physical world requires attention a visualization in the periphery is better. Re-placing the co-user through gestures is not desired, but the ability to look away from them should be supported, which strongly supports placing virtual co-users in AR relatively to the user’s body.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://news.microsoft.com/de-de/videos/microsoft-hololens-skype/.

  2. 2.

    https://www.metavision.com.

  3. 3.

    https://unity.com.

  4. 4.

    https://www.python.org.

  5. 5.

    https://opencv.org.

References

  1. Anjos, R.K.D., et al.: Adventures in hologram space: exploring the design space of eye-to-eye volumetric telepresence. In: 25th ACM Symposium on Virtual Reality Software and Technology. VRST 2019. Association for Computing Machinery, New York, NY, USA (2019). https://doi.org/10.1145/3359996.3364244, https://doi.org/10.1145/3359996.3364244

  2. Basler, A.: Über das sehen von bewegungen. Archiv für die gesamte Physiologie des Menschen und der Tiere 115(11), 582–601 (1906). https://doi.org/10.1007/BF01677292, https://doi.org/10.1007/BF01677292

  3. Bradley, J.V.: Complete counterbalancing of immediate sequential effects in a Latin square design. J. Am. Stat. Assoc. 53(282), 525–528 (1958). https://doi.org/10.1080/01621459.1958.10501456, https://amstat.tandfonline.com/doi/abs/10.1080/01621459.1958.10501456

  4. Brooke, J.: SUS: a quick and dirty usability scale (1996)

    Google Scholar 

  5. Chua, S.H., Perrault, S.T., Matthies, D.J.C., Zhao, S.: Positioning glass: investigating display positions of monocular optical see-through head-mounted display. In: Proceedings of the Fourth International Symposium on Chinese CHI, pp. 1:1–1:6. ChineseCHI2016, ACM, New York, NY, USA (2016). https://doi.org/10.1145/2948708.2948713, http://doi.acm.org/10.1145/2948708.2948713

  6. Du, R., Chuang, M., Chang, W., Hoppe, H., Varshney, A.: Montage4d: interactive seamless fusion of multiview video textures. In: Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, pp. 5:1–5:11. I3D 2018. ACM, New York, NY, USA (2018). https://doi.org/10.1145/3190834.3190843, http://doi.acm.org/10.1145/3190834.3190843

  7. Finlay, D.: Motion perception in the peripheral visual field. Perception 11(4), 457–462 (1982)

    Article  Google Scholar 

  8. Fiorentino, M., Debernardis, S., Uva, A.E., Monno, G.: Augmented reality text style readability with see-through head-mounted displays in industrial context. Presence: Teleoperators Virtual Environ. 22(2), 171–190 (2013)

    Article  Google Scholar 

  9. Fischer, B.: Blick- Punkte. Neurobiologische Prinzipien des Sehens und der Blicksteuerung. Huber, Bern (1999)

    Google Scholar 

  10. Gabbard, J.L., Swan, J.E., Hix, D., Schulman, R.S., Lucas, J., Gupta, D.: An empirical user-based study of text drawing styles and outdoor background textures for augmented reality. In: IEEE Proceedings. VR 2005. Virtual Reality, 2005, pp. 11–18, March 2005. https://doi.org/10.1109/VR.2005.1492748

  11. Gibbs, S.J., Arapis, C., Breiteneder, C.J.: Teleport— towards immersive copresence. Multimedia Syst. 7(3), 214–221, May 1999. https://doi.org/10.1007/s005300050123, http://dx.doi.org/10.1007/s005300050123

  12. Gruenefeld, U., Löcken, A., Brueck, Y., Boll, S., Heuten, W.: Where to look: exploring peripheral cues for shifting attention to spatially distributed out-of-view objects. In: Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 221–228. AutomotiveUI 2018. Association for Computing Machinery, New York, NY, USA (2018). https://doi.org/10.1145/3239060.3239080, https://doi.org/10.1145/3239060.3239080

  13. Kato, H., Billinghurst, M.: Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality, p. 85. IWAR 1999, IEEE Computer Society, USA (1999)

    Google Scholar 

  14. Klose, E.M., Mack, N.A., Hegenberg, J., Schmidt, L.: Text presentation for augmented reality applications in dual-task situations. In: 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 636–644, March 2019. https://doi.org/10.1109/VR.2019.8797992

  15. Krauss, R.M., Chen, Y., Chawla, P.: Nonverbal behavior and nonverbal communication: what do conversational hand gestures tell us? In: Advances in Experimental Social Psychology, vol. 28, pp. 389–450. Elsevier (1996)

    Google Scholar 

  16. Lawrence, L., Dey, A., Billinghurst, M.: The effect of video placement in AR conferencing applications. In: Proceedings of the 30th Australian Conference on Computer-Human Interaction, pp. 453–457. OzCHI 2018. Association for Computing Machinery, New York, NY, USA (2018). https://doi.org/10.1145/3292147.3292203, https://doi.org/10.1145/3292147.3292203

  17. Lindlbauer, D., et al.: A collaborative see-through display supporting on-demand privacy. In: ACM SIGGRAPH 2014 Emerging Technologies, pp. 1:1–1:1. SIGGRAPH 2014. ACM, New York, NY, USA (2014). https://doi.org/10.1145/2614066.2614095, http://doi.acm.org/10.1145/2614066.2614095

  18. Lindlbauer, D., et al.: Tracs: transparency-control for see-through displays. In: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, pp. 657–661. UIST 2014. ACM, New York, NY, USA (2014). https://doi.org/10.1145/2642918.2647350, http://doi.acm.org/10.1145/2642918.2647350

  19. Nassani, A., Lee, G., Billinghurst, M., Langlotz, T., Lindeman, R.W.: Using visual and spatial cues to represent social contacts in ar. In: SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications, pp. 15:1–15:6. SA 2017. ACM, New York, NY, USA (2017). https://doi.org/10.1145/3132787.3139199, http://doi.acm.org/10.1145/3132787.3139199

  20. Nowak, K.L., Biocca, F.: The effect of the agency and anthropomorphism on users’ sense of telepresence, copresence, and social presence in virtual environments. Presence 12(5), 481–494 (2003). https://doi.org/10.1162/105474603322761289

    Article  Google Scholar 

  21. Orlosky, J., Kiyokawa, K., Takemura, H.: Dynamic text management for see-through wearable and heads-up display systems. In: Proceedings of the 2013 International Conference on Intelligent User Interfaces, pp. 363–370. IUI 2013. ACM, New York, NY, USA (2013). https://doi.org/10.1145/2449396.2449443, http://doi.acm.org/10.1145/2449396.2449443

  22. Orts-Escolano, S., et al.: Holoportation: virtual 3d teleportation in real-time. In: Proceedings of the 29th Annual Symposium on User Interface Software and Technology, pp. 741–754. UIST 2016. ACM, New York, NY, USA (2016). https://doi.org/10.1145/2984511.2984517, http://doi.acm.org/10.1145/2984511.2984517

  23. Rzayev, R., Woźniak, P.W., Dingler, T., Henze, N.: Reading on smart glasses: the effect of text position, presentation type and walking. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 45:1–45:9. CHI 2018. ACM, New York, NY, USA (2018). https://doi.org/10.1145/3173574.3173619, http://doi.acm.org/10.1145/3173574.3173619

  24. Schandry, R.: Biologische Psychologie. Beltz (2011)

    Google Scholar 

  25. Schwartz, J.L., Berthommier, F., Savariaux, C.: Seeing to hear better: evidence for early audio-visual interactions in speech identification. Cognition 93(2), B69–B78 (2004). https://doi.org/10.1016/j.cognition.2004.01.006, http://www.sciencedirect.com/science/article/pii/S001002770400054X

  26. Strasburger, H., Rentschler, I., Jüttner, M.: Peripheral vision and pattern recognition: a review. J. Vis. 11(5), 13 (2011). https://doi.org/10.1167/11.5.13

  27. Sumby, W.H., Pollack, I.: Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Am. 26(2), 212–215 (1954). https://doi.org/10.1121/1.1907309

    Article  Google Scholar 

  28. Tanaka, K., Kishino, Y., Miyamae, M., Terada, T., Nishio, S.: An information layout method for an optical see-through HMD considering the background. In: 2007 11th IEEE International Symposium on Wearable Computers, pp. 109–110, October 2007. https://doi.org/10.1109/ISWC.2007.4373791

  29. Tanaka, K., Kishino, Y., Miyamae, M., Terada, T., Nishio, S.: An information layout method for an optical see-through head mounted display focusing on the viewability. In: Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pp. 139–142. ISMAR 2008, IEEE Computer Society, Washington, DC, USA (2008). https://doi.org/10.1109/ISMAR.2008.4637340, https://doi.org/10.1109/ISMAR.2008.4637340

  30. Velamkayala, E.R., Zambrano, M.V., Li, H.: Effects of Hololens in collaboration: a case in navigation tasks. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 61(1), pp. 2110–2114 (2017). https://doi.org/10.1177/1541931213602009, https://doi.org/10.1177/1541931213602009

  31. Zhang, C., Cai, Q., Chou, P., Zhang, Z., Martin-Brualla, R.: Viewport: a distributed, immersive teleconferencing system with infrared dot pattern. IEEE MultiMedia 20(1), 17–27, January 2013. https://doi.org/10.1109/MMUL.2013.12, http://dx.doi.org/10.1109/MMUL.2013.12

  32. Zhang, L., Amin, S.O., Westphal, C.: VR video conferencing over named data networks. In: Proceedings of the Workshop on Virtual Reality and Augmented Reality Network, pp. 7–12. VR/AR Network 2017. ACM, New York, NY, USA (2017). https://doi.org/10.1145/3097895.3097897, http://doi.acm.org/10.1145/3097895.3097897

Download references

Acknowledgements

This work is funded by the German Ministry of Education and Research (BMBF) within the GEVAKUB project (01JKD1701B) and by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) – 425869442 and is part of Priority Program SPP2199 Scalable Interaction Paradigms for Pervasive Computing Environments.

Author information

Authors and Affiliations

  1. University of Applied Science Hamburg, Hamburg, Germany

    Jens Reinhardt

  2. University of Applied Science Berlin, Berlin, Germany

    Marco Kurzweg & Katrin Wolf

Authors
  1. Jens Reinhardt
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marco Kurzweg
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Katrin Wolf
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marco Kurzweg .

Editor information

Editors and Affiliations

  1. Department of Electrical and Information Engineering, Polytechnic University of Bari, Bari, Italy

    Carmelo Ardito

  2. Computer Science Department, University of Bari Aldo Moro, Bari, Italy

    Rosa Lanzilotti

  3. Computer Science Department, University of Pisa, Pisa, Italy

    Alessio Malizia

  4. Department of Computer Science, University of York, York, UK

    Helen Petrie

  5. Computer Science Department, University of Bari Aldo Moro, Bari, Italy

    Antonio Piccinno

  6. Computer Science Department, University of Bari Aldo Moro, Bari, Italy

    Giuseppe Desolda

  7. Microsoft Research, Redmond, WA, USA

    Kori Inkpen

1 Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (mp4 13012 KB)

Rights and permissions

Reprints and permissions

Copyright information

© 2021 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Reinhardt, J., Kurzweg, M., Wolf, K. (2021). Placement of Teleported Co-users in AR. In: Ardito, C., et al. Human-Computer Interaction – INTERACT 2021. INTERACT 2021. Lecture Notes in Computer Science(), vol 12932. Springer, Cham. https://doi.org/10.1007/978-3-030-85623-6_34

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-85623-6_34

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-85622-9

  • Online ISBN: 978-3-030-85623-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation