Skip to main content
SpringerLink
Log in

Gesture-Based Interaction for Virtual Reality Environments Through User-Defined Commands

  • Conference paper
  • First Online:
Human-Computer Interaction (HCI-COLLAB 2018)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 847))

Included in the following conference series:

Abstract

Natural user interaction has been recently identified as a field of interest of computer sciences, mainly due to the development of hardware devices that enable fast identification and recognition of gestures within a diversity of contexts. In this paper, the investigation of body gestures that users naturally perform to navigate virtual reality environments is reported. For this purpose, users were asked to show the commands they would perform when realizing basic navigation tasks within a virtual world, and they were observed following the Wizard of Oz approach. The performance gesture-based interaction is evaluated in terms of usability, contrasted with traditional desktop interaction, and analyzed. Finally, as result of this work, a set of gestures (language) to navigate virtual reality environments is defined, along with insights regarding this interaction modality, and comments on the future direction of natural user interfaces using full-body movement as input.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://developer.microsoft.com/en-us/windows/kinect.

References

  1. Boudoin, P., Otmane, S., Mallem, M.: Design of a 3d navigation technique supporting vr interaction. In: Arioui, H., Merzouki, R., Abbassi, H.A. (eds.) AIP Conference Proceedings, vol. 1019, no. 1, pp. 149–153 (2008). https://doi.org/10.1063/1.2952967

  2. Constantine, L.L.: Canonical abstract prototypes for abstract visual and interaction design. In: Jorge, J.A., Jardim Nunes, N., Falcão e Cunha, J. (eds.) DSV-IS 2003. LNCS, vol. 2844, pp. 1–15. Springer, Heidelberg (2003). https://doi.org/10.1007/978-3-540-39929-2_1

    Chapter  Google Scholar 

  3. Wüthrich, C.A.: An analysis and a model of 3d interaction methods and devices for virtual reality. In: Duke, D., Puerta, A. (eds.) Design, Specification and Verification of Interactive Systems 1999, pp. 18–29. Springer, Vienna (1999). https://doi.org/10.1007/978-3-7091-6815-8_3

    Chapter  Google Scholar 

  4. Bowman, D.A., Koller, D., Hodges, L.F.: Travel in immersive virtual environments: an evaluation of viewpoint motion control techniques. In: Virtual Reality Annual International Symposium 1997, pp. 45–52. IEEE (1997). https://doi.org/10.1109/VRAIS.1997.583043

  5. Vanderdonckt, J.: A MDA-compliant environment for developing user interfaces of information systems. In: Pastor, O., Falcão e Cunha, J. (eds.) CAiSE 2005. LNCS, vol. 3520, pp. 16–31. Springer, Heidelberg (2005). https://doi.org/10.1007/11431855_2

    Chapter  Google Scholar 

  6. Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Bouillon, L., Vanderdonckt, J.: A unifying reference framework for multi-target user interfaces. Interact. Comput. 15(3), 289–308 (2003). https://doi.org/10.1016/S0953-5438(03)00010-9

    Article  Google Scholar 

  7. Paterno, F., Mancini, C., Meniconi, S.: ConcurTaskTrees: a diagrammatic notation for specifying task models. In: Howard, S., Hammond, J., Lindgaard, G. (eds.) Human-Computer Interaction INTERACT 1997. ITIFIP, pp. 362–369. Springer, Boston, MA (1997). https://doi.org/10.1007/978-0-387-35175-9_58

    Chapter  Google Scholar 

  8. Fonseca, J.M.C., et al.: Model-based ui xg final report. W3C Incubator Group Report, May, p. 32 (2010)

    Google Scholar 

  9. Kelley, J.F.: An iterative design methodology for user-friendly natural language office information applications. ACM Trans. Inf. Syst. (TOIS) 2(1), 26–41 (1984). https://doi.org/10.1145/357417.357420

    Article  Google Scholar 

  10. Dow, S., Lee, J., Oezbek, C., MacIntyre, B., Bolter, J.D., Gandy, M.: Wizard of Oz interfaces for mixed reality applications. In: CHI 2005. ACM, April 2005 (2005). https://doi.org/10.1145/1056808.1056911

  11. Höysniemi, J., Hämäläinen, P., Turkki, L.: Wizard of Oz prototyping of computer vision-based action games for children. In: Proceedings of the 2004 Conference on Interaction Design and Children: Building a Community, pp. 27–34. ACM (2004). https://doi.org/10.1145/1017833.1017837

  12. Maike, V.R.M.L., de Sousa Britto Neto, L., Baranauskas, M.C.C., Goldenstein, S.K.: Seeing through the kinect: a survey on heuristics for building natural user interfaces environments. In: Stephanidis, C., Antona, M. (eds.) UAHCI 2014. LNCS, vol. 8513, pp. 407–418. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07437-5_39

    Chapter  Google Scholar 

  13. Lewis, J.R.: IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int. J. Hum. Comput. Interact. 7(1), 57–78 (1995). https://doi.org/10.1080/10447319509526110

    Article  Google Scholar 

  14. Aliakseyeu, D., Subramanian, S., Martens, J.B., Rauterberg, M.: Interaction techniques for navigation through and manipulation of 2 D and 3 D data. In: ACM International Conference Proceeding Series, vol. 23, pp. 179–188 (2002)

    Google Scholar 

  15. González-Calleros, J.M., Vanderdonckt, J., Muñoz-Arteaga, J.: A structured methodology for developing 3D web applications. In: Integrating Usability Engineering for Designing the Web Experience: Methodologies and Principles, pp. 15–43 (2010). https://doi.org/10.4018/978-1-60566-896-3.ch002

  16. Kaur, K.: Designing virtual environments for usability. In: Howard, S., Hammond, J., Lindgaard, G. (eds.) Human-Computer Interaction INTERACT 1997. ITIFIP, pp. 636–639. Springer, Boston, MA (1997). https://doi.org/10.1007/978-0-387-35175-9_112

    Chapter  Google Scholar 

  17. Tan, D.S., Robertson, G.G., Czerwinski, M.: Exploring 3D navigation: combining speed-coupled flying with orbiting. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 418–425. ACM (2001). https://doi.org/10.1145/365024.365307

  18. Kray, C., Nesbitt, D., Dawson, J., Rohs, M.: User-defined gestures for connecting mobile phones, public displays, and tabletops. In: Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services, pp. 239–248. ACM (2010). https://doi.org/10.1145/1851600.1851640

  19. Ruiz, J., Li, Y., Lank, E.: User-defined motion gestures for mobile interaction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 197–206. ACM (2011). https://doi.org/10.1145/1978942.1978971

  20. Kurdyukova, E., Redlin, M., André, E.: Studying user-defined iPad gestures for interaction in multi-display environment. In: Proceedings of the 2012 ACM International Conference on Intelligent User Interfaces, pp. 93–96. ACM (2012). https://doi.org/10.1145/2166966.2166984

  21. Piumsomboon, T., Clark, A., Billinghurst, M., Cockburn, A.: User-defined gestures for augmented reality. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) INTERACT 2013. LNCS, vol. 8118, pp. 282–299. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-40480-1_18

    Chapter  Google Scholar 

  22. Valdes, C., et al.: Exploring the design space of gestural interaction with active tokens through user-defined gestures. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 4107–4116. ACM (2014). https://doi.org/10.1145/2556288.2557373

  23. Vatavu, R.D., Wobbrock, J.O.: Between-subjects elicitation studies: formalization and tool support. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 3390–3402. ACM (2016). https://doi.org/10.1145/2858036.2858228

Download references

Acknowledgment

This work has been funded by PRODEP, CONACYT and BUAP-VIEP projects. We truly appreciate the work of students of the computer science and architecture schools of the Autonomous University of Puebla (BUAP) for their tremendous contribution on the creation of the VR environment. Particularly to the students: Cortés García Raymundo, Rodríguez Hernández Fredy, Tlapaya Tepech Ismael, Roberto Pérez Hernández, Daniel Romero Dominguez, and Manuel Juarez.

Author information

Authors and Affiliations

  1. Facultad de Ciencias de la Computación, Benemérita Universidad Autónoma de Puebla, Puebla, Mexico

    David Céspedes-Hernández, Juan Manuel González-Calleros & Josefina Guerrero-García

  2. Facultad de Ciencias de la Electrónica, Benemérita Universidad Autónoma de Puebla, Puebla, Mexico

    Liliana Rodríguez-Vizzuett

Authors
  1. David Céspedes-Hernández
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Juan Manuel González-Calleros
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Josefina Guerrero-García
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Liliana Rodríguez-Vizzuett
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to David Céspedes-Hernández .

Editor information

Editors and Affiliations

  1. Corporación Universitaria Comfacauca Unicomfacauca, Popayán, Colombia

    Vanessa Agredo-Delgado

  2. Universidad del Cauca, Popayán, Colombia

    Pablo H. Ruiz

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Céspedes-Hernández, D., González-Calleros, J.M., Guerrero-García, J., Rodríguez-Vizzuett, L. (2019). Gesture-Based Interaction for Virtual Reality Environments Through User-Defined Commands. In: Agredo-Delgado, V., Ruiz, P. (eds) Human-Computer Interaction. HCI-COLLAB 2018. Communications in Computer and Information Science, vol 847. Springer, Cham. https://doi.org/10.1007/978-3-030-05270-6_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-05270-6_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-05269-0

  • Online ISBN: 978-3-030-05270-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation