Skip to main content
SpringerLink
Log in

Comparing a Mouse and a Free Hand Gesture Interaction Technique for 3D Object Manipulation

  • Conference paper
  • First Online:
Human-Computer Interaction. Multimodal and Natural Interaction (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12182))

Included in the following conference series:

Abstract

Interacting in 3D has considerable and growing importance today in several areas and most computer systems are equipped with both a mouse or touchscreen and one or more cameras that can be readily used for gesture-based interaction. Literature comparing mouse and free-hand gesture interaction, however, is still somewhat sparse in regards to user satisfaction, learnability and memorability, which can be particularly important attributes for applications in education or entertainment. In this paper, we compare the use of mouse-based interaction with free-hand bimanual gestures to translate, scale and rotate a virtual 3D object. We isolate object manipulation from its selection and focus particularly on those three attributes to test whether the related variables show significant differences when comparing both modalities. To this end, we integrate a gesture recognition system, Microsoft’s Kinect and an educational virtual atlas of anatomy, then design and perform an experiment with 19 volunteers, combining data from self-reported metrics and event logs. Our results show that, in this context, the difference is indeed significant and favors the use of gestures for most experimental tasks and evaluated attributes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://developer.microsoft.com/en-us/windows/kinect/.

  2. 2.

    https://www.ultraleap.com/product/leap-motion-controller/.

References

  1. Albert, W., Tullis, T.: Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics. Newnes, Oxford (2013)

    Google Scholar 

  2. Benavides, A., Khadka, R., Banic, A.: Physically-based bimanual volumetric selection for immersive visualizations. In: Chen, J.Y.C., Fragomeni, G. (eds.) HCII 2019. LNCS, vol. 11574, pp. 183–195. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-21607-8_14

    Chapter  Google Scholar 

  3. Bernardes, J., Nakamura, R., Tori, R.: Comprehensive model and image-based recognition of hand gestures for interaction in 3D environments. Int. J. Virtual Reality 10(4), 11–23 (2011). https://doi.org/10.20870/IJVR.2011.10.4.2825. https://ijvr.eu/article/view/2825

  4. Bolt, R.A.: “Put-that-there”: voice and gesture at the graphics interface. SIGGRAPH Comput. Graph. 14(3), 262–270 (1980). https://doi.org/10.1145/965105.807503

    Article  MathSciNet  Google Scholar 

  5. Farhadi-Niaki, F., GhasemAghaei, R., Arya, A.: Empirical study of a vision-based depth-sensitive human-computer interaction system. In: Proceedings of the 10th Asia Pacific Conference on Computer Human Interaction, pp. 101–108 (2012)

    Google Scholar 

  6. Ha, T., Woo, W.: An empirical evaluation of virtual hand techniques for 3D object manipulation in a tangible augmented reality environment. In: 2010 IEEE Symposium on 3D User Interfaces (3DUI), pp. 91–98. IEEE (2010)

    Google Scholar 

  7. Juhnke, B., Berron, M., Philip, A., Williams, J., Holub, J., Winer, E.: Comparing the microsoft kinect to a traditional mouse for adjusting the viewed tissue densities of three-dimensional anatomical structures. In: Medical Imaging 2013: Image Perception, Observer Performance, and Technology Assessment, vol. 8673, p. 86731M. International Society for Optics and Photonics (2013)

    Google Scholar 

  8. Kim, Y.M., Rhiu, I., Yun, M.H.: A systematic review of a virtual reality system from the perspective of user experience. Int. J. Hum.-Comput. Interact. 1–18 (2019). https://doi.org/10.1080/10447318.2019.1699746

  9. LaViola Jr., J.J., Kruijff, E., McMahan, R.P., Bowman, D., Poupyrev, I.P.: 3D User Interfaces: Theory and Practice. Addison-Wesley Professional, Boston (2017)

    Google Scholar 

  10. Moustakas, K., Nikolakis, G., Tzovaras, D., Strintzis, M.G.: A geometry education haptic VR application based on a new virtual hand representation. In: 2005 IEEE Proceedings, VR 2005, Virtual Reality, pp. 249–252. IEEE (2005)

    Google Scholar 

  11. Nielsen, M., Störring, M., Moeslund, T.B., Granum, E.: A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 409–420. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-24598-8_38

    Chapter  Google Scholar 

  12. dos Santos Nunes, E.P, Nunes, F.L.S., Roque, L.G.: Feasibility analysis of an assessment model of knowledge acquisition in virtual environments: a case study using a three-dimensional atlas of anatomy. In: Proceedings of the 19th Americas Conference on Information Systems - AMCIS 2013, Chicago, USA (2013)

    Google Scholar 

  13. Poupyrev, I., Ichikawa, T.: Manipulating objects in virtual worlds: categorization and empirical evaluation of interaction techniques. J. Vis. Lang. Comput. 10(1), 19–35 (1999)

    Article  Google Scholar 

  14. Reifinger, S., Laquai, F., Rigoll, G.: Translation and rotation of virtual objects in augmented reality: a comparison of interaction devices. In: 2008 IEEE International Conference on Systems, Man and Cybernetics, pp. 2448–2453. IEEE (2008)

    Google Scholar 

  15. Rodrigues, P.G., Raposo, A.B., Soares, L.P.: A virtual touch interaction device for immersive applications. Int. J. Virtual Reality 10(4), 1–10 (2011)

    Article  Google Scholar 

  16. Shneiderman, B., et al.: Designing the User Interface: Strategies for Effective Human-Computer Interaction. Pearson, Essex (2016)

    Google Scholar 

  17. Vrellis, I., Moutsioulis, A., Mikropoulos, T.A.: Primary school students’ attitude towards gesture based interaction: a comparison between microsoft kinect and mouse. In: 2014 IEEE 14th International Conference on Advanced Learning Technologies, pp. 678–682. IEEE (2014)

    Google Scholar 

  18. Wang, R., Paris, S., Popović, J.: 6D hands: markerless hand-tracking for computer aided design. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, pp. 549–558 (2011)

    Google Scholar 

  19. Wipfli, R., Dubois-Ferriere, V., Budry, S., Hoffmeyer, P., Lovis, C.: Gesture-controlled image management for operating room: a randomized crossover study to compare interaction using gestures, mouse, and third person relaying. PLoS ONE 11(4) (2016)

    Google Scholar 

  20. Zimmerman, T.G., Lanier, J., Blanchard, C., Bryson, S., Harvill, Y.: A hand gesture interface device. ACM SIGCHI Bull. 18(4), 189–192 (1986)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Universidade de Sao Paulo, Sao Paulo, Brazil

    Joao Bernardes

Authors
  1. Joao Bernardes
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Joao Bernardes .

Editor information

Editors and Affiliations

  1. The Open University of Japan, Chiba, Japan

    Masaaki Kurosu

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bernardes, J. (2020). Comparing a Mouse and a Free Hand Gesture Interaction Technique for 3D Object Manipulation. In: Kurosu, M. (eds) Human-Computer Interaction. Multimodal and Natural Interaction. HCII 2020. Lecture Notes in Computer Science(), vol 12182. Springer, Cham. https://doi.org/10.1007/978-3-030-49062-1_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-49062-1_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49061-4

  • Online ISBN: 978-3-030-49062-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation