The impact of the input interface in a virtual environment: the Vive controller and the Myo armband

Abstract

Gesture-based touchless devices are becoming a widespread alternative to traditional gaming devices such as joysticks or gamepads. However, the impact of such devices on the user experience has to be evaluated, especially if we consider that most users are more familiar with classical handheld gaming controllers. In virtual reality applications, they influence not only the traditional usability, but also the user perception related to some peculiarities of immersive environments. In this paper, we evaluate both these aspects by comparing the user experience with the Myo armband touchless interface and the Vive controller distributed with the HTC Vive headset. We focused on a virtual navigator we developed for HTC Vive to allow users exploring the organs of the human body and navigating inside them. We recruited 78 subjects to test the virtual environment and asked them to fill in a questionnaire: we combined two generic purpose questionnaires focusing on the system usability (UMUX and SUS) and a presence questionnaire, which was specifically designed for virtual environments. We conducted a statistical analysis to study the effects of a touchless interaction on the user experience. The results revealed a better usability of the Vive controller, even though the effort to learn how to use the two devices is similar. In particular, difficulties in using Myo have a significant impact on immersion and adaptation in the virtual environment.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

References

  1. Anwar S, Sinha SK, Vivek S, Ashank V (2019) Hand gesture recognition: a survey. In: Lecture notes in electrical engineering, pp 365–371

  2. Argelaguet F, Andujar C (2013) A survey of 3D object selection techniques for virtual environments. Comput Graph (Pergamon) 37(3):121–136

    Article  Google Scholar 

  3. Assila A, Marçal De Oliveira K, Ezzedine H (2016) Standardized usability questionnaires: features and quality focus. J Comput Sci Inf Technol (eJCSIT) 6:15–31

    Google Scholar 

  4. Bachmann D, Weichert F, Rinkenauer G (2018) Review of three-dimensional human–computer interaction with focus on the leap motion controller. Sensors 18:2194

    Article  Google Scholar 

  5. Bailey SK, Johnson CI, Sims VK (2019) Using natural gesture interactions leads to higher usability and presence in a computer lesson. In: Advances in intelligent systems and computing, pp 663–671

  6. Bartlett MS (1937) Properties of sufficiency and statistical tests. Proc R Soc Lond Ser A Math Phys Sci 160(901):268–282

    MATH  Google Scholar 

  7. Bhattacharyya A, Mazumder O, Chakravarty K, Chatterjee D, Sinha A, Gavas R (2018) Development of an interactive gaming solution using MYO sensor for rehabilitation. In: 2018 international conference on advances in computing, communications and informatics, ICACCI 2018, pp 2127–2130

  8. Borges M, Symington A, Coltin B, Smith T, Ventura R (2018) HTC Vive: analysis and accuracy improvement. In: IEEE international conference on intelligent robots and systems, pp 2610–2615

  9. Borrego A, Latorre J, Alcañiz M, Llorens R (2018) Comparison of Oculus Rift and HTC Vive: feasibility for virtual reality-based exploration, navigation, exergaming, and rehabilitation. Games Health J 7(3):151–156

    Article  Google Scholar 

  10. Borsci S, Federici S, Lauriola M (2009) On the dimensionality of the system usability scale: a test of alternative measurement models. Cognit Process 10(3):193–197

    Article  Google Scholar 

  11. Bowman DA, McMahan RP (2007) Virtual reality: how much immersion is enough? Computer 40(7):36–43

    Article  Google Scholar 

  12. Bowman DA, Coquillart S, Froehlich B, Hirose M, Kitamura Y, Kiyokawa K, Stuerzlinger W (2008) 3D user interfaces: new directions and perspectives. IEEE Comput Graph Appl 28(6):20–36

    Article  Google Scholar 

  13. Brooke J (1996) SUS—a quick and dirty usability scale. In: Jordan PW, Thomas B, McClelland IL, Weerdmeester B (eds) Usability evaluation in industry. CRC Press, Boca Raton

    Google Scholar 

  14. Caggianese G, Gallo L, Neroni P (2019) The vive controllers vs. leap motion for interactions in virtual environments: a comparative evaluation. In: smart innovation, systems and technologies, pp 24–33

  15. Cain B (2004) A review of the mental workload literature. NATO RTO-TR-HFM-121-Part-II

  16. Caputo FM, Giachetti A (2015) Evaluation of basic object manipulation modes for low-cost immersive virtual reality. In: Proceedings of the 11th biannual conference on Italian SIGCHI chapter. ACM, New York, pp 74–77

    Google Scholar 

  17. Chen MY, Tung YC, Wu PJ, Hsu CY, Chyou S, Valstar A, Wang HY, Lin JW (2015) User-defined game input for smart glasses in public space

  18. Cook H, Nguyen QV, Simoff S, Trescak T, Preston D (2015) A close-range gesture interaction with Kinect. In: 2015 big data visual analytics, BDVA 2015, pp 1–8

  19. Csapo AB, Nagy H, Kristjansson A, Wersenyi G (2017) Evaluation of human-Myo gesture control capabilities in continuous search and select operations. In: 7th IEEE international conference on cognitive infocommunications, CogInfoCom 2016

  20. De Paolis LT (2016) A touchless gestural platform for the interaction with the patients data. In: XIV Mediterranean conference on medical and biological engineering and computing 2016 (MEDICON 2016), March 31st–April 2nd 2016, Paphos, Cyprus, IFMBE Proceedings. Springer, Berlin, pp 880–884

  21. De Paolis LT (2018) Augmented visualization and touchless interaction with virtual organs. In: International conference on bioinformatics and biomedical engineering (IWBBIO 2018) Granada, Spain, April 25–27, 2018. Lecture notes in bioinformatics, LNBI 10814. Springer, Berlin, pp 118–127

  22. De Paolis LT, De Luca V (2019) Augmented visualization with depth perception cues to improve the surgeon’s performance in minimally invasive surgery. Med Biol Eng Comput 57(5):995–1013

    Article  Google Scholar 

  23. De Paolis LT, De Mauro A, Raczkowsky J, Aloisio G (2009) Virtual model of the human brain for neurosurgical simulation. Stud Health Technol Inform 150:811–815

    Google Scholar 

  24. De Paolis LT, Pulimeno M, Aloisio G (2010) Advanced visualization and interaction systems for surgical pre-operative planning. J Comput Inf Technol 18(4):385–392

    Article  Google Scholar 

  25. De Paolis LT, De Luca V, Paladini GI (2019) Touchless navigation in a multimedia application: the effects perceived in an educational context. In: Sixth international conference augmented and virtual reality, and computer graphics (AVR 2019), Santa Maria al Bagno, Italy, June 24–27, 2019. Lecture notes in computer science, LNCS 11614. Springer, Berlin, pp 348–367

  26. Dong H, Figueroa N, El Saddik A (2016) An elicitation study on gesture attitudes and preferences towards an interactive hand-gesture vocabulary

  27. Duvinage M, Castermans T, Petieau M, Hoellinger T, Cheron G, Dutoit T (2013) Performance of the Emotiv Epoc headset for P300-based applications. BioMed Eng Online 12(1):56

    Article  Google Scholar 

  28. Emotiv (2019) Emotiv EPOC+. Retrieved 15 November 2019, from https://www.emotiv.com

  29. Figueiredo L, Rodrigues E, Teixeira J, Techrieb V (2018) A comparative evaluation of direct hand and wand interactions on consumer devices. Comput Graph (Pergamon) 77:108–121

    Article  Google Scholar 

  30. Finstad K (2010) The usability metric for user experience. Interact Comput 22(5):323–327

    Article  Google Scholar 

  31. Frankenstein J, Brüssow S, Ruzzoli F, Hölscher C (2012) The language of landmarks: the role of background knowledge in indoor wayfinding. Cognit Process 13(1):165–170

    Article  Google Scholar 

  32. Gabriel KR (1971) The biplot graphic display of matrices with application to principal component analysis. Biometrika 58(3):453–467

    MathSciNet  MATH  Article  Google Scholar 

  33. Gamer PC (2019) Valve index review. Retrieved 15 November 2019, from https://www.pcgamer.com/valve-index-review/

  34. Garber L (2013) Gestural technology: moving interfaces in a new direction. Computer 46(10):22–25

    Article  Google Scholar 

  35. Grandhi SA, Joue G, Mittelberg I (2011) Understanding naturalness and intuitiveness in gesture production—insights for touchless gestural interfaces. In: Proceedings of the international conference on human factors in computing systems (CHI’11), New York, NY, USA, pp 821–824

  36. Gusai E, Bassano C, Solari F, Chessa M (2017) Interaction in an immersive collaborative virtual reality environment: a comparison between Leap Motion and HTC controllers. In: Lecture notes in computer science, pp 290–300

  37. Guzsvinecz T, Szucs V, Sik-Lanyi C (2019) Suitability of the Kinect sensor and Leap Motion controller—a literature review. Sensors 19:1072

    Article  Google Scholar 

  38. Hauser N, Wade E (2018) Detecting reach to grasp activities using motion and muscle activation data. In: Proceedings of the annual international conference of the IEEE engineering in medicine and biology society, EMBS, pp 3264–3267

  39. Hilliges O, Kim D, Izadi S, Weiss M, Wilson A (2012) HoloDesk: direct 3D interactions with a situated see-through display Otmar. In: Proceedings of the 2012 ACM annual conference on human factors in computing systems-CHI ’12, New York, NY, USA, pp 2421–2430

  40. HTC (2019a) HTC Vive controller. Retrieved 15 November 2019, from https://www.vive.com/eu/accessory/controller/

  41. HTC (2019b) HTC Vive. Retrieved 15 November 2019, from https://www.vive.com/us/product/vive-virtual-reality-system/

  42. HTC (2019c) VIVE wireless adapter. Retrieved 15 November 2019, from https://www.vive.com/us/wireless-adapter/

  43. Hudson S, Matson-Barkat S, Pallamin N, Jegou G (2019) With or without you? Interaction and immersion in a virtual reality experience. J Bus Res 100:459–468

    Article  Google Scholar 

  44. Indraccolo C, De Paolis LT (2017) Augmented reality and MYO for a touchless interaction with virtual organs. In: Fourth international conference augmented and virtual reality, and computer graphics (AVR 2017), Ugento, Italy, June 12–15, 2017. Lecture notes in computer science, LNCS 10325, pp 63–73

  45. Invitto S, Faggiano C, Sammarco S, De Luca V, De Paolis LT (2015) Interactive entertainment, virtual motion training and brain ergonomy. In: 7th international conference on intelligent technologies for interactive entertainment (INTETAIN 2015), Torino, Italy, June 10–12, 2015, pp 88–94

  46. Invitto S, Faggiano C, Sammarco S, De Luca V, De Paolis LT (2016) Haptic, virtual interaction and motor imagery: entertainment tools and psychophysiological testing. Sensors 16(3):394

    Article  Google Scholar 

  47. Kaiser HF (1958) The varimax criterion for analytic rotation in factor analysis. Psychometrika 23(3):187–200

    MATH  Article  Google Scholar 

  48. Kruskal WH, Wallis WA (1952) Use of ranks in one-criterion variance analysis. J Am Stat Assoc 47(260):583–621

    MATH  Article  Google Scholar 

  49. Lachat E, Macher H, Landes T, Grussenmeyer P (2015) Assessment and calibration of a RGB-D camera (Kinect v2 Sensor) towards a potential use for close-range 3D modeling. Remote Sens 7(10):13070–13097

    Article  Google Scholar 

  50. Lewis JR (2018) Measuring perceived usability: the CSUQ, SUS, and UMUX. Int J Hum Comput Interact 34(12):1148–1156

    Article  Google Scholar 

  51. Lewis JR, Sauro J (2009) The factor structure of the system usability scale. In: Lecture notes in computer science, pp 94–103

  52. Lewis JR, Utesch BS, Maher DE (2015) Investigating the correspondence between UMUX-LITE and SUS scores. In: Lecture notes in computer science, pp 204–211

  53. Livatino S, De Paolis LT, D’Agostino M, Zocco A, Agrimi A, De Santis A, Bruno LV, Lapresa M (2015) Stereoscopic visualization and 3-D technologies in medical endoscopic teleoperation. IEEE Trans Ind Electron 62(1):525–535

    Article  Google Scholar 

  54. Lucas JF, Kim JS, Bowman DA (2005) Resizing beyond widgets: object resizing techniques for immersive virtual environments. In: Proceedings of ACM CHI 2005 conference on human factors in computing systems, New York, NY, USA, pp 1601–1604

  55. Lund BAM (2001) Measuring usability with the USE questionnaire. STC usability SIG newsletter

  56. McMahan RP, Gorton D, Gresock J, McConnell W, Bowman DA (2007) Separating the effects of level of immersion and 3D interaction techniques. In: Proceedings of the ACM symposium on virtual reality software and technology. ACM, New York, pp 108–111

  57. Méndez R, Flores J, Castelló E, Viqueira JR (2019) Natural interaction in virtual TV sets through the synergistic operation of low-cost sensors. Univ Access Inf Soc 18(1):17–29

    Article  Google Scholar 

  58. Microsoft (2019a) Azure Kinect DK. Retrieved 15 November 2019, from https://azure.microsoft.com/en-us/services/kinect-dk/

  59. Microsoft (2019b) Microsoft Hololens. Retrieved 15 November 2019, from https://www.microsoft.com/en-IE/hololens

  60. Motion Leap (2019) Leap Motion. Retrieved 15 November 2019, from https://www.leapmotion.com/

  61. Moustafa K, Luz S, Longo L (2017) Assessment of mental workload: a comparison of machine learning methods and subjective assessment techniques. In: Communications in computer and information science, pp 30–50

  62. Niehorster DC, Li L, Lappe M (2017) The accuracy and precision of position and orientation tracking in the HTC vive virtual reality system for scientific research. i-Perception 8(3):2041669517708205

    Google Scholar 

  63. Nintendo (2019) Wii Remote. Retrieved 15 November 2019, from https://www.nintendo.com

  64. Oculus VR (2019a) Oculus Rift. Retrieved 15 November 2019, from https://www.oculus.com/

  65. Oculus VR (2019b) Oculus Touch. Retrieved 15 November 2019, from https://www.oculus.com/rift/accessories/

  66. Pai YS, Dingler T, Kunze K (2018) Assessing hands-free interactions for VR using eye gaze and electromyography. Virtual Real 23:119–131

    Article  Google Scholar 

  67. Polygon (2019) Oculus Go review. Retrieved 15 November 2019, from https://www.polygon.com/virtual-reality/2018/5/1/17284454/oculus-go-review

  68. Rechy-Ramirez EJ, Marin-Hernandez A, Rios-Figueroa HV (2018) Impact of commercial sensors in human computer interaction: a review. J Ambient Intell Humaniz Comput 9:1479–1496

    Article  Google Scholar 

  69. Ruddle R (2006) Review: 3D user interfaces: theory and practice. In: Bowman DA, Kruijff E, LaViola JJ Jr, Poupyrev I (eds) Presence: teleoperators and virtual environments. Addison-Wesley, Boston

    Google Scholar 

  70. Samsung (2019) Samsung Gear VR. Retrieved 15 November 2019, from https://www.samsung.com/us/mobile/virtual-reality/gear-vr/gear-vr-with-controller-sm-r324nzaaxar/

  71. Santos MEC, Sandor C, Kato H, Yamamoto G, Taketomi T, Polvi J (2014) A usability scale for handheld augmented reality. In: Proceedings of the 20th ACM symposium on virtual reality software and technology. ACM, New York, pp 167–176

    Google Scholar 

  72. Santos MEC, Polvi J, Taketomi T, Yamamoto G, Sandor C, Kato H (2015) Toward standard usability questionnaires for handheld augmented reality. IEEE Comput Graph Appl 35(5):66–75

    Article  Google Scholar 

  73. Santos-Torres A, Zarraonandia T, Díaz P, Aedo I (2018) Exploring interaction mechanisms for map interfaces in virtual reality environments. In: Proceedings of the XIX international conference on human computer interaction. ACM, New York, pp 1–7

  74. Sarbolandi H, Lefloch D, Kolb A (2015) Kinect range sensing: structured-light versus Time-of-Flight Kinect. Comput Vis Image Underst 139:1–20

    Article  Google Scholar 

  75. Sayin FS, Ozen S, Baspinar U (2018) Hand gesture recognition by using sEMG signals for human machine interaction applications. In: Signal processing—algorithms, architectures, arrangements, and applications conference proceedings, SPA, pp 27–30

  76. Shapiro SS, Wilk MB (1965) An analysis of variance test for normality (complete samples). Biometrika 52(3/4):591–611

    MathSciNet  MATH  Article  Google Scholar 

  77. Shu Y, Huang YZ, Chang SH, Chen MY (2018) Do virtual reality head-mounted displays make a difference? A comparison of presence and self-efficacy between head-mounted displays and desktop computer-facilitated virtual environments. Virtual Real. https://doi.org/10.1007/s10055-018-0376-x

    Article  Google Scholar 

  78. Somrak A, Humar I, Hossain MS, Alhamid MF, Hossain MA, Guna J (2019) Estimating VR sickness and user experience using different HMD technologies: an evaluation study. Future Gener Comput Syst 94:302–316

    Article  Google Scholar 

  79. Sony (2019) PlayStation Move. Retrieved15 November 2019, from https://www.playstation.com/en-us/explore/accessories/vr-accessories/playstation-move/

  80. Spitzley KA, Karduna AR (2019) Feasibility of using a fully immersive virtual reality system for kinematic data collection. J Biomech 87:172–176

    Article  Google Scholar 

  81. Stanney KM, Mollaghasemi M, Reeves L, Breaux R, Graeber DA (2003) Usability engineering of virtual environments (VEs): Identifying multiple criteria that drive effective VE system design. Int J Hum Comput Stud 58(4):447–481

    Article  Google Scholar 

  82. Steam (2019) SteamVR. Retrieved 15 November 2019, from https://steamcommunity.com/steamvr

  83. Sun R, Wu YJ, Cai Q (2018) The effect of a virtual reality learning environment on learners’ spatial ability. Virtual Real. https://doi.org/10.1007/s10055-018-0355-2

    Article  Google Scholar 

  84. Sun C, Hu W, Xu D (2019) Navigation modes, operation methods, observation scales and background options in UI design for high learning performance in VR-based architectural applications. J Comput Des Eng 6(2):189–196

    Google Scholar 

  85. Tcha-Tokey K, Loup-Escande E, Christmann O, Richir S (2017) Effects on user experience in an edutainment virtual environment

  86. Thalmic Labs (2019) Myo armband. Retrieved 15 November 2019, from https://support.getmyo.com/hc/en-us/articles/203398347-Getting-started-with-your-Myo-armband

  87. Tullis T, Albert B (2013) Measuring the user experience: collecting, analyzing, and presenting usability metrics, 2nd edn. Morgan Kaufmann, Los Altos

    Google Scholar 

  88. Ullmer B, Ishii H (2010) Emerging frameworks for tangible user interfaces. IBM Syst J 39:915–931

    Article  Google Scholar 

  89. Uloziene I, Totiliene M, Paulauskas A, Blažauskas T, Marozas V, Kaski D, Ulozas V (2017) Subjective visual vertical assessment with mobile virtual reality system. Medicina (Lithuania) 53(6):394–402

    Google Scholar 

  90. Unity Technologies (2019) Unity3D. Retrieved 15 November 2019, from https://unity3d.com

  91. UploadVR (2019a) Oculus Quest review. Retrieved 15 November 2019, from https://uploadvr.com/oculus-quest-review/

  92. UploadVR (2019b) OC6: Oculus Quest is getting camera-based finger tracking early next year. Retrieved 15 November 2019, from https://uploadvr.com/oculus-quest-finger-tracking/

  93. UploadVR (2019c) Oculus Rift S is official. Retrieved 15 November 2019, from https://uploadvr.com/oculus-rift-s-official/

  94. Vosinakis S, Koutsabasis P (2018) Evaluation of visual feedback techniques for virtual grasping with bare hands using Leap Motion and Oculus Rift. Virtual Real 22(1):47–62

    Article  Google Scholar 

  95. Vrellis I, Moutsioulis A, Mikropoulos TA (2014) Primary school students’ attitude towards gesture based interaction: a comparison between Microsoft Kinect and mouse. In: Proceedings—IEEE 14th international conference on advanced learning technologies, ICALT 2014, pp 678–682

  96. Webster R, Dues J (2017) System usability scale (SUS): Oculus Rift® DK2 and Samsung Gear VR®. In: 2017 ASEE annual conference & exposition, ASEE conferences, Columbus, Ohio

  97. Witmer BG, Singer MJ (1998) Measuring presence in virtual environments: a presence questionnaire. Presence Teleoper Virtual Environ 7(3):225–240

    Article  Google Scholar 

  98. Witmer BG, Jerome CJ, Singer MJ (2005) The factor structure of the presence questionnaire. Presence Teleoper Virtual Environ 14:298–312

    Article  Google Scholar 

  99. Wobbrock JO, Aung HH, Rothrock B, Myers BA (2005) Maximizing the guessability of symbolic input. In: CHI ’05 extended abstracts on human factors in computing systems. ACM, New York, pp 1869–1872

    Google Scholar 

  100. Yu M, Zhou R, Wang H, Zhao W (2019) An evaluation for VR glasses system user experience: the influence factors of interactive operation and motion sickness. Appl Ergon 74:206–213

    Article  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Valerio De Luca.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

De Paolis, L.T., De Luca, V. The impact of the input interface in a virtual environment: the Vive controller and the Myo armband. Virtual Reality (2019). https://doi.org/10.1007/s10055-019-00409-6

Download citation

Keywords

  • Touchless interaction
  • Gesture
  • User experience
  • Usability
  • Presence
  • Virtual environment