Analyzing Mid-Air Hand Gestures to Confirm Selections on Displays

  • Orlando ErazoEmail author
  • Ariosto Vicuña
  • Roberto Pico
  • Byron Oviedo
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 895)


The use of applications based on mid-air gestures has been increasing during last years, but there are still challenges to be addressed. One of them is the type of hand gestures that should be employed in specific scenarios and/or tasks. A particular case is the selection of an item on a display or surface, with the following confirmation of that selection. Thought several gestures have been proposed to confirm a selection, user interface designers should know the differences between them to make an appropriate decision. Therefore, we analyzed a set of confirmation hand gestures using performance metrics and subjective measures to make comparisons between the chosen gestures. According to our results, all the studied gestures can be perceived to be intuitive, but hover was the best gesture for confirming a selection. The reported findings should help designers to make distinctions between confirmation gestures and made decisions according to the desired scenarios.


Mid-air hand gestures Confirmation gestures Touchless interaction Natural user interfaces Human-computer interaction 



This work was supported by FOCICYT 2017–2018 (Universidad Técnica Estatal de Quevedo, Ecuador).


  1. 1.
    Erazo, O., Pino, J.A., Pino, R., Fernández, C.: Magic mirror for neurorehabilitation of people with upper limb dysfunction using kinect. In: Proceedings of HICSS 2014, pp. 2607–2615. IEEE Press (2014)Google Scholar
  2. 2.
    Erazo, O., Baloian, N., Pino, J.A., Ochoa, S.F.: Designing hand gesture interfaces for easing students participation from their spot. In: Proceedings of the 21st International Conference on Computer Supported Cooperative Work in Design, pp. 133–138. IEEE (2017)Google Scholar
  3. 3.
    Minda Gilces, D., Matamoros Torres, K.: A kinect-based gesture recognition approach for the design of an interactive tourism guide application. In: Botto-Tobar, M., Esparza-Cruz, N., León-Acurio, J., Crespo-Torres, N., Beltrán-Mora, M. (eds.) CITT 2017. CCIS, vol. 798, pp. 115–129. Springer, Cham (2018). Scholar
  4. 4.
    Walter, R., Bailly, G., Valkanova, N., Müller, J.: Cuenesics: using mid-air gestures to select items on interactive public displays. In: Proceedings of MobileHCI 2014, pp. 299–308. ACM Press (2014)Google Scholar
  5. 5.
    Erazo, O., Pino, J.A.: Predicting task execution time on natural user interfaces based on touchless hand gestures. In: Proceedings of IUI 2015, pp. 97–109. ACM Press (2015)Google Scholar
  6. 6.
    Schwaller, M., Lalanne, D.: Pointing in the air: measuring the effect of hand selection strategies on performance and effort. In: Holzinger, A., Ziefle, M., Hitz, M., Debevc, M. (eds.) SouthCHI 2013. LNCS, vol. 7946, pp. 732–747. Springer, Heidelberg (2013). Scholar
  7. 7.
    Nielsen, M., Störring, M., Moeslund, Thomas B., Granum, E.: A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 409–420. Springer, Heidelberg (2004). Scholar
  8. 8.
    Vatavu, R.D.: User-defined gestures for free-hand TV control. In: Proceedings of EuroiTV 2012, pp. 45–48. ACM Press (2012)Google Scholar
  9. 9.
    Piumsomboon, T., Clark, A., Billinghurst, M., Cockburn, A.: User-defined gestures for augmented reality. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) INTERACT 2013, part II. LNCS, vol. 8118, pp. 282–299. Springer, Heidelberg (2013). Scholar
  10. 10.
    Koutsabasis, P., Domouzis, C.K.: Mid-air browsing and selection in image collections. In: Proceedings of AVI 2016, pp. 21–27. ACM Press (2016)Google Scholar
  11. 11.
    Erazo, O., Pino, J.: Estimating the difficulty of touchless hand gestures. IEEE Latin Am. Trans. 12(1), 17–22 (2014)Google Scholar
  12. 12.
    Nancel, M., Wagner, J., Pietriga, E., Chapuis, O., Mackay, W.: Mid-air pan-and-zoom on wall-sized displays. In: Proceedings of CHI 2011, pp. 177–186. ACM Press (2011)Google Scholar
  13. 13.
    Hespanhol, L., Tomitsch, M., Grace, K., Collins, A., Kay, J.: Investigating intuitiveness and effectiveness of gestures for free spatial interaction with large displays. In: Proceedings of PerDis 2012. ACM Press (2012)Google Scholar
  14. 14.
    Yoo, S., Parker, C., Kay, J., Tomitsch, M.: To dwell or not to dwell: an evaluation of mid-air gestures for large information displays. In: Proceedings of OzCHI 2015, pp. 187–191. ACM Press (2015)Google Scholar
  15. 15.
    Douglas, S.A., Kirkpatrick, A.E., MacKenzie, I.S.: Testing pointing device performance and user assessment with the IS0 9241, part 9 standard. In: Proceeding of SIGCHI Conference on Human Factors in Computing Systems (1999)Google Scholar
  16. 16.
    Müller-Tomfelde, C.: Dwell-based pointing in applications of human computer interaction. In: Baranauskas, C., Palanque, P., Abascal, J., Barbosa, S.D.J. (eds.) INTERACT 2007. LNCS, vol. 4662, pp. 560–573. Springer, Heidelberg (2007). Scholar
  17. 17.
    Hincapié-Ramos, J.D., Guo, X., Moghadasian, P., Irani, P.: Consumed endurance: a metric to quantify arm fatigue of mid-air interactions. In: Proceedings of CHI 2014, pp. 1063–1072. ACM Press (2014)Google Scholar
  18. 18.
    Markussen, A., Jakobsen, M.R., Hornbæk, K.: Selection-based mid-air text entry on large displays. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) INTERACT 2013. LNCS, vol. 8117, pp. 401–418. Springer, Heidelberg (2013). Scholar
  19. 19.
    Jones, E., Alexander, J., Andreou, A., Irani, P., Subramanian, S.: GesText: accelerometer-based gestural text-entry systems. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2173–2182. ACM (2010)Google Scholar
  20. 20.
    Borg, G.: Borg’s Perceived Exertion and Pain Scales. Human Kinetics, Champaign (1998)Google Scholar
  21. 21.
    Kamal, A., Li, Y., Lank, E.: Teaching motion gestures via recognizer feedback. In: Proceedings of IUI 2014, pp. 73–82. ACM Press (2014)Google Scholar
  22. 22.
    Pfeiffer, M., Schneegass, S., Alt, F., Rohs, M.: Let me grab this: a comparison of EMS and vibration for haptic feedback in free-hand interaction. In: Proceedings of the 5th Augmented Human International Conference. ACM (2014)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Orlando Erazo
    • 1
    Email author
  • Ariosto Vicuña
    • 1
  • Roberto Pico
    • 1
  • Byron Oviedo
    • 1
  1. 1.Universidad Técnica Estatal de QuevedoQuevedoEcuador

Personalised recommendations