Abstract
We investigate the effects of social context on the acceptability of 3D (touchless) gestures used to control a music system. We also focus on the extent to which gesture control can be regarded as peripheral interaction [3]. We first identified six gestures for player control to use in the social acceptability study. Next, we used a Wizard-of-Oz design to investigate social acceptability by inviting user dyads (Nā=ā24 participants) to a living room setting where they were assigned the roles of host or guest. The host used gestures to control the music system responding to cues while the guest engaged them in a distractor task. We video recorded the interaction and interviewed participants separately about their experiences. We found no reservations from either male, female, mature or young users about gesture interaction, and no distinction between groups with respect to social acceptability. Taken together, this suggests that gesture control is socially acceptable for all users. We analysed gaze direction when gesturing based on the video recordings. Using this as an indicator for user attention we also found evidence that gesture control can indeed exist in the periphery of attention.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ahlstrƶm, D., Hasan, K., Irani, P.: Are you comfortable doing that? Acceptance studies of around-device gestures in and for public settings. In: Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices & Services, pp. 193ā202. ACM Press, New York (2014)
ATAP: project soli (2018). https://atap.google.com/soli
Bakker, S., Hausen, D., Selker, T. (eds.): Peripheral Interaction: Challenges and Opportunities for HCI in the Periphery of Attention. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-29523-7
Audacity: Free, open source, cross-platform audio software. https://www.audacityteam.org
Beocentral: Beosound 3200 (2018). https://beocentral.com/beosound3200
Bixi Remote (2018). https://bixi.io
BMW: Using gesture controls (2015). https://www.youtube.com/watch?v=ttTBJkE-6fs
Bobeth, J., Schmehl, S., Kruijff, E., Deutsch, S., Tscheligi, M.: Evaluating performance and acceptance of older adults using freehand gestures for TV menu control. In: Proceedings of the 10th European Conference on Interactive TV (EuroITV 2012). ACM Press, New York (2012)
Brewster, S., Murray-Smith, R., Crossan, A., Vasquez-Alvarez, Y., Rico, J.: The GAIME project: gestural and auditory interactions for mobile environments. British Computer Society (2009)
Brown, J.N.A.: āUnseen, yet cresciveā: the unrecognized history of peripheral interaction. In: Bakker, S., Hausen, D., Selker, T. (eds.) Peripheral Interaction. HIS, pp. 13ā38. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-29523-7_2
Cabreira, A.T., Hwang, F.: How do novice older users evaluate and perform mid-air gesture interaction for the first time? In: Proceedings of NordiCHI 2016 (2016)
Casey, T., Wilson-Evered, E.: Predicting uptake of technology innovations in online family dispute resolution services: an application and extension of the UTAUT. Comput. Hum. Behav. 28(6), 2034ā2045 (2012)
Chattopadhyay, D., Bolchini, D.: Touchless circular menus: toward an intuitive UI for touchless interactions with large displays. In Proceedings of (AVI 2014) (2014)
Clarkson, P.J., Coleman, R., Keates, S., Lebbon, C.: Inclusive Design: Design for the Whole Population. Springer, Cham (2013)
Comtet, H.: Acceptance of 3D-gestures based on age, gender and experience. Masterās thesis, GjĆøvik University College, GjĆøvik, Norway (2013)
Ekman, P., Friesen, W.V.: Hand movements. J. Commun. 22(4), 353ā374 (1972)
Freeman, W.T., Weissman, C.D.: Television control by hand gestures. In: Proceedings of IEEE International Workshop on Automatic Face and Gesture Recognition, Zurich (1995)
Galor, M., Pokrass, J., Hoffnung, A.: Three dimensional user interface session control. Apple Corp. United States Patent No: US 8,933,876 B2 (2013)
Giddens, A.: The Constitution of Society: Outline of the Theory of Structuration. University of California Press, Berkeley (1986)
Grandhi, S.A., Joue, G., Mittelberg, I.: To move or to remove? A human-centric approach to understanding gesture interpretation. In: Proceedings of DISā2012 (2012)
Harrison, S.: The production line as a context for low metaphoricity. Exploring links between gestures, iconicity, and artefacts on a factory shop floor. In: Herrmann, J., Berber Sardinha, T. (eds.) Metaphor in Specialist Discourse: Investigating Metaphor Use in Technical, Scientificnad Popularized Discourse Contexts, pp. 131ā161. John Benjamins, Amsterdam (2015)
Hayo (2018). https://hayo.io
Hurtienne, J., et al.: Physical gestures for abstract concepts: Inclusive design with primary metaphors. Interact. Comput. 22, 475ā484 (2010)
Inclusive Design Toolkit (2018). https://www.inclusivedesigntoolkit.com/whatis/whatis.html
Juola, J.F.: Theories of focal and peripheral attention. In: Bakker, S., Hausen, D., Selker, T. (eds.) Peripheral Interaction. HIS, pp. 39ā61. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-29523-7_3
Karam, M., Schraefel, M.C.: A taxonomy of gestures in human computer task interactions. In: Proceedings of (CHI 2005), pp. 1961ā1964. ACM Press, New York (2005)
Lim, J.H., Jo, C., Kim, D.-H.: Analysis on user variability in gesture interaction. Convergence and hybrid information technology. In: Proceedings of the International Conference on Hybrid Information Technology, pp. 295ā302. ACM Press, New York (2012)
Malhotra, Y., Galletta, D.F.: Extending the technology acceptance model to account for social influence: theoretical bases and empirical validation. In: Proceedings of the 32nd Annual Hawaii International Conference on System Sciences (HICSS-32) (1999)
Mauney, D., Howarth, J., Wirtanen, A., Capra, M.: Cultural similarities and differences in user-defined gestures for touchscreen user interfaces. In: Proceedings of CHI 2010 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2010), pp. 4015ā4020. ACM Press, New York (2010)
McNeill, D.: Hand and Mind: What Gestures Reveal About Thought. University of Chicago Press, Chicago (1992)
McNeill, D.: Gesture & Thought. University of Chicago Press, Chicago (2005)
Montero, C.S., Alexander, J., Marshall, M.T., Subramanian, S.: Would you do that? Understanding social acceptance of gestural interfaces. In: Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services, pp. 275ā278. ACM Press, New York (2010)
MĆ¼ller, C., Cienki, A., Fricke, E., Ladewig, S., McNeill, D., TeĆendorf, S. (eds.): Body-Language-Communication. de Gruyter Mouton, Berlin (2013)
Nellemann, L., Nielsen, S.: Perifer interaktion med et musikanlƦg. B.Sc. thesis, Aalborg University, Aalborg, Denmark (2017)
Nielsen, M., Stƶrring, M., Moeslund, T.B., Granum, E.: A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 409ā420. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-24598-8_38
Ninja Blocks (2015). https://ninjablocks.com
Norman, D.: Natural user interfaces are not natural. Interactions 17(3), 6ā10 (2010)
Panger, G.: Kinect in the kitchen: testing depth camera interaction in practical home environments. In: Proceedings of CHI 2012 Work-in-Progress. ACM Press, New York (2012)
Perniss, P., Vigliocco, G.: The bridge of iconicity: from a world of experience to the experience of language. Phil. Trans. Roy. Soc. B 369(1651), 20130300 (2014)
Piccolo Labs (2018). https://www.piccololabs.com
Rautaray, S.S., Agrawal, A.: A vision based hand gesture interface for controlling VLC media player. Int. J. Comput. Appl. (2010) ISSN 0975-8887
Rico, J.: Evaluating the social acceptability of multimodal mobile interactions. In: Proceedings of CHI 2010 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2010), pp. 2887ā2890. ACM Press, New York (2010)
Rempel, D., Camilleri, M.J., Lee, D.L.: The design of hand gestures for human-computer interaction: lessons from sign language interpreters. Int. J. Hum.-Comput. Stud. 72, 728ā735 (2014)
Rico, J., Brewster, S.A.: Usable gestures for mobile interfaces: evaluating social acceptability. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM Press, New York (2010)
Samsung: SmartTV Guide Book (2013). http://www.samsung.com/ph/smarttv/common/guide_book_3p_si/waving.html
Vatavu, R.-D.: User-defined gestures for free-hand TV control. In: Proceedings of the 10th European Conference on Interactive TV and Video (EuroITV 2012), pp. 45ā48. ACM Press, New York (2012)
Vatavu, R.-D., Wobbrock, J.O.: Formalizing agreement analysis for elicitation studies: new measures, significance test, and toolkit. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 1325ā1334. ACM Press, New York (2015)
Venkatesh, V., Davis, F.D.: A theoretical extension of the technology acceptance model: four longitudinal field studies. Manag. Sci. 46(2), 186ā204 (2000)
Verma, S., Bansal, H., Sorathia, K.: A study for investigating suitable gesture based selection for gestural user interfaces. In: Proceedings of the 7th International Conference on HCI (IndiaHCI), pp. 47ā55. ACM Press, New York (2015)
Sweetser, E., Stec, K.: Maintaining multiple viewpoints in gaze. In: Dancygier, B., Wei-lun, L., Verhagen, A. (eds.) Viewpoint and the Fabric of Meaning: Form and Use of Viewpoint Tools across Languages and Modalities, pp. 237ā257. Mouton de Gruyter, Berlin (2016)
Taniberg, A., Botin, L., Stec, K.: Context of use affects the social acceptability of gesture interaction. In: Proceedings of NordiCHI 2018, the 10th Nordic Conference on Human-Computer Interaction, pp. 731ā735 (2018)
Weiser, M., Brown, J.S.: The coming age of calm technology. In: Denning, P.J., Metcalfe, R.M. (eds.) Beyond Calculation: The Next Fifty Years of Computing, pp. 75ā85. Springer, New York (1997). https://doi.org/10.1007/978-1-4612-0685-9_6
Williamson, J.R.: User experience, performance, and social acceptability: usable multimodal mobile interaction. Ph.D. dissertation, University of Glasgow, Glasgow, Scotland (2012)
Wobbrock, J.O., Morris, M.R., Wilson, A.D.: User-defined gestures for surface computing. In: Proceedings of CHI 2009. ACM Press, New York (2009)
Wolf, K.: Microgesturesāenabling gesture input with busy hands. In: Bakker, S., Hausen, D., Selker, T. (eds.) Peripheral Interaction. HIS, pp. 95ā116. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-29523-7_5
ZaiÅ£i, I.-A., Pentiuc, Å.-G., Vatavu, R.-D.: On free-hand TV control: experimental results on user-elicited gestures with Leap Motion. Pers. Ubiquit. Comput. 19(5ā6), 821ā838 (2015)
Acknowledgements
Most of the reported study was carried out by the first two authors as their bachelorās thesis project at Aalborg University [34]. We wish to thank all participants for lending us their time, as well as Aalborg University and Bang and Olufsen for financial support.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
Ā© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Nielsen, S., Nellemann, L.J., Larsen, L.B., Stec, K. (2020). The Social Acceptability of Peripheral Interaction with 3D Gestures in a Simulated Setting. In: Kurosu, M. (eds) Human-Computer Interaction. Multimodal and Natural Interaction. HCII 2020. Lecture Notes in Computer Science(), vol 12182. Springer, Cham. https://doi.org/10.1007/978-3-030-49062-1_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-49062-1_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49061-4
Online ISBN: 978-3-030-49062-1
eBook Packages: Computer ScienceComputer Science (R0)