Gesture-Based Communication via User Experience Design: Integrating Experience into Daily Life for an Arm-Swing Input Device

  • Nuanphan KaewpanukrangsiEmail author
  • Chutisant Kerdvibulvech
Original Paper


Arm swing is a well-known exercise practiced throughout Asia. The benefits of regular exercise affect a person’s gait, shoulder function as well as head and body strength. This paper presents a new study of gesture-based communication by using arm swing as a gestural input command applied to any digital device used by persons aged 21–50 years of age during their workday. In five difference occupations, i.e., student, lecturer, office workers, designer and industrial worker, with different routine tasks were studied. The sampling comprised 30 participants, 6 persons representing each occupation. Data were collected through focus groups. The objective of this study is to provide possibilities to integrate proper user experience of gesture-based communication toward an arm-swing input device onto participants’ routine activities. It is believed this research can have a significant impact on quality on human daily lives. A part of user experience methodology, like a field experiment, is applied to provoke participants to follow the correct sequence case by case. This paper adopts user experience measurement for this qualitative research approach. A proper user experience occurs when one understands how strength and weakness are affected by gestural input. An input gesture, feedback, system and output can then be mapped together into a complete scenario of a person’s daily life. Each participant is encouraged to raise various ideas on how he/she accesses technology rather than on how technologies allow them to access information. Based on the experimental results, this paper will then discuss the possible tasks performed in the five occupations in which an arm-swing input gesture is integrated. The influence of this integration into the participants’ daily activities presents confirmation of a preferable wearable input device for all focus groups. This wearable input device can then be integrated into activities without any interruption in a person’s main actions.


Input device Gesture-based communication User experience Gesture interaction Wearable computing Interface design 



  1. 1.
    Barnes OR, Hejrati B, Abbott JJ (2015) An underactuated wearable arm-swing rehabilitator for gait training. In: 2015 IEEE international conference on robotics and automation (ICRA), pp 4998–5003Google Scholar
  2. 2.
    Barnes OR (2015) A wearable underactuated kinesthetic device for inducing arm swing during gait rehabilitation. Master’s Thesis, The University of UtahGoogle Scholar
  3. 3.
    Billinghurst M, Raffle H (2014) The glass classes. In: Proceedings of the extended abstracts of the 32nd annual ACM conference on human factors in computing systems—CHI EA’14, pp 1041–1042.
  4. 4.
    Chan L, Chen CHY, Yang S (2015) Cyclops: wearable and single-piece full-body gesture input devices. Chi 2015:3001–3009. CrossRefGoogle Scholar
  5. 5.
    Cooper A, Reinmann R, Cronin D (2007) About Face 30: the essentials of interaction design. Information visualization, vol 3. Wiley, Hoboken. CrossRefGoogle Scholar
  6. 6.
    Ferraro V, Ugur S (2011). Designing wearable technologies through a user centered approach. In: Proceedings of the 2011 conference on designing pleasurable products and interfaces—DPPI’11, (c), 1.
  7. 7.
    Friedman N, Rowe JB, Reinkensmeyer DJ, Bachman M (2014) The manumeter: a wearable device for monitoring daily use of the wrist and fingers. IEEE J Biomed Health Inform 18(6):1804–1812. CrossRefGoogle Scholar
  8. 8.
    Fronemann N, Peissner M (2014) User experience concept exploration. In: Proceedings of the 8th Nordic conference on human–computer interaction fun, fast, foundational—NordiCHI’14, pp 727–736.
  9. 9.
    Fu J, Jiang B, Yang X (2016) Research on natural gesture interaction of smartwatch. In: Proceedings of 2016 8th international conference on intelligent human–machine systems and cybernetics, IHMSC 2016, vol 2, pp 566–569.
  10. 10.
    Gleeson B, MacLean K, Croft E, Alcazar J (2013) Gestures for industry. In: Proceedings of the ACM/IEEE international conference on human–robot interaction, pp 349–356.
  11. 11.
    Grandhi SA, Joue G, Mittelberg I (2011) Understanding naturalness and intuitiveness in gesture production. In: Proceedings of the 2011 annual conference on human factors in computing systems—CHI’11, p 821.
  12. 12.
    Jewpattanakul Y, Reungthongdee U, Tabkeaw T (2012) The effect of the arm swing exercise with family participation program on exercise behavior in elderly with essential hyp. J Nurs Sci 30(2):46–57Google Scholar
  13. 13.
    Kerdvibulvech C (2015) Hand tracking by extending distance transform and hand model in real-time. Pattern Recognit Image Anal 25(3):437–441CrossRefGoogle Scholar
  14. 14.
    Kerdvibulvech C, Saito H (2007) Vision-based guitarist fingering tracking using a Bayesian classifier and particle filters. Pacific-rim symposium on image and video technology, pp 625–638Google Scholar
  15. 15.
    Kobayashi T, Sekiyama K, Aoyama T, Hasegawa Y, Fukuda T (2015) Optimal use of arm-swing for bipedal walking control. In: Proceedings of IEEE international conference on robotics and automation, 2015 June, pp 5698–5703Google Scholar
  16. 16.
    Koo H, Lee S (2016) Gait analysis on the condition of arm swing in healthy young adults. Phys Ther Rehabil Sci 5:149–154. CrossRefGoogle Scholar
  17. 17.
    Lee JC (2010) In search of a natural gesture. XRDS: crossroads. ACM Mag Stud 16(4):9–12. CrossRefGoogle Scholar
  18. 18.
    Lee U, Song J, Lee J, Ko M, Lee C, Kim Y, Chung K-M (2014) Hooked on smartphones. In: Proceedings of the 32nd annual ACM conference on human factors in computing systems—CHI’14, pp 2327–2336.
  19. 19.
    Leelayuwat N (2006) Effects of arm exercise on metabolic parameters in type 2 diabetic patients (unpublished research report). KhonKaen University, ThailandGoogle Scholar
  20. 20.
    Morgan M, Hong X, Joel M, Matthew J, Wyatt P, William C, William K, Joshua L, Betsy W (2015) Myo arm: swinging to explore a VE. In: Proceedings of the ACM SIGGRAPH symposium on applied perception (SAP’15), ACM, New York, pp 107–113Google Scholar
  21. 21.
    Nguyen KD, Chen IM, Luo Z, Yeo SH, Duh HBL (2011) A wearable sensing system for tracking and monitoring of functional arm movement. IEEE ASME Trans Mechatron 16(2):213–220. CrossRefGoogle Scholar
  22. 22.
    Nicholas M, Lynne B, Stephen U (2016) Time to exercise! an aide-memoire stroke app for post-stroke arm rehabilitation. In: Proceedings of the 18th international conference on human–computer interaction with mobile devices and services (MobileHCI’16). ACM, New York, pp 112–123Google Scholar
  23. 23.
    Nor RM, Muhlberger R (2010) Designing to support empathy: understanding user experience by using a model of interaction in meeting human needs. In: 2010 International conference on user science and engineering (I-USEr), pp 7–10.
  24. 24.
    Roggen D, Perez DG, Fukumoto M, Van Laerhoven K (2014) ISWC 2013—wearables are here to stay. IEEE Pervasive Comput 13(1):14–18. CrossRefGoogle Scholar
  25. 25.
    Schifferstein HNJ (2011) Multi-sensory design. In: Proceedings of the second conference on creativity and innovation in design—DESIRE’11, p 361.
  26. 26.
    Scholl J, Drugge M (2003) Wearable computing past, present and future. Past & PresentGoogle Scholar
  27. 27.
    Starner T (1996) Human-powered wearable computing. IBM Syst J 35(3.4):618–629. CrossRefGoogle Scholar
  28. 28.
    Wang, I, Narayana, P, Patil, D, Mulay, G, Bangar R, Draper B, Ruiz J(2017) Exploring the use of gesture in collaborative tasks. In: Proceedings of conference on human factors in computing systems, part F1276, pp 2990–2997.
  29. 29.
    Yamamoto T, Terada T, Tsukamoto M (2011) Designing gestures for hands and feet in daily life. In: Proceedings of the 9th international conference on advances in mobile computing and multimedia—MoMM’11, p 285.
  30. 30.
    Kompagorn L (2012) The cause and effect of office syndrome presentation. Accessed 18 May 2017

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Graduate School of Communication Arts and Management InnovationNational Institute of Development AdministrationBangkokThailand

Personalised recommendations