Abstract
With the development of artificial intelligence, more and more attention has been paid to ho me intelligent terminal products. Compared with the common products, the family control intelligent terminal products are more complex in functional architecture and hierarchy, and the existing interactive gestures can not meet the functional requirements. The aim of this paper is to design a new interaction gesture for home control intelligent terminal. Analyzes the need and feasibility of using gesture interaction in this type of product and explores several factors that affect the accuracy of gesture interaction. We obtained user needs for product functions through questionnaire surveys, and then proposed four principles for gesture design for smart home products based on home control and designed a set of interactive gestures based on this criterion. Finally, we use Kinect V2 to perform gesture recognition experiments and issue a Likert scale questionnaire to obtain users’ subjective experience. The recognition rate of the gesture system is more than 80%, and it has good recognition ability. 0.5 m–4.5 m is the best recognition area. When the distance increases, the accuracy will decrease. However, due to the limitation of family space, there are few areas over 4.5 m. The subjective scores of users are over 9 points, indicating that the gesture system of the device has good recognition and user experience.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Panger, G.: Kinect in the kitchen: testing depth camera interactions in practical home environments. In: CHI 12 Extended Abstracts on Human Factors in Computing Systems (2012)
Mittal, Y., Toshniwal, P., Sharma, S., Singhal, D., Gupta, R., Mittal, V.K.: A voice-controlled multi-functional smart home automation system. In: 2015 Annual IEEE India Conference (INDICON), New Delhi, pp. 1–6 (2015)
Miroslav, B., Ondrej, K.R.: Vision of smart home point solution as sustainable intelligent house concept. IFAC Proc. Vol. 46(28), 383–387 (2013). ISSN 1474-6670, ISBN 9783902823533
Ji, R., Gong, M.S.: Application of natural interaction design in smart home. Packag. Eng. 40(22), 208–213 (2019)
Wan, H.G., Li, T., Feng, L.W., Chen, Y.S.: An approach to free-hand interaction for 3D scene modeling. Trans. Beijing Institute Technol. 39(02), 175–180 (2019)
Wu, H., Wang, J., Zhang, X.: User-centered gesture development in TV viewing environment. Multimed Tools Appl. 75, 733–760 (2016)
Ntoa, S., Birliraki, C., Drossis, G., Margetis, G., Adami, I., Stephanidis, C.: UX design of a big data visualization application supporting gesture-based interaction with a large display. In: Yamamoto, S. (ed.) HIMI 2017. LNCS, vol. 10273, pp. 248–265. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-58521-5_20
Ram, P.S., Verma, G.K.: Human computer interaction using hand gesture. Procedia Comput. Sci. 54, 721–727 (2015). ISSN 1877-0509
Li, X., Guan, D., Zhang, J., Liu, X., Li, S., Tong, H.: Exploration of ideal interaction scheme on smart TV: based on user experience research of far-field speech and mid-air gesture interaction. In: Marcus, A., Wang, W. (eds.) HCII 2019. LNCS, vol. 11584, pp. 144–162. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-23541-3_12
Min, L., Gu, W., Chen, W., He, Y., Wu, Y., Zhang, Y.: Smart home: architecture, technologies and systems. Procedia Comput. Sci. 131, 393–400 (2018). ISSN 1877-0509
Li, Y., Huang, J., Tian, F., Wang, H.-A., Dai, G.-Z.: Gesture interaction in virtual reality. Virtual Reality Intell. Hardware 1(1), 84–112 (2019). ISSN 2096-5796
Grandhi, S.A., Joue, G., Mittelberg, I.: Understanding naturalness and intuitiveness in gesture production: insights for touchless gestural interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 821–824. ACM (2011)
Wigdor, D., Wixon, D.: Brave NUI World: Designing Natural User Interfaces for Touch and Gesture. Elsevier, Amsterdam (2011)
Shin, Y.K., Choe, J.H.: Remote control interaction for individual environment of smart TV. In: IEEE International Symposium on Personal. IEEE Xplore (2011)
Annelies, K., Sujit, S.: Language ideologies on the difference between gesture and sign. Lang. Commun. 60, 44–63 (2018). ISSN 0271-5309
Dinh, D.-L., Jeong, T.K., Kim, T.-S.: Hand gesture recognition and interface via a depth imaging sensor for smart home appliances. Energy Procedia 62, 576–582 (2014). ISSN 1876-6102
Zhu, M.B., Li, S.: The housing inequality in China. Res. Econ. Manag. 39(09), 91–101 (2018)
Khaoula, B., Majida, L., Samira, K., Mohamed, L.K., Abir, E.Y.: AHP-based approach for evaluating ergonomic criteria. Procedia Manuf. 32, 856–863 (2019). ISSN 2351-9789
Gil, M., Lubiano, M., de la Rosa de Sáa, S., Sinova, B.: Analyzing data from a fuzzy rating scale-based questionnaire. A case study. Psicothema 27, 182–191 (2015)
Camargo, M., Wendling, L., Bonjour, E.: A fuzzy integral based methodology to elicit semantic spaces in usability tests. Int. J. Ind. Ergon. 44, 11–17 (2014)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Jiang, B., Wang, X., Wu, Y. (2020). Research on Gesture Interaction Design for Home Control Intelligent Terminals. In: Kurosu, M. (eds) Human-Computer Interaction. Multimodal and Natural Interaction. HCII 2020. Lecture Notes in Computer Science(), vol 12182. Springer, Cham. https://doi.org/10.1007/978-3-030-49062-1_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-49062-1_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49061-4
Online ISBN: 978-3-030-49062-1
eBook Packages: Computer ScienceComputer Science (R0)