Abstract
In this paper, we propose a user interface for large displays that allows pointing operations from a wide area. Two fisheye cameras installed on both sides of the display are used to capture images of a wide area in front of the display, and the system recognizes the user’s skeleton and allows the user to perform pointing operation. Due to the wide viewing angle of the fisheye cameras, the baseline length between the cameras can be long. The experimental result showed that the pointing accuracy was higher with the fisheye cameras than with the standard cameras when operating at the same distance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Jota, R., Nacenta, M., Jorge, J., Carpendale, S., Greenberg, S.: A comparision of ray pointing techniques for very large displays. In: Proceedings of Graphics Interface, pp. 269–276 (2010)
Rateau, H., Rekik, Y., Grisoni, L., Jorge, J.: Talaria: Continuous drag & drop on a wall display. In: Proceedings of the ACM International Conference on Interactive Surfaces and Spaces, pp. 199–204 (2016)
Matulic, F., Vogel, D.: Multiray: multi-finger raycasting for large displays. In: Proceedings of the CHI Conference on Human Factors in Computing Systems, Article No. 245 (2018)
Pietroszek, K., Tahai, L., Wallace, J., Lank, E.: Watchcasting: freehand 3D interaction with off-the-shelf smartwatch. In: Proceedings of IEEE Symposium on 3D User Interface, pp. 172–175 (2017)
Haque, F., Nancel, M., Vogel, D.: Myopoint: pointing and clicking using forearm mounted electromyography and inertial motion sensors. In: Proceedings of the Annual ACM Conference on Human Factors in Computing Systems, pp. 3653–3656 (2015)
Schick, A., van de Camp, F., Ijsselmuiden, J., Stiefelhagen, R.: Extending touch: towards interaction with large-scale surfaces. In: Proceedings of ACM International Conference on Interactive Tabletops and Surfaces, pp. 117–124 (2009)
Hu, K., Canavan, S., Yin, L.: Hand pointing estimation for human computer interaction based on two orthogonal-views, In: Proceedings of International Conference on Pattern Recognition, pp. 3760–3763 (2010)
Matsuda, Y., Komuro, T.: Dynamic layout optimization for multi-user interaction with a large display. In: Proceedings of the International Conference on Intelligent User Interfaces, pp. 401–409 (2020)
Endo, Y., Fujita, D., Komuro, T.: Distant pointing user interfaces based on 3D hand pointing recognition. In: Proceedings of ACM International Conference on Interactive Surfaces and Spaces, pp. 413–416 (2017)
Makela, V., James, J., Keskinen, T., Hakulinen, J., Turunen, M.: It’s natural to grab and pull: retrieving content from large displays using mid-air gestures. IEEE Pervasive Comput. 16(3), 70–77 (2017)
Cao, Z., Hidalgo, G., Simon, T., Wei, S., Sheikh, Y.: OpenPose: realtime multi-person 2D pose estimation using part affinity fields. IEEE Trans. Pattern Anal. Mach. Intell. 43(1), 172–186 (2021)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Kuramochi, A., Komuro, T. (2021). 3D Hand Pointing Recognition over a Wide Area using Two Fisheye Cameras. In: Stephanidis, C., et al. HCI International 2021 - Late Breaking Papers: Multimodality, eXtended Reality, and Artificial Intelligence. HCII 2021. Lecture Notes in Computer Science(), vol 13095. Springer, Cham. https://doi.org/10.1007/978-3-030-90963-5_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-90963-5_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-90962-8
Online ISBN: 978-3-030-90963-5
eBook Packages: Computer ScienceComputer Science (R0)