Abstract
Building on the observation that finger orientation is an inherent part of human’s interaction in the real world, exploiting finger orientation for multi-touch tabletop interaction would facilitate more natural interaction techniques. We motivate this by means of examples where the finger orientation improves or enriches interaction. Afterwards, we present a simple and fast approach to detect the finger orientation reliably for multi-touch tabletop interaction. The steps involved are computationally cheap and therefore suit the needs of tracking software operating under time-critical conditions. We show that the presented approach enables the detection of finger orientation also for fingers that touch the tabletop surface only slightly. Further, recognition rates on real data gained from the camera within a multi-touch tabletop are presented in order to give a measure for the precision and reliability of the presented approach.
Chapter PDF
References
Takeoka, Y., Miyaki, T., Rekimoto, J.: Z-touch: an infrastructure for 3d gesture interaction in the proximity of tabletop surfaces. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010, pp. 91–94. ACM, New York (2010)
Han, J.Y.: Low-cost multi-touch sensing through frustrated total internal reflection. In: UIST 2005: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 115–118. ACM, New York (2005)
Hofer, R., Naeff, D., Kunz, A.: Flatir: Ftir multi-touch detection on a discrete distributed sensor array. In: Proceedings of the 3rd International Conference on Tangible and Embedded Interaction, pp. 317–322. ACM, New York (2009)
Peltonen, P., Kurvinen, E., Salovaara, A., Jacucci, G., Ilmonen, T., Evans, J., Oulasvirta, A., Saarikko, P.: It’s mine, don’t touch!: interactions at a large multi-touch display in a city centre. In: CHI 2008, pp. 1285–1294. ACM, New York (2008)
NUIGroup: Multitouch techniques, http://nuigroup.com/forums/viewthread/1982
Dietz, P., Leigh, D.: Diamondtouch: a multi-user touch technology. In: UIST 2001: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 219–226. ACM, New York (2001)
Rekimoto, J.: Smartskin: an infrastructure for freehand manipulation on interactive surfaces. In: CHI 2002, pp. 113–120. ACM, New York (2002)
Apple inc., iphone, ipad, magic trackpad, http://www.apple.com
Microsoft surface, http://www.surface.com
Smart table, Smarttechnologies, http://www.smarttech.com
Archimedes solutions, http://www.multi-touch.de
Evoluce, Multitouch lcd monitors, http://www.evoluce.com
Dell, Latitude xt2, dell studio one 19, http://www.dell.com
HP Touchsmart tx2, touchsmart 600-1050de, http://www.hp.com
NUIGroup: Community core vision, http://ccv.nuigroup.com
Moscovich, T.: Contact area interaction with sliding widgets. In: UIST 2009: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, pp. 13–22. ACM, New York (2009)
Cao, X., Wilson, A.D., Balakrishnan, R., Hinckley, K., Hudson, S.E.: Shapetouch: Leveraging contact shape on interactive surfaces. In: Tabletop 2008, pp. 129–136 (2008)
Benko, H., Wilson, A.D., Baudisch, P.: Precise selection techniques for multi-touch screens. In: CHI 2006: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1263–1272. ACM, New York (2006)
Wang, F., Ren, X.: Empirical evaluation for finger input properties in multi-touch interaction. In: CHI 2009: Proceedings of the 27th International Conference on Human Factors in Computing Systems, pp. 1063–1072. ACM, New York (2009)
NUIGroup: Touchlib, a multi-touch development kit, http://www.nuigroup.com/touchlib
Wang, F., Cao, X., Ren, X., Irani, P.: Detecting and leveraging finger orientation for interaction with direct-touch surfaces. In: UIST 2009: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, pp. 23–32. ACM, New York (2009)
Vogel, D., Balakrishnan, R.: Occlusion-aware interfaces. In: Proceedings of the 28th International Conference on Human Factors in Computing Systems, CHI 2010, pp. 263–272. ACM, New York (2010)
Vogel, D., Baudisch, P.: Shift: a technique for operating pen-based interfaces using touch. In: Proceedings of the SIGCHI Conference on Human factors in Computing Systems, CHI 2007, pp. 657–666. ACM, New York (2007)
Wigdor, D., Perm, G., Ryall, K., Esenther, A., Shen, C.: Living with a tabletop: Analysis and observations of long term office use of a multi-touch table. In: Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems, TABLETOP 2007, pp. 60–67 (2007)
Yee, W.: Potential limitations of multi-touch gesture vocabulary: Differentiation, adoption, fatigue. In: Jacko, J.A. (ed.) HCI International 2009. LNCS, vol. 5611, pp. 291–300. Springer, Heidelberg (2009)
Dang, C.T., Straub, M., André, E.: Hand distinction for multi-touch tabletop interaction. In: ITS 2009: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, pp. 101–108. ACM, New York (2009)
Jennings, C.: Robust finger tracking with multiple cameras. In: Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems 1999 (1999)
Hung, Y.P., Yang, Y.S., Chen, Y.S., Hsieh, I.B., Fuh, C.S.: Free-hand pointer by use of an active stereo vision system. In: Proceedings of Fourteenth International Conference on Pattern Recognition 1998, vol. 2, pp. 1244–1246 (1998)
Malik, S., Laszlo, J.: Visual touchpad: a two-handed gestural input device. In: ICMI 2004: Proceedings of the 6th International Conference on Multimodal Interfaces, pp. 289–296. ACM, New York (2004)
Marquardt, N., Kiemer, J., Greenberg, S.: What caused that touch? expressive interaction with a surface through fiduciary-tagged gloves. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces ITS 2010, pp. 139–142. ACM, New York (2010)
OpenCV, open computer vision library, http://sourceforge.net/projects/opencvlibrary
Tianding, C.: A solution of computer vision based real-time hand pointing recognition. In: 27th Chinese Control Conference, CCC 2008, pp. 384–388 (2008)
Jackson, D., Bartindale, T., Olivier, P.: Fiberboard: compact multi-touch display using channeled light. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, pp. 25–28. ACM, New York (2009)
Izadi, S., Hodges, S., Butler, A., Rrustemi, A., Buxton, B.: Thinsight: integrated optical multi-touch sensing through thin form-factor displays. In: Proceedings of the 2007 Workshop on Emerging Displays Technologies: Images and Beyond: the Future of Displays and Interacton, EDT 2007. ACM, New York (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 IFIP International Federation for Information Processing
About this paper
Cite this paper
Dang, C.T., André, E. (2011). Usage and Recognition of Finger Orientation for Multi-Touch Tabletop Interaction. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2011. INTERACT 2011. Lecture Notes in Computer Science, vol 6948. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23765-2_28
Download citation
DOI: https://doi.org/10.1007/978-3-642-23765-2_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23764-5
Online ISBN: 978-3-642-23765-2
eBook Packages: Computer ScienceComputer Science (R0)