Abstract
This paper presents AirMouse, a new interaction technique based on finger gestures above the laptop’s keyboard. At a reasonably low cost, the technique can replace the traditional methods for pointing in two or three dimensions. Moreover, the device-switching time is reduced and no additional surface than the one for the laptop is needed. In a 2D pointing evaluation, a vision-based implementation of the technique is compared with commonly used devices. The same implementation is also compared with the two most commonly used 3D pointing devices. The two user experiments show the benefits of the polyvalent technique: it is easy to learn, intuitive and efficient by providing good performance. In particular, our conducted experiment shows that performance with AirMouse is promising in comparison with a touchpad and with dedicated 3D pointing devices. It shows that AirMouse offers better performance as compared to FlowMouse, a previous solution using fingers above the keyboard.
Chapter PDF
Similar content being viewed by others
References
Smith, R.B.: Put-that-here: Voice and gesture at the graphics interface. Computer Graphics 14, 262–270 (1980)
Bowman, D.A., Kruijff, E., LaViola, J.J., Poupyrev, I.: 3D User Interfaces: Theory and Practice. Addison-Wesley Professional, Reading (2005)
Card, S.K., English, W.K., Burr, B.J.: Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys, for text selection on a crt. In: Human-Computer Interaction, pp. 386–392. Morgan Kaufmann Publishers Inc, San Francisco (1978)
Card, S.K., Morans, T.P., Newell, A.: The Psychology of Human Computer Interaction. Lawrence Erlbaum Associates, Inc, Mahwah (1983)
3D Connexion. Space navigator, http://www.3dconnexion.com
Dementhon, D., Davis, L.S.: Model-based object pose in 25 lines of code. International Journal on Computer Vision (1995)
Douglas, S.A., Mithal, A.K.: The effect of reducing homing time on the speed of a finger-controlled isometric pointing device. In: Computer-Human Interaction, pp. 411–416. ACM Press, New York (1994)
Fitts, P.M.: The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology 47(6), 381–391 (1954)
Grossman, T., Widgor, D., Balakrishnan, R.: Multi-finger gestural interaction with 3d volumetric displays. In: User Interface Software and Technology. ACM Press, New York (2004)
Han, J.Y.: Low-cost multi-touch sensing through frustrated total internal reflection. In: Symposium on User Interface Software and Technology. ACM Press, New York (2005)
Hancock, M., Carpendale, S., Cockburn, A.: Shallow-depth 3d interaction: Design and evaluation of one-, two- and three-touch techniques. In: Computer-Human Interaction (2007)
Natural Point http://www.naturalpoint.com . Trackir http://www.naturalpoint.com/trackir
Iddan, G.J., Yahav, G.: 3d imaging in the studio. SPIE (2001), http://www.3dvsystems.com.il
Jacob, R.J.K., Sibert, L.E.: The perceptual structure of multidimensional input device selection. In: SIGCHI conference on Human factors in computing systems (1992)
Kabbash, P., Buxton, W.: The “prince” technique: Fitts’ law and selection using area cursors. In: Computer-Human Interaction, pp. 273–279 (1995)
MacKenzie, I.S., Sellen, A., Buxton, W.: A comparison of input devices in elemental pointing and dragging tasks. In: Computer-Human Interaction, pp. 161–166 (1991)
Malik, S., Laszlo, J.: Visual touchpad: A two-handed gestural input device. In: ICMI (2004)
Massie, T.H., Salisbury, J.K.: The phantom haptic interface: A device for probing virtual objects. In: Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. ASME winter Meeting (1994)
Mysliwiec, T.A.: Fingermouse: A freehand computer pointing interface. Technical report for the degree of Masters of Science (October 1994)
Paljic, A., Burkhardt, J., Coquillart, S.: A study of distance of manipulation on the responsive workbench (2002)
Pierce, J.S., Stearns, B.C., Pausch, R.: Voodoo dolls: Seamless interaction at multiple scales in virtual environments. In: Symposium on Interactive 3D graphics (1999)
Qhueck, F.K.H.: Unencumbered gestural interaction. In: IEEE Multimedia (Winter 996)
Schneiderman, B.: Designing the User Interface: Strategies for Effective Human-Computer Interaction. Addison-Wesley Longman Publishing Co., Inc, Amsterdam (1986)
Shneiderman, B.: The future of interactive systems and the emergence of direct manipulation. Human Factors in Interactive Computer Systems (1983)
Soukoreff, R.W., MacKenzie, I.S.: Towards a standard for pointing device evaluation, perspectives on 27 years of fitts’ law research in hci. International Journal of Human-Computer Studies 61, 751–789 (2004)
Tory, M., Moller, T., Atkins, M.S., Kirkpatrick, A.E.: Combining 2d and 3d views for orientation and relative position tasks. In: CHI 2004: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 73–80. ACM Press, New York (2004)
Vogel, D., Balakrishnan, R.: Distant freehand pointing and clicking on very large, high resolution displays. In: User Interface Software and Technology (2005)
Wilson, A.D.: Robust computer vision-based detection of pinching for one and twohanded gesture input. In: User Interface Software and Technology. ACM Press, New York (2006)
Wilson, A.D., Cutrell, E.: Flowmouse: A computer vision-based pointing and gesture input device. In: INTERACT: human-computer interaction (2005)
Zhai, S.: Human Performance in 6dof Input Control. PhD Thesis (1995)
Zhai, S., Milgram, P.: Quantifying coordination in multiple dof movement and its application to evaluating 6 dof input devices. In: Computer-Human Interaction, pp. 320–327. ACM Press, New York (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 IFIP International Federation for Information Processing
About this paper
Cite this paper
Ortega, M., Nigay, L. (2009). AirMouse: Finger Gesture for 2D and 3D Interaction. In: Gross, T., et al. Human-Computer Interaction – INTERACT 2009. INTERACT 2009. Lecture Notes in Computer Science, vol 5727. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03658-3_28
Download citation
DOI: https://doi.org/10.1007/978-3-642-03658-3_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03657-6
Online ISBN: 978-3-642-03658-3
eBook Packages: Computer ScienceComputer Science (R0)