Abstract
Today’s mobile phones have not only become the most representative device in the new ubiquitous computing era but also dramatically improved in terms of their multi-modal sensing and display capabilities. This advance makes the mobile phone an ideal candidate for a more natural interaction device in ubiquitous computing environment. This paper proposes techniques which use camera-equipped mobile phones for interacting with 2D and 3D applications on a tabletop display environment. The camera acts as the main sensor for a gesture-based interaction. Using the mobile phone with an interactive touch screen allows the use of techniques that move beyond single hand/finger input to improve task performance. The interaction performances of the proposed techniques and design guidelines are also described in this paper.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Fitzmaurice, G.W., Zhai, S., Chignell, M.H.: Virtual Reality for Palmtop Computers. ACM Transactions on Information Systems 11, 197–218 (1993)
Watsen, K., Darken, R.P., Capps, M.: A Handheld Computer as an Interaction Device to a Virtual Environment. In: Proceedings of Intern. Projection Technologies Workshop (1999)
Kukimoto, N., Furusho, Y., Nonaka, J., Koyamada, K., Kanazawa, M.: PDA-based Visualization Control and Annotation Interface for Virtual Environment. In: Proceeding of 3rd IASTED International Conference Visualization, Image and Image Processing (2003)
Bayon, V., Griffiths, G.: Co-located interaction in virtual environments via de-coupled interfaces. In: HCI International 2003 (2003)
Madhavapeddy, A., Scott, D., Sharp, R., Upton, E.: Using camera-phones to enhance human-computer interaction. In: 6th International Conference on Ubiquitous Computing (2004)
Lourakis, M.I.A., Argyros, A.A.: Efficient, causal camera tracking in unprepared environments. Computer Vision and Image Understanding 99, 259–290 (2005)
Wagner, D., Schmalstieg, D.: First Steps Towards Handheld Augmented Reality. In: Proceedings of the 7th International Conference on Wearable Computers (2003)
Paelke, V., Reimann, C., Stichling, D.: Foot-based Mobile Interaction with Games. In: ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (ACE) (2004)
Hachet, M., Kitamura, Y.: 3D Interaction With and From Handheld Computers. In: IEEE VR 2005 Workshop: New Directions in 3D User Interfaces (2005)
Hachet, M., Pouderoux, J., Guitton, P.: A camera-based interface for interaction with mobile handheld computers. In: Proceedings of the 2005 symposium on Interactive 3D graphics and games Washington, District of Columbia (2005)
Rohs, M., Zweifel, P.: A Conceptual Framework for Camera Phone-based Interaction Techniques. In: Gellersen, H.-W., Want, R., Schmidt, A. (eds.) PERVASIVE 2005. LNCS, vol. 3468, pp. 171–189. Springer, Heidelberg (2005)
SpotCode, http://www.cl.cam.ac.uk/Research/SRG/netos/uid/spotcode.html
Bouguet, J.Y.: Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the Algorithm (2000)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jeon, S., Kim, G.J., Billinghurst, M. (2007). Interacting with a Tabletop Display Using a Camera Equipped Mobile Phone. In: Jacko, J.A. (eds) Human-Computer Interaction. Interaction Platforms and Techniques. HCI 2007. Lecture Notes in Computer Science, vol 4551. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73107-8_38
Download citation
DOI: https://doi.org/10.1007/978-3-540-73107-8_38
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73106-1
Online ISBN: 978-3-540-73107-8
eBook Packages: Computer ScienceComputer Science (R0)