Abstract
We describe a user interface and interaction technique, named ‘Javelin’, designed for large display environments. It provides quick access to random screen regions and manipulation methods for screen widgets which are difficult or impossible to reach. It consists of a dynamic global thumbnail, a touchpad widget that drives the screen cursor, and a teleport widget in which interactions are transferred to its target screen region. Javelin can be easily integrated into many programs to optimize their interaction performance in large screens. The experiment and user study show that Javelin can extend user access field and enhance widget manipulation in large displays.
Similar content being viewed by others
References
Albinsson, P., Zhai, S., 2003. High Precision Touch Screen Interaction. Proc. SIGCHI Conf. on Human Factors in Computing Systems, p.105–112. [doi:10.1145/642611.642631]
Badillo, B., Bowman, D.A., McConnel, W., Ni, T., Silva, M., 2006. Literature Survey on Interaction Techniques for Large Displays. Available from http://eprints.cs.vt.edu/archive/00000925/ [Accessed on Oct. 20, 2006].
Ball, R., North, C., 2005. Analysis of user behavior on high-resolution tiled displays. LNCS, 3585:350–363. [doi:10. 1007/11555261_30]
Benko, H., Wilson, A.D., Baudisch, P.M., 2006. Precise Selection Techniques for Multi-Touch Screens. US Patent 20070247435A1.
Bezerianos, A., Balakrishnan, R., 2005. The Vacuum: Facilitating the Manipulation of Distant Objects. Proc. SIGCHI Conf. on Human Factors in Computing Systems, p.361–370. [doi:10.1145/1054972.1055023]
Elvins, T.T., Nadeau, D.R., Schul, R., Kirsh, D., 2001. Worldlets: 3-D thumbnails for wayfinding in large virtual worlds. Pres. Teleoper. Virt. Environ., 10(6):565–582. [doi:10.1162/105474601753272835]
Guiard, Y., Blanch, R., Beaudouin-Lafon, M., 2004. Object Pointing: a Complement to Bitmap Pointing in GUIs. Proc. Graphics Interface, 62:9–16.
Johanson, B., Hutchins, G., Winograd, T., Stone, M., 2002. PointRight: Experience with Flexible Input Redirection in Interactive Workspaces. Proc. 15th Annual ACM Symp. on User Interface Software and Technology, p.227–234. [doi:10.1145/571985.572019]
Khan, A., Fitzmaurice, G., Almeida, D., Burtnyk, N., Kurtenbach, G., 2004. A Remote Control Interface for Large Displays. Proc. 17th Annual ACM Symp. on User Interface Software and Technology, p.127–136. [doi:10.1145/1029632.1029655]
Khan, A., Matejka, J., Fitzmaurice, G., Kurtenbach, G., 2005. Spotlight: Directing Users’ Attention on Large Displays. Proc. SIGCHI Conf. on Human Factors in Computing Systems, p.791–798. [doi:10.1145/1054972.1055082]
Lee, J.C., 2007. Johnny Chung Lee>Projects>Wii. Available from http://johnnylee.net/projects/wii/ [Accessed on Aug. 11, 2008].
Malik, S., 2007. An Exploration of Multi-Finger Interaction on Multi-Touch Surfaces. PhD Thesis, University of Toronto, Toronto, Canada.
Malik, S., Laszlo, J., 2004. Visual Touchpad: a Two-Handed Gestural Input Device. Proc. 6th Int. Conf. on Multimodal Interfaces, p.289–296. [doi:10.1145/1027933.1027980]
Matejka, J., Grossman, T., Lo, J., Fitzmaurice, G., 2009. The Design and Evaluation of Multi-Finger Mouse Emulation Techniques. Proc. 27th Int. Conf. on Human Factors in Computing Systems, p.1073–1082. [doi:10.1145/1518701.1518865]
Morris, M.R., Lombardo, J., Wigdor, D., 2010. WeSearch: Supporting Collaborative Search and Sensemaking on a Tabletop Display. Proc. ACM Conf. on Computer Supported Cooperative Work, p.401–410. [doi:10.1145/1718918.1718987]
Moscovich, T., 2007. Principles and Applications of Multi-Touch Interaction. PhD Thesis, Brown University, Providence, RI, USA.
O’Hara, K., Glancy, M., Robertshaw, S., 2008. Understanding Collective Play in an Urban Screen Game. Proc. ACM Conf. on Computer Supported Cooperative Work, p.67–76. [doi:10.1145/1460563.1460576]
Peltonen, P., Kurvinen, E., Salovaara, A., Jacucci, G., Ilmonen, T., Evans, J., Oulasvirta, A., Saarikko, P., 2008. It’s Mine, Don’t Touch!: Interactions at a Large Multi-Touch Display in a City Centre. Proc. 26th Annual SIGCHI Conf. on Human Factors in Computing Systems, p.1285–1294. [doi:10.1145/1357054.1357255]
Schikore, D.R., Fischer, R.A., Frank, R., Gaunt, R., Hobson, J., Whitlock, B., 2000. High-resolution multiprojector display walls. IEEE Comput. Graph. Appl., 20(4):38–44. [doi:10.1109/38.851748]
Sommer, R., 1969. Personal Space. The Behavioral Basis of Design. Prentice-Hall, Inc., Englewood Cliffs, New Jersey, USA.
Stoakley, R., Conway, M.J., Pausch, R., 1995. Virtual Reality on a WIM: Interactive Worlds in Miniature. Proc. SIGCHI Conf. on Human Factors in Computing Systems p.265–272. [doi:10.1145/223904.223938]
Stødle, D., Hagen, T., Bjørndalen, J.M., Anshus, O.J., 2008. Gesture-based, touch-free multi-user gaming on wall-sized, high-resolution tiled displays. J. Virt. Real. Broadcast., 5(10):0009-6–15001.
Tan, D.S., Meyers, B., Czerwinski, M., 2004. WinCuts: Manipulating Arbitrary Window Regions for More Effective Use of Screen Space. Conf. on Human Factors in Computing Systems, p.1525–1528. [doi:10.1145/985921.986106]
Wei, B., Silva, C., Koutsofios, E., Krishnan, S., North, S., 2000. Visualization research with large displays. IEEE Comput. Graph. Appl., 20(4):50–54. [doi:10.1109/38.851750]
Wilson, A.D., 2004. TouchLight: an Imaging Touch Screen and Display for Gesture-Based Interaction. Proc. 6th Int. Conf. on Multimodal Interfaces, p.69–76. [doi:10.1145/1027933.1027946]
Author information
Authors and Affiliations
Corresponding author
Additional information
Project supported by China Academic Digital Associative Library (CADAL)
Rights and permissions
About this article
Cite this article
Zhou, Zk., Wu, Jq., Zhang, Y. et al. Javelin: an access and manipulation interface for large displays. J. Zhejiang Univ. - Sci. C 11, 893–902 (2010). https://doi.org/10.1631/jzus.C1001008
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1631/jzus.C1001008
Key words
- Large display
- User interface
- Interaction method
- Screen widget
- Remote target acquisition
- Human-computer interaction (HCI)