Abstract
Multi-touch interaction has received considerable attention in the last few years, in particular for natural two-dimensional (2D) interaction. However, many application areas deal with three-dimensional (3D) data and require intuitive 3D interaction techniques therefore. Indeed, virtual reality (VR) systems provide sophisticated 3D user interface, but then lack efficient 2D interaction, and are therefore rarely adopted by ordinary users or even by experts. Since multi-touch interfaces represent a good trade-off between intuitive, constrained interaction on a touch surface providing tangible feedback, and unrestricted natural interaction without any instrumentation, they have the potential to form the foundation of the next generation user interface for 2D as well as 3D interaction. In particular, stereoscopic display of 3D data provides an additional depth cue, but until now the challenges and limitations for multi-touch interaction in this context have not been considered. In this paper we present new multi-touch paradigms and interactions that combine both traditional 2D interaction and novel 3D interaction on a touch surface to form a new class of multi-touch systems, which we refer to as interscopic multi-touch surfaces (iMUTS). We discuss iMUTS-based user interfaces that support interaction with 2D content displayed in monoscopic mode and 3D content usually displayed stereoscopically. In order to underline the potential of the proposed iMUTS setup, we have developed and evaluated two example interaction metaphors for different domains. First, we present intuitive navigation techniques for virtual 3D city models, and then we describe a natural metaphor for deforming volumetric datasets in a medical context.
Chapter PDF
Similar content being viewed by others
References
Bowman, D., Kruijff, E., LaViola, J., Poupyrev, I.: 3D User Interfaces: Theory and Practice. Addison-Wesley, Reading (2004)
Balakrishnan, R.: A Grant of 3D. Why aren’t we using 3D user interfaces, and will we ever? (3D User Interfaces Keynote) (2006)
Myers, B.A.: A taxonomy of window manager user interfaces. IEEE Comput. Graph. Appl. 8(5), 65–84 (1988)
Chun, W.S., Napoli, J., Cossairt, O.S., Dorval, R.K., Hall, D.M., Purtell II, T.J., Schooler, J.F., Banker, Y., Favalora, G.E.: Spatial 3-D Infrastructure: Display-Independent Software Framework, High-Speed Rendering Electronics, and Several New Displays. In: Stereoscopic Displays and Virtual Reality Systems XII, vol. 5664, pp. 302–312 (2005)
Conner, D.B., Snibbe, S.C., Herndon, K.P., Robbins, D.C., Zeleznik, R.C., van Dam, A.: Three-Dimensional Widgets. In: Symposium on Interactive 3D Graphics (1992)
Hanson, A.J., Wernert, E.: Constrained 3D Navigation with 2D Controllers. In: Proceedings of Visualization 1997, pp. 175–182. IEEE Computer Society Press, Los Alamitos (1997)
Salzman, T., Stachniak, S., Stürzlinger, W.: Unconstrained vs. Constrained 3D scene manipulation. In: Nigay, L., Little, M.R. (eds.) EHCI 2001. LNCS, vol. 2254, p. 207. Springer, Heidelberg (2001)
Steinicke, F., Ropinski, T., Bruder, G., Hinrichs, K.: Interscopic User Interface Concepts for Fish Tank Virtual Reality Systems. In: Proceedings of the Virtual Reality, pp. 27–34 (2007)
Dietz, P., Leigh, D.: DiamondTouch: a multi-user touch technology. In: Proceedings of the 14th annual ACM symposium on User interface software and technology, pp. 219–226 (2001)
Han, J.Y.: Low-cost multi-touch sensing through frustrated total internal reflection. In: UIST 2005: Proceedings of the 18th annual ACM symposium on User interface software and technology, pp. 115–118. ACM, New York (2005)
Malik, S., Laszlo, J.: Visual touchpad: a two-handed gestural input device. In: Proceedings of the 6th international conference on Multimodal interfaces, pp. 289–296 (2004)
Peltonen, P., Kurvinen, E., Salovaara, A., Jacucci, G., Ilmonen, T., Evans, J., Oulasvirta, A., Saarikko, P.: It’s mine, don’t touch!: interactions at a large multi-touch display in a city centre. In: CHI 2008: Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, pp. 1285–1294. ACM, New York (2008)
Schöning, J., Brandl, P., Daiber, F., Echtler, F., Hilliges, O., Hook, J., Löchtefeld, M., Motamedi, N., Muller, L., Olivier, P., Roth, T., von Zadow, U.: Multi-touch surfaces: A technical guide. Technical report, Technical University of Munich (2008)
Buxton, W., Myers, B.: A study in two-handed input. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 321–326 (1986)
Lee, S., Buxton, W., Smith, K.: A multi-touch three dimensional touch-sensitive tablet. ACM SIGCHI Bulletin 16(4), 21–25 (1985)
Matsushita, N., Rekimoto, J.: HoloWall: designing a finger, hand, body, and object sensitive wall. In: Proceedings of the 10th annual ACM symposium on User interface software and technology, pp. 209–210 (1997)
Epps, J., Lichman, S., Wu, M.: A study of hand shape use in tabletop gesture interaction. In: CHI 2006: CHI 2006 extended abstracts on Human factors in computing systems, pp. 748–753. ACM, New York (2006)
Wu, M., Balakrishnan, R.: Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. In: Proceedings of the 16th annual ACM Symposium on User Interface Software and Technology, pp. 193–202 (2003)
Schöning, J., Hecht, B., Raubal, M., Krüger, A., Marsh, M., Rohs, M.: Improving Interaction with Virtual Globes through Spatial Thinking: Helping users Ask “Why?”. In: IUI 2008: Proceedings of the 13th annual ACM conference on Intelligent User Interfaces. ACM Press, New York (2008)
Steinicke, F., Schöning, J., Krüger, A., Hinrichs, K.: Multi-touching cross-dimensional data: towards direct interaction in stereoscopic display environments coupled with mobile devices. In: AVI 2008: Workshop on designing multi-touch interaction techniques for coupled private and public displays (2008)
Grossman, T., Wigdor, D., Balakrishnan, R.: Multi-finger gestural interaction with 3d volumetric displays. In: SIGGRAPH 2005: ACM SIGGRAPH 2005 Papers, pp. 931–931. ACM, New York (2005)
Benko, H., Feiner, S.: Balloon selection: A multi-finger technique for accurate low-fatigue 3d selection. 3D User Interfaces (2007)
Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. IBM Systems Journal 39(3), 915–931 (2000)
Pierce, J., Forsberg, A., Conway, M., Hong, S., Zeleznik, R., Mine, M.: Image Plane Interaction Techniques in 3D Immersive Environments. In: ACM Symposium on Interactive 3D Graphics, pp. 39–44 (1997)
Mine, M.: Virtual Environments Interaction Technqiues. Technical Report TR95-018, UNC Chapel Hill Computer Science (1995)
Wilson, A.D., Izadi, S., Hilliges, O., Garcia-Mendoza, A., Kirk, D.: Bringing physics to the surface. In: UIST 2008: Proceedings of the 21st annual ACM symposium on User interface software and technology, pp. 67–76. ACM, New York (2008)
Broll, W., Lindt, I., Ohlenburg, J., Wittkämper, M., Yuan, C., Novotny, T., Fatah, A., Mottram, C., Strothmann, A.: Arthur: A collaborative augmented environment for architectural design and urban planning. Journal of Virtual Reality and Broadcasting (JVRB) 1(1), 1–10 (2004)
Feiner, S., MacIntyre, B., Haupt, M., Solomon, E.: Windows on the world: 2D windows for 3D augmented reality. In: Proceedings of the 6th annual ACM symposium on User interface software and technology, pp. 145–155. ACM, New York (1993)
Kaltenbrunner, M., Bovermann, T., Bencina, R., Costanza, E.: TUIO: A protocol for table-top tangible user interfaces. In: Proc. of the The 6th Intl. Workshop on Gesture in Human-Computer Interaction and Simulation (2005)
Benko, H., Wilson, A.D., Balakrishnan, R.: Sphere: multi-touch interactions on a spherical display. In: UIST 2008: Proceedings of the 21st annual ACM symposium on User interface software and technology, pp. 77–86. ACM, New York (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 IFIP International Federation for Information Processing
About this paper
Cite this paper
Schöning, J., Steinicke, F., Krüger, A., Hinrichs, K., Valkov, D. (2009). Bimanual Interaction with Interscopic Multi-Touch Surfaces. In: Gross, T., et al. Human-Computer Interaction – INTERACT 2009. INTERACT 2009. Lecture Notes in Computer Science, vol 5727. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03658-3_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-03658-3_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03657-6
Online ISBN: 978-3-642-03658-3
eBook Packages: Computer ScienceComputer Science (R0)