Abstract
Interactive surfaces like tabletop computers provide large touch-enabled displays, support novel forms of interaction and collaboration, and extend computation to new environments. However, being a novel platform, the existing application pool is limited and applications existing for other platforms have to be re-developed. At the same time, smartphones are pervasive computers that users carry around and with a large pool of applications. This paper presents TIDE, a lightweight device composition middleware to bring existing smartphone applications onto the tabletop. Through TIDE, applications running on the smartphone are displayed on the tabletop computer, and users can interact with them through the tabletop’s interactive surface. TIDE contributes to the areas of device composition and tabletops by providing an OS-level middleware that is transparent to the smartphone applications, maintaining privacy by limiting content transfer between devices, and enhancing the usefulness of tabletops with already existing smartphone applications and software developers. We present the design and implementation of TIDE, the study of different interaction techniques to manipulate TIDE’s interactive content, and an analysis of different research directions. Initial user feedback shows that TIDE is easy to use, learnable, and convenient for collaborative activities and private environments.
Chapter PDF
Similar content being viewed by others
Keywords
References
Arthur, R., Olsen Jr., D.R.: Xice windowing toolkit: Seamless display annexation. ACM Trans. Comput.-Hum. Interact. 18, 14:1–14:46 (2011)
Bardram, J.E., Fuglsang, C., Pedersen, S.C.: Compute: a runtime infrastructure for device composition. In: Proc. AVI 2010 (2010)
Baur, D., Boring, S., Feiner, S.: Virtual projection: Exploring optical projection as a metaphor for multi-device interaction. In: Proc. CHI 2012. ACM (2012)
Chehimi, F., Rukzio, E.: Throw your photos: an intuitive approach for sharing between mobile phones and interactive tables. In: Proc. Ubicomp 2010, pp. 443–444. ACM (2010)
Gjerlufsen, T., Nylandsted Klokmose, C., Eagan, J., Pillias, C., Beaudouin-Lafon, M.: Shared substance: developing flexible multi-surface applications. In: Proc. of CHI 2011 (2011)
Hartmann, B., Morris, M.R., Benko, H., Wilson, A.: Augmenting Interactive Tables with Mice and Keyboards. In: Proc. of UIST 2009. ACM (2009)
Hartmann, B., Morris, M.R., Benko, H., Wilson, A.D.: Pictionaire: supporting collaborative design work by integrating physical and digital artifacts. In: Proc. of CSCW 2010 (2010)
Hunter, S., Maes, P., Scott, S., Kaufman, H.: MemTable: an integrated system for capture and recall of shared histories in group workspaces. In: Proc. of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2001, pp. 3305–3314. ACM (2001)
Johanson, B., Fox, A., Winograd, T.: The interactive workspaces project: experiences with ubiquitous computing rooms. Pervasive Computing 1(2), 67–74 (2002)
Jordà, S., Geiger, G., Alonso, M., Kaltenbrunner, M.: The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces. In: Proc. of TEI 2007 (2007)
Karmouch, E., Nayak, A.: A distributed protocol for virtual device composition in mobile ad hoc networks. In: Proc. of ICC 2009, pp. 1–6. IEEE (2009)
Lee, J.W., Kim, S.M., Lim, H., Schuster, M., Domene, A.: A software architecture for virtual device composition and its applications. In: Ichikawa, H., Cho, W.-D., Satoh, I., Youn, H.Y. (eds.) UCS 2007. LNCS, vol. 4836, pp. 150–157. Springer, Heidelberg (2007)
Lyons, K., Pering, T., Rosario, B., Sud, S., Want, R.: Multi-display composition: Supporting display sharing for collocated mobile devices. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5726, pp. 758–771. Springer, Heidelberg (2009)
McGrath, W., Bowman, B., McCallum, D., Hincapié-Ramos, J.D., Elmqvist, N., Irani, P.: Branch-explore-merge: facilitating real-time revision control in collaborative visual exploration. In: Proc. of ITS 2012. ACM (2012)
Mistry, P., Maes, P.: SixthSense: a wearable gestural interface. In: ACM SIGGRAPH ASIA 2009 Sketches, p. 11. ACM (2009)
Mukhtar, H., Belaïd, D., Bernard, G.: User Preferences-Based Automatic Device Selection for Multimedia User Tasks in Pervasive Environments. In: Proc. of the 2009 Fifth International Conference on Networking and Services, ICNS 2009 (2009)
Newman, M.W., Elliott, A., Smith, T.F.: Providing an integrated user experience of networked media, devices, and services through end-user composition. In: Indulska, J., Patterson, D.J., Rodden, T., Ott, M. (eds.) PERVASIVE 2008. LNCS, vol. 5013, pp. 213–227. Springer, Heidelberg (2008)
Olwal, A., Wilson, A.D.: Surfacefusion: unobtrusive tracking of everyday objects in tangible user interfaces. In: Proc. of GI 2008, Toronto, pp. 235–242 (2008)
Pinhanez, C.: The everywhere displays projector: A device to create ubiquitous graphical interfaces. In: Abowd, G.D., Brumitt, B., Shafer, S. (eds.) UbiComp 2001. LNCS, vol. 2201, pp. 315–331. Springer, Heidelberg (2001)
Rekimoto, J., Saitoh, M.: Augmented surfaces: a spatially continuous work space for hybrid computing environments. In: Proc. of CHI 1999, pp. 378–385. ACM (1999)
Richardson, T., Stafford-Fraser, Q., Wood, K.R., Hopper, A.: Virtual network computing. Internet Computing 2, 33–38 (1998)
Rogers, Y., Hazlewood, W., Blevis, E., Lim, Y.-K.: Finger talk: collaborative decision making using talk and fingertip interaction around a tabletop display. In: Proc. of CHI E.A. 2004, pp. 1271–1274. ACM (2004)
Roman, M., Hess, C., Cerqueira, R., Ranganathan, A., Campbell, R.H., Nahrstedt, K.: A middleware infrastructure for active spaces. IEEE Pervasive Computing 1(4), 74–83 (2002)
Schmidt, D., Chehimi, F., Rukzio, E., Gellersen, H.: Phonetouch: a technique for direct phone interaction on surfaces. In: Proc. UIST 2010, pp. 13–16. ACM (2010)
Schuster, M., Domene, A., Vaidya, R., Arbanowski, S., Kim, S.M., Lee, J.W., Lim, H.: Virtual device composition. In: Proc. of the Eighth International Symposium on Autonomous Decentralized Systems, ISADS 2007, pp. 270–278. IEEE (2007)
Sicard, L.: TIDE - Using Device Composition on Tabletop Computers to Extend the Smartphone Experience, Master Thesis, IT University of Copenhagen (2012)
Streitz, N.A., Geissler, J., Holmer, T., Konomi, S., Müller-Tomfelde, C., Reischl, W., Rexroth, P., Seitz, P., Steinmetz, R.: I-land: an interactive landscape for creativity and innovation. In: Proc. of CHI 1999, pp. 120–127. ACM (1999)
Tabard, A., Hincapié-Ramos, J.D., Bardram, J.E.: The eLabBench in the wild: supporting exploration in a molecular biology lab. In: Proc. of CHI 2012, pp. 3051–3060. ACM (2012)
Tabard, A., Hincapié-Ramos, J.D., Esbensen, M., Bardram, J.E.: The elabbench: an interactive tabletop system for the biology laboratory. In: Proc. of ITS 2011, pp. 202–211. ACM (2011)
Tandler, P.: Software infrastructure for ubiquitous computing environments: Supporting synchronous collaboration with heterogeneous devices. In: Abowd, G.D., Brumitt, B., Shafer, S. (eds.) UbiComp 2001. LNCS, vol. 2201, pp. 96–115. Springer, Heidelberg (2001)
Virolainen, A., Paldanius, M., Lehtiö, A., Häkkilä, J.: Projector-based Multi-touch Screen for Situated Interaction with a Mobile Phone. In: Mobile and Personal Projection Workshop at CHI 2011 (2011)
Want, R.: Near Field Communication (NFC). IEEE Pervasive Computing, Smart Phone Dept. 10(3), 4–7 (2011)
Wigdor, D., Jiang, H., Forlines, C., Borkin, M., Shen, C.: WeSpace: the design development and deployment of a walk-up and share multi-surface visual collaboration system. In: Proc. of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2009, pp. 1237–1246. ACM (2009)
Wilson, A.D., Sarin, R.: Bluetable: connecting wireless mobile devices on interactive surfaces using vision-based handshaking. In: Proc. GI 2007, pp. 119–125. ACM (2007)
Winkler, C., Reinartz, C., Nowacka, D., Rukzio, E.: Interactive phone call: synchronous remote collaboration and projected interactive surfaces. In: Proc. of ITS 2011 (2011)
Wobbrock, J.O., Morris, M.R., Wilson, A.D.: User-defined gestures for surface computing. In: Proc. of CHI 2009, pp. 1083–1092. ACM (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sicard, L., Tabard, A., Hincapié-Ramos, J.D., Bardram, J.E. (2013). TIDE: Lightweight Device Composition for Enhancing Tabletop Environments with Smartphone Applications. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2013. INTERACT 2013. Lecture Notes in Computer Science, vol 8120. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40498-6_13
Download citation
DOI: https://doi.org/10.1007/978-3-642-40498-6_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40497-9
Online ISBN: 978-3-642-40498-6
eBook Packages: Computer ScienceComputer Science (R0)