Bridging Digital and Physical Worlds Using Tangible Drag-and-Drop Interfaces

  • Mathieu Hopmann
  • Mario Gutierrez
  • Daniel Thalmann
  • Frederic Vexo
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6670)


The last ten years have seen an explosion in the diversity of digital-life devices, e.g. music and video players. However, the interaction paradigm to use these devices has remained mostly unchanged. Remote controls are still the most common way to manage a digital-life device. Moreover, the interaction between devices themselves is still very limited and rarely addressed by a remote control interface. We present in this paper a study of tangible drag-and-drop, a remote control interface based on the well-known paradigm coming from the graphical user interface. This interaction technique aims at reducing the gap between the digital and physical worlds, enabling the transfer of digital data from one device to another. To validate such a concept, we present two prototypes, along with user studies and a general discussion about the tangible drag-and-drop technique.


Interaction techniques Input devices Tangible interaction Remote control Drag-and-drop Multimedia content 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Alonso, M.B., Keyson, D.V.: MusicCube: making digital music tangible. In: CHI 2005 Extended Abstracts on Human Factors in Computing Systems (CHI 2005), pp. 1176–1179. ACM, New York (2005)Google Scholar
  2. 2.
    Edwards, W., Grinter, R.: At Home with Ubiquitous Computing: Seven Challenges. In: Abowd, G.D., Brumitt, B., Shafer, S. (eds.) UbiComp 2001. LNCS, vol. 2201, pp. 256–272. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  3. 3.
    Enright, A.C.: Dissatisfaction Sows Innovation,
  4. 4.
    Fitzmaurice, G.W., Ishii, H., Buxton, W.A.S.: Bricks: laying the foundations for graspable user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 1995), pp. 442–449. ACM Press, New York (1995)CrossRefGoogle Scholar
  5. 5.
    Graham, J., Hull, J.J.: Icandy: a tangible user interface for itunes. In: CHI 2008 Extended Abstracts on Human Factors in Computing Systems (CHI 2008), pp. 2343–2348. ACM, New York (2008)Google Scholar
  6. 6.
    Hassenzahl, M., Burmester, M., Koller, F.: AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualitt [AttracDiff: A questionnaire to measure perceived hedonic and pragmatic quality]. In: Ziegler, J., Szwillus, G. (eds.) Mensch & Computer 2003. Interaktion in Bewegung, pp. 187–196. B. G. Teubner, Stuttgart (2003)CrossRefGoogle Scholar
  7. 7.
    Hopmann, M., Thalmann, D., Vexo, F.: Tangible Drag-and-Drop: Transferring Digital Content with a Remote Control. In: Chang, M., Kuo, R., Kinshuk, Chen, G.-D., Hirose, M. (eds.) Learning by Playing. LNCS, vol. 5670, pp. 306–315. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  8. 8.
    Hsu, S.H., Jumpertz, S., Cubaud, P.: A tangible interface for browsing digital photo collections. In: Proceedings of the 2nd International Conference on Tangible and Embedded Interaction (TEI 2008), pp. 31–32. ACM, New York (2008)CrossRefGoogle Scholar
  9. 9.
    Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and atoms. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 1997), pp. 234–241. ACM, New York (1997)CrossRefGoogle Scholar
  10. 10.
    Lee, H., Jeong, H., Lee, J., Yeom, K.-W., Park, J.-H.: Gesture-Based Interface for Connection and Control of Multi-device in a Tabletop Display Environment. In: Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques, pp. 216–225. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  11. 11.
    Lee, H., Jeong, H., Lee, J., Yeom, K.-W., Shin, H.-J., Park, J.-H.: Select-and-point: a novel interface for multi-device connection and control based on simple hand gestures. In: CHI 2008 Extended Abstracts on Human Factors in Computing Systems (CHI 2008), pp. 3357–3362. ACM, New York (2008)Google Scholar
  12. 12.
    MacKenzie, I.S.: Fitts’ law as a research and design tool in human-computer interaction. Human-Computer Interaction 7, 91–139 (1992)CrossRefGoogle Scholar
  13. 13.
    Nunes, M., Greenberg, S., Neustaedter, C.: Sharing digital photographs in the home through physical mementos, souvenirs, and keepsakes. In: Proceedings of the 7th ACM Conference on Designing Interactive Systems (DIS 2008), pp. 250–260. ACM, New York (2008)CrossRefGoogle Scholar
  14. 14.
    Rekimoto, J.: Pick-and-drop: a direct manipulation technique for multiple computer environments. In: Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology (UIST 1997), pp. 31–39. ACM, New York (1997)Google Scholar
  15. 15.
    Rumbolt, R.B., McIntyre Jr., W.R.: Universal remote control unit. US Patent 4,774,511 (1988)Google Scholar
  16. 16.
    Seifried, T., Haller, M., Scott, S.D., Perteneder, F., Rendl, C., Sakamoto, D., Inami, M.: CRISTAL: a collaborative home media and device controller based on a multi-touch display. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS 2009), pp. 33–40. ACM, New York (2009)CrossRefGoogle Scholar
  17. 17.
    Seifried, T., Rendl, C., Perteneder, F., Leitner, J., Haller, M., Sakamoto, D., Kato, J., Inami, M., Scott, S.D.: CRISTAL, control of remotely interfaced systems using touch-based actions in living spaces. In: ACM SIGGRAPH 2009 Emerging Technologies (SIGGRAPH 2009), ACM, New York (2009) Article 6Google Scholar
  18. 18.
    Zigelbaum, J., Kumpf, A., Vazquez, A., Ishii, H.: Slurp: tangibility spatiality and an eyedropper. In: CHI 2008 Extended Abstracts on Human Factors in Computing Systems (CHI 2008), pp. 2565–2574. ACM, New York (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Mathieu Hopmann
    • 1
  • Mario Gutierrez
    • 1
  • Daniel Thalmann
    • 1
  • Frederic Vexo
    • 1
  1. 1.VRLabEPFLLausanneSwitzerland

Personalised recommendations