Skip to main content

Distributed User Interfaces: State of the Art

  • Chapter
  • First Online:
Distributed User Interfaces

Part of the book series: Human-Computer Interaction Series ((HCIS))

Abstract

We summarize the state of the art in the field of distributed user interfaces (DUIs). Topics surveyed include pervasive and ubiquitous computing, migratory and migratable interfaces, plasticity and adaptivity in interaction, and applications to multi-display and multi-surface environments. Based on this survey, we then draw some general conclusions on past and current research within the field. Our purpose is to provide a solid foundation for future research in distributed user interfaces.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aquino, N., Vanderdonckt, J., Condori-Fernández, N., Tubío, Ó.D., Pastor, O.: Usability evaluation of multi-device/platform user interfaces generated by model-driven engineering. In: Proceedings of the International Symposium on Empirical Software Engineering and Measurement. Association for Computing Machinery, New York (2010)

    Google Scholar 

  2. Baecker, R.M.: Readings in Groupware and Computer-Supported Cooperative Work. Morgan Kaufmann Publishers, San Francisco, CA (1993)

    Google Scholar 

  3. Ballagas, R., Ringel, M., Stone, M., Borchers, J.: iStuff: a physical user interface toolkit for ubiquitous computing environments. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 537–544. ACM, New York (2003)

    Google Scholar 

  4. Balme, L., Demeure, A., Barralon, N., Coutaz, J., Calvary, G.: CAMELEON-RT: A software architecture reference model for distributed, migratable, and plastic user interfaces. In: Proceedings of the Symposium on Ambient Intelligence, Lecture Notes in Computer Science, vol. 3295, pp. 291–302. Springer, Berlin (2004)

    Google Scholar 

  5. Bandelloni, R., Paterno, F.: Flexible interface migration. In: Proceedings of the ACM Conference on Intelligent User Interfaces, pp. 148–155. Association for Computing Machinery, New York (2004)

    Google Scholar 

  6. Baudisch, P., Cutrell, E., Hinckley, K., Gruen, R.: Mouse ether: accelerating the acquisition of targets across multi-monitor displays. In: Extended Abstracts of the ACM CHI Conference on Human Factors in Computing Systems, pp. 1379–1382. ACM Press, New York (2004)

    Google Scholar 

  7. Benko, H., Feiner, S.: Multi-monitor mouse. In: Extended Abstracts of the ACM CHI Conference on Human Factors in Computing Systems, pp. 1208–1211. ACM, New York (2005)

    Google Scholar 

  8. Bharat, K.A., Cardelli, L.: Migratory applications. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 133–142. Association for Computing Machinery, New Yok (1995)

    Google Scholar 

  9. Biehl, J.T., Bailey, B.P.: ARIS: an interface for application relocation in an interactive space. In: Proceedings of the Graphics Interface Conference, pp. 107–116. Canadian Human-Computer Communications Society, School of Computer Science, University of Waterloo, Ontario (2004)

    Google Scholar 

  10. Biehl, J.T., Bailey, B.P.: A toolset for creating iconic interfaces for interactive workspaces. In: Proceedings of IFIP INTERACT, Lecture Notes in Computer Science, vol. 3585, pp. 699–712. Springer, Berlin/New York (2005)

    Google Scholar 

  11. Biehl, J.T., Bailey, B.P.: Improving interfaces for managing applications in multiple-device environments. In: Proceedings of the ACM Conference on Advanced Visual Interfaces, pp. 35–42. ACM, New York (2006)

    Google Scholar 

  12. Biehl, J.T., Baker, W.T., Bailey, B.P., Tan, D.S., Inkpen, K.M., Czerwinski, M.: IMPROMPTU: a new interaction framework for supporting collaboration in multiple display environments and its field evaluation for co-located software development. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 939–948. ACM, New York (2008)

    Google Scholar 

  13. Bolt, R.A.: “Put-That-There”: voice and gesture at the graphics interface. Comput. Graph. (SIGGRAPH ’80 Proceedings) 14(3), 262–270 (1980)

    Google Scholar 

  14. Booth, K.S., Fisher, B.D., Lin, C.J.R., Argue, R.: The ‘mighty mouse’ multi-screen collaboration tool. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 209–212. ACM, New York (2002)

    Google Scholar 

  15. Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Bouillon, L., Vanderdonckt, J.: A unifying reference framework for multi-target user interfaces. Interact. Comput. 15(3), 289–308 (2003)

    Article  Google Scholar 

  16. Coutaz, J., Balme, L., Lachenal, C., Barralon, N.: Software infrastructure for distributed migratable user interfaces. In: Proceedings of the UbiHCISys Workshop on UbiComp (2003)

    Google Scholar 

  17. Coutaz, J., Lachenal, C., Dupuy-Chessa, S.: Ontology for multi-surface interaction. In: Proceedings of IFIP INTERACT, pp. 447–454. Springer, Berlin/New York (2003)

    Google Scholar 

  18. Demeure, A., Calvary, G., Sottet, J.S., Vanderdonckt, J.: A reference model for distributed user interfaces. In: Proceedings of the International Workshop on Task Models and Diagrams for User Interface Design, pp. 79–86. ACM, New York (2005)

    Google Scholar 

  19. Demeure, A., Sottet, J.S., Calvary, G., Coutaz, J., Ganneau, V., Vanderdonckt, J.: The 4C reference model for distributed user interfaces. In: Proceedings of the International Conference on Autonomic and Autonomous Systems, pp. 61–69. IEEE Xplore, Piscataway (2008)

    Google Scholar 

  20. Dey, A.K., Ljungstrand, P., Schmidt, A.: Workshop: Distributed and disappearing user interfaces in ubiquitous computing. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 487–488. ACM, New York (2001)

    Google Scholar 

  21. Everitt, K., Shen, C., Ryall, K., Forlines, C.: MultiSpace: enabling electronic document micro-mobility in table-centric, multi-device environments. In: Proceedings of IEEE Tabletop, pp. 27–34. IEEE Computer Society Press, Los Alamitos (2006)

    Google Scholar 

  22. Feiner, S., Shamash, A.: Hybrid user interfaces: Breeding virtually bigger interfaces for physically smaller computers. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 9–17. ACM, New York (1991)

    Google Scholar 

  23. Fox, A., Johanson, B., Hanrahan, P., Winograd, T.: Integrating information appliances into an interactive workspace. IEEE Comput. Graph. Appl. 20(3), 54–65 (2000)

    Article  Google Scholar 

  24. Graham, T.C.N., Urnes, T., Nejabi, R.: Efficient distributed implementation of semi-replicated synchronous groupware. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 1–10. ACM, New York (1996)

    Google Scholar 

  25. Grolaux, D., Roy, P.V., Vanderdonckt, J.: Migratable user interfaces: beyond migratory interfaces. In: Proceedings of the IEEE/ACM Conference on Mobile and Ubiquitous Systems, pp. 422–430. IEEE Service Center, Piscataway (2004)

    Google Scholar 

  26. Grudin, J.: Partitioning digital worlds: focal and peripheral awareness in multiple monitor use. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 458–465. ACM, New York (2001)

    Google Scholar 

  27. Guimbretière, F., Stone, M.C., Winograd, T.: Fluid interaction with high-resolution wall-size displays. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 21–30. ACM, New York (2001)

    Google Scholar 

  28. Han, R., Perret, V., Naghshineh, M.: WebSplitter: A unified XML framework for multi-device collaborative web browsing. In: Proceedings of the ACM Conference on Computer-Supported Cooperative Work, pp. 221–230. Association for Computing Machinery, New York (2000)

    Google Scholar 

  29. Harrison, C.: Appropriated interaction surfaces. IEEE Comput. 43(6), 86–89 (2010)

    Article  Google Scholar 

  30. Johanson, B., Hutchins, G., Winograd, T., Stone, M.: PointRight: experience with flexible input redirection in interactive workspaces. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 227–234. ACM, New York (2002)

    Google Scholar 

  31. Johanson, B., Winograd, T., Fox, A.: Interactive workspaces. IEEE Comput. 36(4), 99–101 (2003)

    Google Scholar 

  32. Johanson, B., Winograd, T., Fox, A.: Invisible computing: interactive workspaces. IEEE Comput. 36(4), 99–103 (2003)

    Google Scholar 

  33. Kim, K., Javed, W., Williams, C., Elmqvist, N., Irani, P.: Hugin: A framework for awareness and coordination in mixed-presence collaborative information visualization. In: Proceedings of the ACM Conference on Interactive Tabletops and Surfaces, pp. 231–240. ACM, New York (2010)

    Google Scholar 

  34. Klokmose, C.N., Beaudouin-Lafon, M.: VIGO: instrumental interaction in multi-surface environments. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 869–878. ACM, New York (2009)

    Google Scholar 

  35. Kobayashi, M., Igarashi, T.: Ninja cursors: using multiple cursors to assist target acquisition on large screens. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 949–958. ACM, New York (2008)

    Google Scholar 

  36. Kohtake, N., Ohsawa, R., Yonezawa, T., Matsukura, Y., Iwai, M., Takashio, K., Tokuda, H.: u-Texture: self-organizable universal panels for creating smart surroundings. In: Proceedings of the International Conference on Ubiquitous Computing, Lecture Notes in Computer Science, vol. 3660, pp. 19–36. Springer, Berlin (2005)

    Google Scholar 

  37. Luyten, K., Coninx, K.: Distributed user interface elements to support smart interaction spaces. In: Proceedings the IEEE International Symposium on Multimedia, pp. 277–286. IEEE Computer Society, Los Alamitos (2005)

    Google Scholar 

  38. Melchior, J., Grolaux, D., Vanderdonckt, J., Roy, P.V.: A toolkit for peer-to-peer distributed user interfaces: concepts, implementation, and applications. In: Proceedings of the ACM Symposium on Engineering Interactive Computing System, pp. 69–78. Association for Computing Machinery, New York (2009)

    Google Scholar 

  39. Modahl, M., Agarwalla, B., Abowd, G.D., Ramachandran, U., Saponas, T.S.: Toward a standard ubiquitous computing framework. In: Proceedings of the Workshop on Middleware for Pervasive and Ad-hoc Computing, pp. 135–139. ACM, New York (2004)

    Google Scholar 

  40. Modahl, M., Bagrak, I., Wolenetz, M., Hutto, P.W., Ramachandran, U.: MediaBroker: an architecture for pervasive computing. In: Proceedings of the IEEE Conference on Pervasive Computing, pp. 253–262. IEEE Computer Society, Los Alamitos (2004)

    Google Scholar 

  41. Mori, G., Paternò, F., Santoro, C.: Design and development of multidevice user interfaces through multiple logical descriptions. IEEE Trans. Software Eng. 30(8), 507–520 (2004)

    Article  Google Scholar 

  42. Myers, B.A., Nichols, J., Wobbrock, J.O., Miller, R.C.: Taking handheld devices to the next level. Computer 37(12), 36–43 (2004)

    Article  Google Scholar 

  43. Myers, B.A., Stiel, H., Gargiulo, R.: Collaboration using multiple PDAs connected to a PC. In: Proceedings of the ACM Conference on Computer-Supported Cooperative Work, pp. 285–294. Association for Computing Machinery, New York (1998)

    Google Scholar 

  44. Nacenta, M.A., Aliakseyeu, D., Subramanian, S., Gutwin, C.: A comparison of techniques for multi-display reaching. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 371–380. Association for Computing Machinery, New York (2005)

    Google Scholar 

  45. Nacenta, M.A., Mandryk, R.L., Gutwin, C.: Targeting across displayless space. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 777–786. ACM, New York (2008)

    Google Scholar 

  46. Nacenta, M.A., Sakurai, S., Yamaguchi, T., Miki, Y., Itoh, Y., Kitamura, Y., Subramanian, S., Gutwin, C.: E-conic: a perspective-aware interface for multi-display environments. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 279–288. ACM, New York (2007)

    Google Scholar 

  47. Nacenta, M.A., Sallam, S., Champoux, B., Subramanian, S., Gutwin, C.: Perspective cursor: perspective-based interaction for multi-display environments. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 289–298. Association for Computing Machinery, New York (2006)

    Google Scholar 

  48. Pinhanez, C.: The everywhere displays projector: a device to create ubiquitous graphical interfaces. Lect. Notes Comput. Sci. 2201, 315–331 (2001)

    Article  Google Scholar 

  49. Ponnekanti, S., Lee, B., Fox, A., Hanrahan, P., Winograd, T.: ICrafter: a service framework for ubiquitous computing environments. In: Proceedings of the International Conference on Ubiquitous Computing, Lecture Notes in Computer Science, vol. 2201, pp. 56–75. Springer, Berlin (2001)

    Google Scholar 

  50. Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., Fuchs, H.: The office of the future: a unified approach to image-based modeling and spatially immersive displays. Comput. Graph. (SIGGRAPH ’98 Proceedings) 32, 179–188 (1998)

    Google Scholar 

  51. Rekimoto, J.: Pick-and-drop: a direct manipulation technique for multiple computer environments. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 31–40. Association for Computing Machinery. New York (1997)

    Google Scholar 

  52. Rekimoto, J., Saitoh, M.: Augmented surfaces: a spatially continuous work space for hybrid computing environments. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 378–385. ACM, New York (1999)

    Google Scholar 

  53. Rekimoto, J., Ullmer, B., Oba, H.: DataTiles: a modular platform for mixed physical and graphical interactions. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 269–276. ACM, New York (2001)

    Google Scholar 

  54. Robertson, S., Wharton, C., Ashworth, C., Franzke, M.: Dual device user interface design: PDAs and interactive television. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 79–86. Association for Computing Machinery, New York (1996)

    Google Scholar 

  55. Rogers, Y., Lindley, S.E.: Collaborating around vertical and horizontal large interactive displays: which way is best? Interact. Comput. 16(6), 1133–1152 (2004)

    Article  Google Scholar 

  56. Román, M., Hess, C., Cerqueira, R., Ranganathan, A., Campbell, R.H., Nahrstedt, K.: Gaia: A middleware infrastructure for active spaces. IEEE Pervasive Comput. 1(4), 74–83 (2002)

    Article  Google Scholar 

  57. Shen, C., Everitt, K., Ryall, K.: UbiTable: impromptu face-to-face collaboration on horizontal interactive surfaces. In: Proceedings of the International Conference on Ubiquitous Computing, Lecture Notes in Computer Science, vol. 2864, pp. 281–288. Springer, Berlin (2003)

    Google Scholar 

  58. Sousa, J.P., Garlan, D.: Aura: an architectural framework for user mobility in ubiquitous computing environments. In: Proceedings of the IEEE/IFIP Conference on Software Architecture, pp. 29–43. IEEE Computer Society, Los Alamitos (2002)

    Google Scholar 

  59. Stefik, M., Bobrow, D.G., Foster, G., Lanning, S., Tatar, D.G.: WYSIWIS revised: early experiences with multiuser interfaces. ACM Trans. Office Info. Syst. 5(2), 147–167 (1987)

    Article  Google Scholar 

  60. Streitz, N.A., Geissler, J., Holmer, T., Konomi, S., Müller-Tomfelde, C., Reischl, W., Rexroth, P., Seitz, P., Steinmetz, R.: i-LAND: an interactive landscape for creativity and innovation. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 120–127. Addison-WesleyAssociation for Computing Machinery, Addison-Wesley, Harlow/New York (1999)

    Google Scholar 

  61. Streitz, N.A., Rexroth, P., Holmer, T.: Does ‘roomware’ matter? investigating the role of personal and public information devices and their combination in meeting room collaboration. In: Proceedings of the European Conference on Computer-Supported Cooperative Work, pp. 297–312. Kluwer Academic Publishers, Dordrecht/Boston/London (1997)

    Google Scholar 

  62. Streitz, N.A., Tandler, P., Müller-Tomfelde, C.: Human-Computer Interaction in the New Millenium, Chap. Roomware: Towards the Next Generation of Human-Computer Interaction based on an Integrated Design of Real and Virtual Worlds, pp. 553–578. Addison Wesley, Harlow (2001)

    Google Scholar 

  63. Tan, D.S., Meyers, B., Czerwinski, M.: WinCuts: manipulating arbitrary window regions for more effective use of screen space. In: Extended Abstracts of the ACM CHI Conference on Human Factors in Computing Systems, pp. 1525–1528. ACM, New York (2004)

    Google Scholar 

  64. Tandler, P.: Software infrastructure for ubiquitous computing environments: supporting synchronous collaboration with heterogeneous devices. Lect. Notes Comput. Sci. 2201, 96–115 (2001)

    Article  Google Scholar 

  65. Tandler, P., Prante, T., Müller-Tomfelde, C., Streitz, N., Steinmetz, R.: ConnecTables: dynamic coupling of displays for the flexible creation of shared workspaces. In: Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 11–20. ACM, New York (2001)

    Google Scholar 

  66. Terrenghi, L., Quigley, A.J., Dix, A.J.: A taxonomy for and analysis of multi-person-display ecosystems. Pers. Ubiquitous Comput. 13(8), 583–598 (2009)

    Article  Google Scholar 

  67. Thevenin, D., Coutaz, J.: Plasticity of user interfaces: framework and research agenda. In: Proceedings of IFIP INTERACT, pp. 110–117. IOS Press, Ohmsha (1999)

    Google Scholar 

  68. Vanderdonckt, J.: Distributed user interfaces: How to distribute user interface elements across users, platforms, and environments. In: Proceedings of the International Conference on Interaccion (2010)

    Google Scholar 

  69. Vanderdonckt, J., Mendonca, H., Massó, J.P.M.: Distributed user interfaces in ambient environment. Commun. Comput. Info. Sci. 11(3), 121–130 (2008)

    Article  Google Scholar 

  70. Vandervelpen, C., Coninx, K.: Towards model-based design support for distributed user interfaces. In: Proceedings of the Nordic Conference on Human-Computer Interaction, pp. 61–70. ACM, New York (2004)

    Google Scholar 

  71. Villanueva, P.G., Tesoriero, R., Gallud, J.: Multi-pointer and collaborative system for mobile devices. In: Proceedings of the ACM Mobile HCI Conference, pp. 435–438. ACM, New York (2010)

    Google Scholar 

  72. Wallace, J., Ha, V., Ziola, R., Inkpen, K.: Swordfish: user tailored workspaces in multi-display environments. In: Extended Abstracts of the ACM CHI Conference on Human Factors in Computing Systems, pp. 1487–1492. ACM, New York (2006)

    Google Scholar 

  73. Wallace, J.R., Mandryk, R.L., Inkpen, K.M.: Comparing content and input redirection in MDEs. In: Proceedings of the ACM Conference on Computer Supported Cooperative Work, pp. 157–166. ACM, New York (2008)

    Google Scholar 

  74. Weiser, M.: The computer for the twenty-first century. Sci. Am. 3(265), 94–104 (1991)

    Article  Google Scholar 

  75. Wellner, P.: Interacting with paper on the DigitalDesk. Commun. ACM 36(7), 86–96 (1993)

    Google Scholar 

  76. Wellner, P., Mackay, W., Gold, R.: Introduction to the special issue on computer-augmented environments: back to the real world. Commun. ACM 36(7), 24 (1993)

    Article  Google Scholar 

  77. Wigdor, D., Jiang, H., Forlines, C., Borkin, M., Shen, C.: WeSpace: the design development and deployment of a walk-up and share multi-surface visual collaboration system. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 1237–1246. ACM, New York (2009)

    Google Scholar 

  78. Wilson, A., Shafer, S.: XWand: UI for intelligent spaces. In: Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pp. 545–552. ACM, New York (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Niklas Elmqvist .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag London Limited

About this chapter

Cite this chapter

Elmqvist, N. (2011). Distributed User Interfaces: State of the Art. In: Gallud, J., Tesoriero, R., Penichet, V. (eds) Distributed User Interfaces. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-4471-2271-5_1

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-2271-5_1

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-2270-8

  • Online ISBN: 978-1-4471-2271-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics