Skip to main content
SpringerLink
Log in
Book cover

Model-Driven Development of Advanced User Interfaces pp 171–197Cite as

Dynamic Distribution and Layouting of Model-Based User Interfaces in Smart Environments

  • Chapter

Part of the book series: Studies in Computational Intelligence ((SCI,volume 340))

Abstract

The developments in computer technology in the last decade change the ways of computer utilization. The emerging smart environments make it possible to build ubiquitous applications that assist users during their everyday life, at any time, in any context. But the variety of contexts-of-use (user, platform and environment) makes the development of such ubiquitous applications for smart environments and especially its user interfaces a challenging and time-consuming task. We propose a model-based approach, which allows adapting the user interface at runtime to numerous (also unknown) contexts-of-use. Based on a user interface modelling language, defining the fundamentals and constraints of the user interface, a runtime architecture exploits the description to adapt the user interface to the current context-of-use. The architecture provides automatic distribution and layout algorithms for adapting the applications also to contexts unforeseen at design time. Designers do not specify predefined adaptations for each specific situation, but adaptation constraints and guidelines. Furthermore, users are provided with a meta user interface to influence the adaptations according to their needs. A smart home energy management system serves as running example to illustrate the approach.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Balme, L., Demeure, A., Barralon, N., Coutaz, J., Calvary, G.: Cameleon-rt: A software architecture reference model for distributed, migratable, and plastic user interfaces. In: Markopoulos, P., Eggen, B., Aarts, E., Crowley, J.L. (eds.) EUSAI 2004. LNCS, vol. 3295, pp. 291–302. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  2. Balz, M., Striewe, M., Goedicke, M.: Embedding state machine models in object-oriented source code, pp. 6–15 (2008)

    Google Scholar 

  3. Barralon, N., Coutaz, J., Lachenal, C.: Coupling interaction resources and technical support. In: Stephanidis, C. (ed.) UAHCI 2007 (Part II). LNCS, vol. 4555, pp. 13–22. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  4. Blumendorf, M.: Multimodal Interaction in Smart Environments A Model-based Runtime System for Ubiquitous User Interfaces. Ph.D. thesis, Technische Universität Berlin (2009)

    Google Scholar 

  5. Blumendorf, M., Feuerstack, S., Albayrak, S.: Multimodal user interaction in smart environments: Delivering distributed user interfaces. In: Mühlhäuser, M., Ferscha, A., Aitenbichler, E. (eds.) AmI 2007. LNCS, vol. 4794, Springer, Heidelberg (2007)

    Google Scholar 

  6. Blumendorf, M., Lehmann, G., Feuerstack, S., Albayrak, S.: Executable models for human-computer interaction. In: Graham, T.C.N., Palanque, P. (eds.) DSV-IS 2008. LNCS, vol. 5136, pp. 238–251. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  7. Blumendorf, M., Lehmann, G., Roscher, D., Albayrak, S.: Ubiquitous User Interfaces: Multimodal Adaptive Interaction for Smart Environments. In: Multimodality in Mobile Computing and Mobile Devices: Methods for Adaptable Usability, pp. 24–52. IGI-Global (2009)

    Google Scholar 

  8. Bouchet, J., Nigay, L., Ganille, T.: Icare software components for rapidly developing multimodal interfaces. In: Proceedings of the 6th International Conference on Multimodal Interfaces, ICMI 2004, pp. 251–258. ACM Press, New York (2004)

    Chapter  Google Scholar 

  9. Bouchet, J., Nigay, L., Balzagette, D.: Icare: A component-based approach for multimodal interaction. In: Proceedings of the 1st French-speaking conference on Mobility and Ubiquity Computing, UbiMob 2004, pp. 36–43. ACM Press, New York (2004)

    Chapter  Google Scholar 

  10. Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Souchon, N., Bouillon, L., Florins, M., Vanderdonckt, J.: Plasticity of user interfaces: A revised reference framework. In: TAMODIA 2002: Proceedings of the First International Workshop on Task Models and Diagrams for User Interface Design, pp. 127–134. INFOREC Publishing House, Bucharest (2002)

    Google Scholar 

  11. Clerckx, T., Luyten, K., Coninx, K.: Dynamo-aid: A design process and a runtime architecture for dynamic model-based user interface development. In: Feige, U., Roth, J. (eds.) DSV-IS 2004 and EHCI 2004. LNCS, vol. 3425, pp. 77–95. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  12. Clerckx, T., Vandervelpen, C., Coninx, K.: Task-based design and runtime support for multimodal user interface distribution. In: Proceedings of Engineering Interactive Systems 2007, EHCI-HCSE-DSVIS (2007)

    Google Scholar 

  13. Clerckx, T., Vandervelpen, C., Luyten, K., Coninx, K.: A task-driven user interface architecture for ambient intelligent environments. In: IUI 2006: Proceedings of the 11th international conference on Intelligent user interfaces, pp. 309–311. ACM Press, New York (2006)

    Chapter  Google Scholar 

  14. Coutaz, J., Calvary, G.: HCI and Software Engineering: Designing for User Interface Plasticity. In: Sears, A., Jacko, J. (eds.) Human Factor and Ergonomics series, 2nd edn., ch. 56, pp. 1107–1125. Taylor & Francis/CRC Press (2008), ISBN 9780805858709, http://www.isrc.umbc.edu/HCIHandbook/

  15. Coutaz, J., Nigay, L., Salber, D., Blandford, A., May, J., Young, R.M.: Four easy pieces for assessing the usability of multimodal interaction: The care properties. In: INTERACT 1995, pp. 115–120 (1995)

    Google Scholar 

  16. Demeure, A., Sottet, J.S., Calvary, G., Coutaz, J., Ganneau, V., Vanderdonkt, J.: The 4c reference model for distributed user interfaces. In: The Fourth International Conference on Autonomic and Autonomous Systems, ICAS 2008, Gosier, Guadeloupe. IEEE Computer Society Press, Los Alamitos (2008)

    Google Scholar 

  17. Duarte, C., Carriço, L.: A conceptual framework for developing adaptive multimodal applications. In: IUI 2006: Proceedings of the 11th International Conference on Intelligent User Interfaces, pp. 132–139. ACM Press, New York (2006)

    Chapter  Google Scholar 

  18. Elting, C., Hellenschmidt, M.: Strategies for self-organization and multimodal output coordination in distributed device environments. In: Workshop on Artificial Intelligence in Mobile Systems 2004 In conjunction with UbiComp 2004 (September 2004)

    Google Scholar 

  19. Feuerstack, S., Blumendorf, M., Schwartze, V., Albayrak, S.: Model-based layout generation. In: Bottoni, P., Levialdi, S. (eds.) Proceedings of the Working Conference on Advanced Visual Interfaces, ACM, New York (2008)

    Google Scholar 

  20. Fleurey, F., Dehlen, V., Bencomo, N., Morin, B., Jézéquel, J.M.: Modeling and validating dynamic adaptation. In: Chaudron, M.R.V. (ed.) MODELS 2008. LNCS, vol. 5421, pp. 97–108. Springer, Heidelberg (2009), http://dx.doi.org/10.1007/978-3-642-01648-6

    Chapter  Google Scholar 

  21. Gajos, K., Weld, D.S.: Preference elicitation for interface optimization. In: Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, UIST 2005, pp. 173–182. ACM Press, New York (2005)

    Chapter  Google Scholar 

  22. Ghiani, G., Paternò, F., Spano, L.D.: Cicero designer: An environment for end-user development of multi-device museum guides. In: Pipek, V., Rosson, M.B., de Ruyter, B., Wulf, V. (eds.) IS-EUD 2009. LNCS, vol. 5435, pp. 265–274. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  23. Hurst, N., Marriott, K., Moulder, P.: Minimum sized text containment shapes. In: Proceedings of the 2006 ACM Symposium on Document Engineering, DocEng 2006, pp. 3–12. ACM, New York (2006)

    Chapter  Google Scholar 

  24. Klug, T., Kangasharju, J.: Executable task models. In: Proceedings of TAMODIA 2005, pp. 119–122. ACM Press, Gdansk (2005)

    Chapter  Google Scholar 

  25. Limbourg, Q., Vanderdonckt, J., Michotte, B., Bouillon, L., López-Jaquero, V.: USIXML: A language supporting multi-path development of user interfaces. In: Bastide, R., Palanque, P.A., Roth, J. (eds.) DSV-IS 2004 and EHCI 2004. LNCS, vol. 3425, pp. 200–220. Springer, Heidelberg (2005), http://dx.doi.org/10.1007/11431879_12

    Chapter  Google Scholar 

  26. Lutteroth, C., Weber, G.: User interface layout with ordinal and linear constraints. In: Proceedings of the 7th Australasian User Interface Conference, AUIC 2006, pp. 53–60. Australian Computer Society, Inc., Darlinghurst (2006)

    Google Scholar 

  27. Martin, J.C.: Tycoon: Theoretical framework and software tools for multimodal interfaces. In: Intelligence and Multimodality in Multimedia interfaces. AAAI Press, Menlo Park (1998)

    Google Scholar 

  28. Martinez-Ruiz, F.J., Vanderdonckt, J., Arteaga, J.M.: Context-aware generation of user interface containers for mobile devices. In: Proceedings of the 2008 Mexican International Conference on Computer Science, ENC 2008, pp. 63–72. IEEE Computer Society, Washington (2008)

    Chapter  Google Scholar 

  29. Meskens, J., Vermeulen, J., Luyten, K., Coninx, K.: Gummy for multi-platform user interface designs: shape me, multiply me, fix me, use me. In: Proceedings of the Working Conference on Advanced Visual Interfaces, AVI 2008, pp. 233–240. ACM, New York (2008)

    Chapter  Google Scholar 

  30. Molina, J., Vanderdonckt, J., González, P., Fernández-Caballero, A., Lozano, M.: Rapid prototying of distributed user interfaces. In: Proceedings of 6th Int. Conf. on Computer-Aided Design of User Interfaces, CADUI 2006, pp. 151–166. Springer, Heidelberg (2006)

    Google Scholar 

  31. Mori, G., Paternò, F., Santoro, C.: Design and development of multidevice user interfaces through multiple logical descriptions. IEEE Trans. Softw. Eng. 30(8), 507–520 (2004)

    Article  Google Scholar 

  32. Nichols, C.A.J., Myers, B.A., Higgins, M., Hughes, J., Harris, T.K., Rosenfeld, R.: of Computer Science Carnegie Mellon, M.P.S.: Generating remote control interfaces for complex appliances. In: UIST 2002: Proceedings of the 15th annual ACM symposium on User interface software and technology, pp. 161–170. ACM Press, New York (2002), citeseer.ist.psu.edu/602919.html

    Chapter  Google Scholar 

  33. Omojokun, O., Dewan, P.: Automatic generation of device user-interfaces? In: PERCOM 2007: Proceedings of the Fifth IEEE International Conference on Pervasive Computing and Communications, pp. 251–261. IEEE Computer Society Press, Washington (2007)

    Chapter  Google Scholar 

  34. Paternò, F.: Model-Based Design and Evaluation of Interactive Applications. In: Applied Computing. Springer, Heidelberg (1999)

    Google Scholar 

  35. Reithinger, N., Alexandersson, J., Becker, T., Blocher, A., Engel, R., Löckelt, M., Müller, J., Pfleger, N., Poller, P., Streit, M., Tschernomas, V.: Smartkom: Adaptive and flexible multimodal access to multiple applications. In: ICMI 2003: Proceedings of the 5th International Conference on Multimodal Interfaces, pp. 101–108. ACM Press, New York (2003)

    Chapter  Google Scholar 

  36. Sanchez, M., Barrero, I., Villalobos, J., Deridder, D.: An execution platform for extensible runtime models. In: 3rd Int. Workshop on Models at Runtime at MoDELS (2008)

    Google Scholar 

  37. Schwartze, V., Feuerstack, S., Albayrak, S.: Behavior-sensitive user interfaces for smart environments. In: HCII 2009 - User Modeling (2009)

    Google Scholar 

  38. Sottet, J.S., Calvary, G., Favre, J.M.: Models at runtime for sustaining user interface plasticity. presented at Models@run.time workshop (in conjunction with MoDELS/UML, conference) (2006)

    Google Scholar 

  39. Staikopoulos, A., Saudrais, S., Clarke, S., Padget, J., Cliffe, O., Vos, M.D.: Mutual dynamic adaptation of models and service enactment in alive*. In: Proceedings of the Models@Runtime workshop at Models 2008, pp. 1–10 (September 2008), https://www.cs.tcd.ie/publications/tech-reports/reports.08/TCD-CS-2008-56.pdf

  40. Tognazzini, B.: TOG on Interface. Addison-Wesley Longman Publishing Co., Inc., Boston (1992)

    Google Scholar 

  41. Vanderdonckt, J.: Model-driven engineering of user interfaces: Promises, successes, failures, and challenges. In: Proceedings of ROCHI 2008 (2008)

    Google Scholar 

  42. Schwartze, V., Marco Blumendorf, S.A.: Adjustable context adaptations for user interfaces at runtime. In: Proceedings of the Working Conference on Adnvanced Visual Interfaces, pp. 321–325 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. DAI-Labor, TU-Berlin, Ernst-Reuter-Platz 7, 10587, Berlin, Germany

    Dirk Roscher, Grzegorz Lehmann, Veit Schwartze, Marco Blumendorf & Sahin Albayrak

Authors
  1. Dirk Roscher
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Grzegorz Lehmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Veit Schwartze
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marco Blumendorf
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sahin Albayrak
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Lehr- und Forschungseinheit, Ludwig-Maximilians-UniversitätMünchen, Medieninformatik Amalienstr. 17, 80333, München, Germany

    Heinrich Hussmann

  2. Deutsches Forschungszentrum für, Künstliche Intelligenz (DFKI) Innovative Fabriksysteme (IFS), Trippstadter Str. 122, 67663, Kaiserslautern, Germany

    Gerrit Meixner  & Detlef Zuehlke  & 

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Roscher, D., Lehmann, G., Schwartze, V., Blumendorf, M., Albayrak, S. (2011). Dynamic Distribution and Layouting of Model-Based User Interfaces in Smart Environments. In: Hussmann, H., Meixner, G., Zuehlke, D. (eds) Model-Driven Development of Advanced User Interfaces. Studies in Computational Intelligence, vol 340. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14562-9_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-14562-9_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-14561-2

  • Online ISBN: 978-3-642-14562-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation