Advertisement

Universal Access in the Information Society

, Volume 18, Issue 4, pp 719–746 | Cite as

Model-based development of distributable user interfaces

  • Ricardo TesorieroEmail author
  • Abdulrahman H. Altalhi
Long Paper

Abstract

The price drop of digital displays during the last decade has promoted the use of coupled-display ecosystems. This paper proposes a model-based approach to develop applications that exploit these ecosystems. It introduces the concept of Distributable User Interface to define applications running on coupled-display ecosystems that enable users to distribute interaction objects (e.g., labels, buttons, panels and frames) across interaction surfaces (e.g., Web documents, frames and panels) using a set of distribution primitives. The Distributable User Interface concept is formalized in the User Interface Distribution meta-model, which is implemented using the Eclipse Modeling Framework to ensure the compliance of these models with the OMG standards. This paper also describes the graphical model editor to create, edit and validate User Interface Distribution models conforming to the proposed meta-model. The models created with the model editor are used as input parameters for the model-to-text transformation developed in Acceleo that generates the source code of Web applications supporting Distributable User Interfaces. The generated code runs on the User Interface Distribution Framework which is also presented in this paper. Finally, the On-line Photo Gallery application is the case of study presented to demonstrate the viability of the proposal.

Keywords

Distributed User Interfaces Human-computer interaction Model-based development 

References

  1. 1.
    Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Bouillon, L., Vanderdonckt, J.: A unifying reference framework for multi-target user interfaces. Interact. Comput. 15(3), 289 (2003).  https://doi.org/10.1016/S0953-5438(03)00010-9 CrossRefGoogle Scholar
  2. 2.
    Coutaz, J., Nigay, L., Salber, D., Blandford, A., May, J., Young, R.M.: Four Easy Pieces for Assessing the Usability of Multimodal Interaction: The CARE Properties, pp. 115–120. Springer, Boston (1995).  https://doi.org/10.1007/978-1-5041-2896-4_19 CrossRefGoogle Scholar
  3. 3.
    Coyette, A., Kieffer, S., Vanderdonckt, J.: Multi-fidelity prototyping of user interfaces. In: Proceedings of the 11th IFIP TC 13 International Conference on Human-computer Interaction, INTERACT’07, pp. 150–164. Springer, Berlin, (2007). http://dl.acm.org/citation.cfm?id=1776994.1777015 Google Scholar
  4. 4.
    Eclipse Foundation: The MOFScript home page (2011). https://eclipse.org/gmt/mofscript/
  5. 5.
    Eclipse Foundation: ACCELEO (2016). https://eclipse.org/acceleo/
  6. 6.
    Eclipse Foundation: The atlas transformation language (2016). https://eclipse.org/atl/
  7. 7.
    Eclipse Foundation: The eclipse modeling framework (2016). https://eclipse.org/modeling/emf/
  8. 8.
    Eclipse Foundation: Ecore (2016). https://wiki.eclipse.org/Ecore
  9. 9.
    Eclipse Foundation: The graphical modeling framework (2016). https://wiki.eclipse.org/Graphical_Modeling_Framework
  10. 10.
    Eclipse Foundation: The graphical modeling project (2016). http://www.eclipse.org/modeling/gmp/
  11. 11.
    Eclipse Foundation: OclInEcore (2016). https://wiki.eclipse.org/OCL/OCLinEcore
  12. 12.
    Eclipse Foundation: Papyrus modeling environment (2016). https://eclipse.org/papyrus/
  13. 13.
    Fielding, R.T.: Architectural styles and the design of network-based software architectures. Ph.D. thesis, University of California, Irvine (2000). Chapter 5: Representational State Transfer (REST)Google Scholar
  14. 14.
    Fondement, F., Baar, T.: Making Metamodels Aware of Concrete Syntax, pp. 190–204. Springer, Berlin (2005).  https://doi.org/10.1007/11581741_15 CrossRefGoogle Scholar
  15. 15.
    Frosini, L., Paternò, F.: User interface distribution in multi-device and multi-user environments with dynamically migrating engines. In: Proceedings of the 2014 ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS ’14, pp. 55–64. ACM, New York, NY, USA (2014).  https://doi.org/10.1145/2607023.2607032
  16. 16.
    Guerrero-Garcia, J., Vanderdonckt, J., Gonzalez-Calleros, J.M.: Towards a multi-user interaction meta-model (2008). http://www.academia.edu/26771363/Towards_a_Multi-User_Interaction_Meta-Model
  17. 17.
    Hutchings, H.M., Pierce, J.S.: Understanding the whethers, hows, and whys of divisible interfaces. In: Proceedings of the Working Conference on Advanced Visual Interfaces, AVI ’06, pp. 274–277. ACM, New York, NY, USA (2006).  https://doi.org/10.1145/1133265.1133320
  18. 18.
    Johanson, B., Ponnekanti, S., Sengupta, C., Fox, A.: Multibrowsing: Moving Web Content Across Multiple Displays, pp. 346–353. Springer, Berlin (2001).  https://doi.org/10.1007/3-540-45427-6_29 CrossRefzbMATHGoogle Scholar
  19. 19.
    Lorenz, A., De Castro, C.F., Rukzio, E.: Using handheld devices for mobile interaction with displays in home environments. In: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI ’09, pp. 18:1–18:10. ACM, New York, NY, USA (2009).  https://doi.org/10.1145/1613858.1613882
  20. 20.
    Manca, M., Paternò, F.: Customizable dynamic user interface distribution. In: Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS ’16, pp. 27–37. ACM, New York, NY, USA (2016).  https://doi.org/10.1145/2933242.2933259
  21. 21.
    Martinie, C., Navarre, D., Palanque, P.: A multi-formalism approach for model-based dynamic distribution of user interfaces of critical interactive systems. Int. J. Hum. Comput. Stud. 72(1), 77–99 (2014).  https://doi.org/10.1016/j.ijhcs.2013.08.013 CrossRefGoogle Scholar
  22. 22.
    Masson, D., Demeure, A., Calvary, G.: Magellan, an evolutionary system to foster user interface design creativity. In: Proceedings of the 2Nd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS ’10, pp. 87–92. ACM, New York, NY, USA (2010)Google Scholar
  23. 23.
    Meixner, G., Calvary, G., Coutaz, J.: Introduction to model-based user interfaces (2014). https://www.w3.org/TR/mbui-intro/
  24. 24.
    Meixner, G., Paternò, F., Vanderdonckt, J.: Past, present, and future of model-based user interface development. i-com 10(3), 2–11 (2011).  https://doi.org/10.1524/icom.2011.0026 CrossRefGoogle Scholar
  25. 25.
    Meixner, G., Schäfer, R.: Modellbasierte entwicklung von benutzungsschnittstellen mit UIML (model-based development of user interfaces with UIML). i-com 8(1), 60–67 (2009).  https://doi.org/10.1524/icom.2009.0010 CrossRefGoogle Scholar
  26. 26.
    Melchior, J., Vanderdonckt, J., Van Roy, P.: A model-based approach for distributed user interfaces. In: Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS ’11, pp. 11–20. ACM, New York, NY, USA (2011).  https://doi.org/10.1145/1996461.1996488
  27. 27.
    Mellor, S.: MDA Distilled, Principles of Model Driven Architecture. Addison-Wesley Professional, Boston (2004)Google Scholar
  28. 28.
    Nebeling, M., Dey, A.K.: Xdbrowser: User-defined cross-device web page designs. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI ’16, pp. 5494–5505. ACM, New York, NY, USA (2016).  https://doi.org/10.1145/2858036.2858048
  29. 29.
    Object Management Group OMG: Unified modeling language (uml) (2015). http://www.omg.org/mof/
  30. 30.
    Object Management Group OMG: Mda - the architecture of choice for a changing world (2016). http://www.omg.org/mda/
  31. 31.
    Object Management Group OMG: Meta object facility (2016). http://www.omg.org/mof/
  32. 32.
    Object Management Group OMG: The object constraint language specification (2016). http://www.omg.org/spec/OCL/
  33. 33.
    Peñalver, A., López-Espín, J.J., Gallud, J.A., Lazcorreta, E., Botella, F.: Distributed User Interfaces: Specification of Essential Properties, pp. 13–21. Springer, London (2011).  https://doi.org/10.1007/978-1-4471-2271-5_2 CrossRefGoogle Scholar
  34. 34.
    Petrasch, R.: Model based user interface design: model driven architecture and hci patterns. Mitt Ges Inf. 27(3), 5–10 (2007)Google Scholar
  35. 35.
    Pilemalm, S., Hallberg, N., Sparf, M., Niclason, T.: Practical experiences of model-based development: case studies from the swedish armed forces. Syst. Eng. 15(4), 407–421 (2012)CrossRefGoogle Scholar
  36. 36.
    Pinheiro da Silva, P.: User interface declarative models and development environments: A survey. In: Palanque, P., Paternò, F. (eds.) Proceedings of the 7th International Workshop in Interactive Systems Design, Specification and Verification DSV-IS 2000, pp. 207–226. Springer, Berlin (2001)CrossRefGoogle Scholar
  37. 37.
    Szekely, P.: Retrospective and challenges for model-based interface development. In: Bodart, F., Vanderdonckt, J. (eds.) Proceedings of the Eurographics Workshop in Design, Specification and Verification of Interactive Systems ’96, pp. 1–27. Springer Vienna (1996)Google Scholar
  38. 38.
    Terrenghi, L., Quigley, A., Dix, A.: A taxonomy for and analysis of multi-person-display ecosystems. Personal Ubiquitous Comput. 13(8), 583–598 (2009)CrossRefGoogle Scholar
  39. 39.
    Vanderdonckt, J.: Distributed user interfaces: how to distribute user interface elements across users, platforms, and environments. Proc. XI Interaccin 2010, 20–32 (2010)Google Scholar
  40. 40.
    Vanderdonckt, J., Bodart, F.: Encapsulating knowledge for intelligent automatic interaction objects selection. In: Proceedings of the ACM Conference on Human Factors in Computing Systems, pp. 424–429. ACM Press (1993)Google Scholar
  41. 41.
    Vanderdonckt, J., Tesoriero, R., Mezhoudi, N., Motti, V., Beuvens, F., Melchior, J.: MBUI—abstract user interface models (2014). https://www.w3.org/TR/abstract-ui/
  42. 42.
    Villanueva, P.G., Tesoriero, R., Gallud, J.A.: Revisiting the Concept of Distributed User Interfaces, pp. 1–15. Springer, Berlin (2013)Google Scholar
  43. 43.
    Yang, J., Wigdor, D.: Panelrama: Enabling easy specification of cross-device web applications. In: Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems, CHI ’14, pp. 2783–2792. ACM, New York, NY, USA (2014).  https://doi.org/10.1145/2556288.2557199

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2017

Authors and Affiliations

  1. 1.University of Castilla-La ManchaAlbaceteSpain
  2. 2.King Abdulaziz UniversityJeddahSaudi Arabia

Personalised recommendations