Usability Evaluation of Model-Driven Cross-Device Web User Interfaces

  • Enes YigitbasEmail author
  • Anthony Anjorin
  • Ivan Jovanovikj
  • Thomas Kern
  • Stefan Sauer
  • Gregor Engels
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11262)


User Interface (UI) development is a challenging task as modern UIs are expected to be available across a wide range of diverse platforms while assuring high usability for heterogeneous users. Model-driven engineering principles have been applied in the context of multi-device and cross-device UI development to tackle complexity in development. While previous work related to usability evaluation of model-driven UIs primarily focused on single- and multi-device UIs, an investigation of the usability of model-driven cross-device UIs was not fully covered yet. In this paper, therefore, we present a model-driven UI development (MDUID) approach for cross-device UIs and analyze whether the applied MDUID approach has a positive impact on the usability of the generated UI. To accomplish this, we conduct a usability evaluation based on the generated UI for a cross-channel banking web application. The usability evaluation results provide detailed feedback regarding fulfillment of different usability criteria and enable improvement of involved models as well as model transformations.


Model-driven UI development Usability Cross-device UIs 



This paper is based on some of the work within “KoMoS”, a project of the “it’s OWL” Leading-Edge Cluster, partially funded by the German Federal Ministry of Education and Research (BMBF). We also acknowledge the support of the project “Mittelstand 4.0” funded by the German Federal Ministry for Economic Affairs and Energy.


  1. 1.
    Abrahão, S., Iborra, E., Vanderdonckt, J.: Usability evaluation of user interfaces generated with a model-driven architecture tool. In: Law, E.L.-C., Hvannberg, E.T., Cockton, G. (eds.) Maturing Usability. HIS, pp. 3–32. Springer, London (2008). Scholar
  2. 2.
    Aquino, N., Vanderdonckt, J., Condori-Fernandez, N., Dieste, O., Pastor, O.: Usability evaluation of multi-device/platform user interfaces generated by model-driven engineering. In: Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM 2010) (2010)Google Scholar
  3. 3.
    Brambilla, M., Fraternali, P.: Interaction Flow Modeling Language - Model-Driven UI Engineering of Web and Mobile Apps with IFML. The MK/OMG Press, New York (2014)Google Scholar
  4. 4.
    Gediga, G., Hamborg, K., Duentsch, I.: The IsoMetrics usability inventory: an operationalisation of ISO 9241–10. Behav. Inf. Technol. 18(1999), 151–164 (1999)CrossRefGoogle Scholar
  5. 5.
    Ghiani, G., Paterno’, F., Santoro, C.: Push and pull of web user interfaces in multi-device environments. In: Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI 2012), pp. 10–17. ACM, New York (2012)Google Scholar
  6. 6.
    Hamilton, P., Wigdor, D.: Conductor: enabling and understanding cross-device interaction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2014), pp. 2773–2782. ACM, New York (2014)Google Scholar
  7. 7.
    International Organization for Standardization. ISO 9241–11: Ergonomic requirements for office work with visual display terminals (VDTs) - Part 9: Guidance on usability (1998)Google Scholar
  8. 8.
    Limbourg, Q., Vanderdonckt, J.: USIXML: a user interface description language supporting multiple levels of independence. In: Engineering Advanced Web Applications: Proceedings of Workshops in connection with the 4th International Conference on Web Engineering, pp. 325–338. Rinton Press (2004)Google Scholar
  9. 9.
    Majrashi, K., Hamilton, M., Uitdenbogerd, A.: Cross-platform usability and eye-tracking measurement and analysis model. In: Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: The Future of Design (OzCHI 2014), pp. 418–421. ACM, New York (2014)Google Scholar
  10. 10.
    Manca, M., Paterno’, F.: Customizable dynamic user interface distribution. In: Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2016), pp. 27–37. ACM, New York (2016)Google Scholar
  11. 11.
    Mori, G., Paterno’, F., Santoro, C.: Design and development of multidevice user interfaces through multiple logical descriptions. IEEE Trans. Softw. Eng. 30(8), 507–520 (2004)CrossRefGoogle Scholar
  12. 12.
    Nebeling, M., Mintsi, T., Husmann, M., Norrie, M.: Interactive development of cross-device user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2014) (2014)Google Scholar
  13. 13.
    Paterno’, F., Santoro, C.: A logical framework for multi-device user interfaces. In: Proceedings of the 4th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2012), pp. 45–50. ACM, New York (2012)Google Scholar
  14. 14.
    Paterno’, F., Santoro, C., Scorcia, A.: Ambient intelligence for supporting task continuity across multiple devices and implementation languages. Comput. J. 53(8), 1210–1228 (2010)CrossRefGoogle Scholar
  15. 15.
    Paterno’, F., Santoro, C., Spano, L.D.: MARIA: a universal, declarative, multiple abstraction-level language for service-oriented applications in ubiquitous environments. ACM Trans. Comput. Hum. Interact. 16(4), 19:1–19:30 (2009)Google Scholar
  16. 16.
    Scholtz, J.: Common industry format for usability test reports. CHI Extended Abstracts (2000)Google Scholar
  17. 17.
    Yigitbas, E., Kern, T., Urban, P., Sauer, S.: Multi-device UI development for task-continuous cross-channel web applications. In: Casteleyn, S., Dolog, P., Pautasso, C. (eds.) ICWE 2016. LNCS, vol. 9881, pp. 114–127. Springer, Cham (2016). Scholar
  18. 18.
    Yigitbas, E., Stahl, H., Sauer, S., Engels, G.: Self-adaptive UIs: integrated model-driven development of UIs and their adaptations. In: Anjorin, A., Espinoza, H. (eds.) ECMFA 2017. LNCS, vol. 10376, pp. 126–141. Springer, Cham (2017). Scholar
  19. 19.
    Yigitbas, E., Sauer, S., Engels, G.: Adapt-UI: an IDE supporting model-driven development of self-adaptive UIs. In: Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2017), pp. 99–104. ACM, New York (2017)Google Scholar
  20. 20.
    Yang, J., Wigdor, D.: Panelrama: enabling easy specification of cross-device web applications. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2014), pp. 2783–2792. ACM, New York (2014)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2019

Authors and Affiliations

  • Enes Yigitbas
    • 1
    Email author
  • Anthony Anjorin
    • 1
  • Ivan Jovanovikj
    • 1
  • Thomas Kern
    • 2
  • Stefan Sauer
    • 1
  • Gregor Engels
    • 1
  1. 1.Paderborn UniversityPaderbornGermany
  2. 2.Diebold Nixdorf AGPaderbornGermany

Personalised recommendations