An Empirical Evaluation of a Usability Measurement Method in a Model Driven Framework

  • Lassad Ben Ammar
  • Adel Mahfoudhi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7946)


Usability is increasingly considered as a basic determinant of the Interactive Systems (IS) success. An IS that satisfies all the functional requirements can be rejected by end-users if it presents usability problems. Unusable User Interface (UI) is probably the main reason that may lead to the failure in the actual use of an IS. Therefore, several approaches dealing with the evaluation of the user interface usability have been proposed in literature. However, these approaches are focused on the final system and require a large amount of resources to perform the evaluation (end-users, video cameras, questionnaires, etc.). The ability to go back and makes major changes to the design is greatly reduced. It is widely accepted that the evaluation performed at the beginning of the development process is a critical part of ensuring that the product will be used and effective for its intended purpose. In addition, an early usability evaluation would be a significant advantage with regard to saving time and resources.

The purpose of the present paper is to investigate the integration of the usability issues at an early stage of the development process. A model based approach is presented and empirically evaluated.


Plastic User Interface Usability Model Empirical Evaluation Model Driven Engineering 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bpmn: Business process modeling notation version 1.0. (2004),
  2. 2.
    ISO/IEC 9241. Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs). ISO/IEC (1998)Google Scholar
  3. 3.
    Abrahao, S., Insfran, E.: Early usability evaluation in model driven architecture environments. In: Proceedings of the Sixth International Conference on Quality Software, pp. 287–294. IEEE Computer Society, Washington, DC (2006)Google Scholar
  4. 4.
    Abran, A., Khelifi, A., Suryn, W., Seffah, A.: Usability meanings and interpretations in iso standards. Software Quality Control 11(4), 325–338 (2003)CrossRefGoogle Scholar
  5. 5.
    Aquino, N., Vanderdonckt, J., Condori-Fernández, N., Dieste, Ó., Pastor, Ó.: Usability evaluation of multi-device/platform user interfaces generated by model-driven engineering. In: Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2010, pp. 30:1–30:10. ACM, New York (2010)Google Scholar
  6. 6.
    Basili, V.R., Caldiera, G., Dieter Rombach, H.: The goal question metric approach. In: Encyclopedia of Software Engineering. Wiley (1994)Google Scholar
  7. 7.
    Christian Bastien, J.M., Scapin, D.L.: Ergonomic criteria for the evaluation of human-computer interfaces. Technical Report RT-0156, INRIA (June 1993)Google Scholar
  8. 8.
    Bevan, N., Macleod, M.: Usability measurement in context. Behaviour and Information Technology 13, 132–145 (1994)CrossRefGoogle Scholar
  9. 9.
    Boehm, B.W.: Software Engineering Economics. Prentice Hall, Englewood Cliffs (1981)zbMATHGoogle Scholar
  10. 10.
    Bouchelligua, W., Mahfoudhi, A., Mezhoudi, N., Daassi, O., Abed, M.: User interfaces modelling of workflow information systems. In: Barjis, J. (ed.) EOMAS 2010. LNBIP, vol. 63, pp. 143–163. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  11. 11.
    Calvary, G., Coutaz, J., Thevenin, D.: A unifying reference framework for the development of plastic user interfaces. In: Nigay, L., Little, M.R. (eds.) EHCI 2001. LNCS, vol. 2254, pp. 173–192. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  12. 12.
    Campbell, D.T., Fiske, D.W.: Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin 56, 81–105 (1959)CrossRefGoogle Scholar
  13. 13.
    Coutaz, J.: User interface plasticity: model driven engineering to the limit! In: EICS, pp. 1–8 (2010)Google Scholar
  14. 14.
    Endres, A., Rombach, D.: A handbook of software and systems engineering: empirical observations, laws and theories. The Fraunhofer IESE series on software engineering. Pearson/Addison Wesley, Harlow, England (2003)Google Scholar
  15. 15.
    Fernandez, A., Insfran, E., Abrahão, S.: Integrating a usability model into model-driven web development processes. In: Vossen, G., Long, D.D.E., Yu, J.X. (eds.) WISE 2009. LNCS, vol. 5802, pp. 497–510. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  16. 16.
    Gómez, J., Cachero, C., Pastor, O.: Conceptual modeling of device-independent web applications. IEEE MultiMedia 8(2), 26–39 (2001)CrossRefGoogle Scholar
  17. 17.
    Holzinger, A.: Usability engineering methods for software developers. Commun. ACM 48(1), 71–74 (2005)CrossRefGoogle Scholar
  18. 18.
    ISO/IEC. ISO/IEC 9126. Software engineering – Product quality. ISO/IEC (2001)Google Scholar
  19. 19.
    Juristo, Moreno: Basics of Software Engineering Experimentation. Kluwer Academic Publishers, Norwell (2001)CrossRefGoogle Scholar
  20. 20.
    Kirakowski, J., Corbett, M.: Sumi: the software usability measurement inventory. British Journal of Educational Technology 24(3), 210–212 (1993)CrossRefGoogle Scholar
  21. 21.
    Lacob, M.E.: Readability and Usability Guidelines (2003)Google Scholar
  22. 22.
    Shneiderman, B., Leavit, M.: Research Based Web Design & Usability Guidelines (2006)Google Scholar
  23. 23.
    Murata, M., Uchimoto, K., Ma, Q., Isahara, H.: Magical number seven plus or minus two: Syntactic structure recognition in japanese and english sentences. In: Gelbukh, A. (ed.) CICLing 2001. LNCS, vol. 2004, pp. 43–52. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  24. 24.
    Nielsen, J., Molich, R.: Heuristic evaluation of user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Empowering People, CHI 1990, pp. 249–256. ACM, New York (1990)CrossRefGoogle Scholar
  25. 25.
    Panach, J.I., Condori-Fernandez, N., Vos, T.E.J., Aquino, N., Valverde, F.: Early usability measurement in model-driven development: Definition and empirical evaluation. International Journal of Software Engineering and Knowledge Engineering 21(3), 339–365 (2011)CrossRefGoogle Scholar
  26. 26.
    Rubin, J.: Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests. John Wiley & Sons, Inc., New York (1994)Google Scholar
  27. 27.
    Schmidt, D.C.: Model-driven engineering. IEEE Computer 39(2) (February 2006)Google Scholar
  28. 28.
    Seffah, A., Donyaee, M., Kline, R.B., Padda, H.K.: Usability measurement and metrics: A consolidated model. Software Quality Control 14, 159–178 (2006)CrossRefGoogle Scholar
  29. 29.
    Thevenin, D., Coutaz, J.: Plasticity of user interfaces: Framework and research agenda. In: Sasse, A., Johnson, C. (eds.) Proc. Interact 1999, Edinburgh, pp. 110–117. IFIP IOS Press Publ. (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Lassad Ben Ammar
    • 1
  • Adel Mahfoudhi
    • 1
  1. 1.ENIS, CES LaboratoryUniversity of SfaxSfaxTunisia

Personalised recommendations