Quantifying the Usability Through a Variant of the Traditional Heuristic Evaluation Process

  • Freddy PazEmail author
  • Freddy A. Paz
  • Manuel Sánchez
  • Arturo Moquillaza
  • Luis Collantes
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10918)


Usability has become in an essential aspect for the success of E-Commerce applications, especially in the current context in which there is high competitiveness because of a large number of websites that are available on the Internet. However, there is little evidence in the literature about the existence of methods that allow specialists to measure the level of usability of the system interfaces through a quantitative approach. The advantage of obtaining a numeric value about the ease of use is the possibility to perform comparisons between different design proposals and determine the best alternative for a specific scenario. Likewise, a quantifying process of the level of usability provide companies with the necessary mechanism to establish the degree in which their web applications are more usable regarding other accessible websites in a highly competitive market. In this paper, we present the results of applying a variant to the traditional heuristic evaluation process to determine the usability degree of two web applications. This case study is intended to serve as a framework for specialists in this field that are interested in retrieving quantitative data in addition to the traditional usability issues that are identified.


Human-Computer Interaction Usability Heuristic evaluation Quantitative metrics Assessment framework 


  1. 1.
    Alroobaea, R., Mayhew, P.: How many participants are really enough for usability studies? In: Proceedings of 2014 Science and Information Conference, SAI 2014, pp. 48–56 (2014)Google Scholar
  2. 2.
    Bonastre, L., Granollers, T.: A set of heuristics for user experience evaluation in e-commerce websites. In: Proceedings of the Seventh International Conference on Advances in Computer-Human Interactions (ACHI 2014), pp. 27–34 (2014)Google Scholar
  3. 3.
    Davis, F.D.: Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 13(3), 319–340 (1989)CrossRefGoogle Scholar
  4. 4.
    Díaz, J., Rusu, C., Collazos, C.A.: Experimental validation of a set of cultural-oriented usability heuristics: e-commerce websites evaluation. Comput. Stand. Interfaces 50, 160–178 (2017)CrossRefGoogle Scholar
  5. 5.
    Granollers, T.: Validación experimental de un conjunto heurístico para evaluaciones de ux de sitios web de comercio-e. In: 2016 IEEE 11th Colombian Computing Conference (CCC), pp. 1–8, September 2016Google Scholar
  6. 6.
    Hasan, L., Morris, A., Probets, S.: Using Google analytics to evaluate the usability of e-commerce sites. In: Kurosu, M. (ed.) HCD 2009. LNCS, vol. 5619, pp. 697–706. Springer, Heidelberg (2009). Scholar
  7. 7.
    ISO: Software engineering – product quality – part 1: Quality model. Standard ISO 9126–1:2001, International Organization for Standardization, Geneva, Switzerland (2001)Google Scholar
  8. 8.
    Lewis, J.R.: IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int. J. Hum.-Comput. Interact. 7(1), 57–78 (1995)CrossRefGoogle Scholar
  9. 9.
    de Lima Salgado, A., Agostini do Amaral, L., de Mattos Fortes, R.P., Hortes Nisihara Chagas, M., Joyce, G.: Addressing mobile usability and elderly users: validating contextualized heuristics. In: Marcus, A., Wang, W. (eds.) DUXU 2017. LNCS, vol. 10288, pp. 379–394. Springer, Cham (2017). Scholar
  10. 10.
    Nielsen, J.: Finding usability problems through heuristic evaluation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1992, pp. 373–380. ACM, New York (1992)Google Scholar
  11. 11.
    Nielsen, J.: Usability Engineering. Morgan Kaufmann Publishers Inc., San Francisco (1993)zbMATHGoogle Scholar
  12. 12.
    Nielsen, J.: Usability inspection methods. In: Conference Companion on Human Factors in Computing Systems, CHI 1994, pp. 413–414. ACM, New York (1994)Google Scholar
  13. 13.
    Nielsen, J., Landauer, T.K.: A mathematical model of the finding of usability problems. In: Proceedings of the INTERACT 1993 and CHI 1993 Conference on Human Factors in Computing Systems, CHI 1993, pp. 206–213. ACM, New York (1993)Google Scholar
  14. 14.
    Nielsen, J., Molich, R.: Heuristic evaluation of user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1990, pp. 249–256. ACM, New York (1990)Google Scholar
  15. 15.
    Nielsen Norman Group: 10 usability heuristics for user interface design (1995). Accessed 14 Jan 2016
  16. 16.
    Nielsen Norman Group: Severity ratings for usability problems (2012). Accessed 14 Jan 2016
  17. 17.
    Paz, F., Pow-Sang, J.A.: Current trends in usability evaluation methods: a systematic review. In: 2014 7th International Conference on Advanced Software Engineering and its Applications, pp. 11–15, December 2014Google Scholar
  18. 18.
    Paz, F., Paz, F.A., Pow-Sang, J.A.: Experimental case study of new usability heuristics. In: Marcus, A. (ed.) DUXU 2015. LNCS, vol. 9186, pp. 212–223. Springer, Cham (2015). Scholar
  19. 19.
    Paz, F., Pow-Sang, J.A.: A systematic mapping review of usability evaluation methods for software development process. Int. J. Softw. Eng. Appl. 10(1), 165–178 (2016)Google Scholar
  20. 20.
    Quiñones, D., Rusu, C.: How to develop usability heuristics: a systematic literature review. Comput. Stand. Interfaces 53, 89–122 (2017)CrossRefGoogle Scholar
  21. 21.
    Sauro, J., Lewis, J.R.: Quantifying the User Experience: Practical Statistics for User Research, 1st edn. Morgan Kaufmann Publishers Inc., San Francisco (2012)Google Scholar
  22. 22.
    Zapata, C., Pow-Sang, J.A.: Sample size in a heuristic evaluation of usability. In: Software Engineering: Methods, Modeling, and Teaching, vol. 37 (2012)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Freddy Paz
    • 1
    Email author
  • Freddy A. Paz
    • 2
  • Manuel Sánchez
    • 2
  • Arturo Moquillaza
    • 1
    • 3
  • Luis Collantes
    • 2
  1. 1.Pontificia Universidad Católica del PerúLima 32Peru
  2. 2.Universidad Nacional Pedro Ruiz GalloLambayequePeru
  3. 3.Universidad San Ignacio de LoyolaLima 12Peru

Personalised recommendations