Experimental Case Study of New Usability Heuristics

  • Freddy PazEmail author
  • Freddy Asrael Paz
  • José Antonio Pow-Sang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9186)


A widely used method to measure the level of usability of software applications is the heuristic evaluation. In this method, specialists commonly use the Nielsen’s heuristics to assess the usability of a software product. However, these principles address to general aspects and become inappropriate when they are used to evaluate new categories of software applications. For this reason, we previously proposed a new set of usability heuristics in the Web transactional domain. In this paper, we present an empirical analysis of our new proposal. For this purpose, fifteen undergraduate students were asked to perform a heuristic evaluation in which the new set of heuristics were employed. A survey was taken in order to capture their perceptions about the heuristics in four dimensions: ease of use, usefulness, intention to use and completeness. The results showed that the new heuristics meet the expectations. In addition, this analysis was compared with the results of a similar study that was performed to the current proposal of Nielsen. The results from this study have allowed to reach promising results in this area.


Heuristic evaluation Usability inspection Usability heuristics Experimental evaluation Perception model 


  1. 1.
    Alroobaea, R., Mayhew, P.: How many participants are really enough for usability studies? Science and Information Conference (SAI) 2014, 48–56 (2014)Google Scholar
  2. 2.
    Davis, F.D.: Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly 13(3), 319–340 (1989)CrossRefzbMATHGoogle Scholar
  3. 3.
    Davis, F.D., Bagozzi, R.P., Warshaw, P.R.: User acceptance of computer technology: A comparison of two theoretical models. Management Science 35(8), 982–1003 (1989)CrossRefGoogle Scholar
  4. 4.
    Fernandez, A., Insfran, E., Abraho, S.: Usability evaluation methods for the web: A systematic mapping study. Information and Software Technology 53(8), 789–817 (2011)CrossRefGoogle Scholar
  5. 5.
    Holzinger, A.: Usability engineering methods for software developers. Commun. ACM 48(1), 71–74 (2005)CrossRefGoogle Scholar
  6. 6.
    Jurca, G., Hellmann, T., Maurer, F.: Integrating agile and user-centered design: A systematic mapping and review of evaluation and validation studies of agile-ux. Agile Conference (AGILE) 2014, 24–32 (2014)Google Scholar
  7. 7.
    Moody, D.: Dealing with Complexity: A Practical Method for Representing Large Entity Relationship Models. University of Melbourne, Department of Information Systems (2001)Google Scholar
  8. 8.
    Muijs, D.: Doing quantitative research in education with SPSS. Sage (2010)Google Scholar
  9. 9.
    Nielsen, J.: Usability inspection methods. In: Conference Companion on Human Factors in Computing Systems. pp. 413–414. CHI ’94, ACM, New York, NY, USA (1994)Google Scholar
  10. 10.
    Paz, F., Asrael Paz, F., Pow-Sang, J., Collantes, L.: Usability heuristics for transactional web sites. In: Information Technology: New Generations (ITNG), 2014 11th International Conference on. pp. 627–628 (April 2014)Google Scholar
  11. 11.
    Paz, F., Villanueva, D., Rusu, C., Roncagliolo, S., Pow-Sang, J.: Experimental evaluation of usability heuristics. In: Information Technology: New Generations (ITNG), 2013 Tenth International Conference on. pp. 119–126 (April 2013)Google Scholar
  12. 12.
    Paz, F.: Usability Heuristics for Transactional Web Sites. Master’s thesis, Pontifical Catholic University of Peru (December 2013)Google Scholar
  13. 13.
    Rescher, N.: Methodological Pragmatism: Systems-theoretic Approach to the Theory of Knowledge. Blackwell Publishers, New York, NY, 1 edition edn. (1977)Google Scholar
  14. 14.
    Rusu, C., Roncagliolo, S., Rusu, V., Collazos, C.: A methodology to establish usability heuristics. In: The Fourth International Conference on Advances in Computer-Human Interactions. pp. 59–62. ACHI ’11 (2011)Google Scholar
  15. 15.
    Salvador, C., Nakasone, A., Pow-Sang, J.A.: A systematic review of usability techniques in agile methodologies. In: Proceedings of the 7th Euro American Conference on Telematics and Information Systems. EATIS 2014, pp. 17:1–17:6. ACM, New York (2014)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Freddy Paz
    • 1
    Email author
  • Freddy Asrael Paz
    • 2
  • José Antonio Pow-Sang
    • 1
  1. 1.Pontificia Universidad Católica del PerúSan Miguel, LimaPerú
  2. 2.Universidad Nacional Pedro Ruiz GalloLambayequePerú

Personalised recommendations