Evaluating Online Travel Agencies’ Usability: What Heuristics Should We Use?

  • Cristian RusuEmail author
  • Virginica Rusu
  • Daniela Quiñones
  • Silvana Roncagliolo
  • Virginia Zaraza Rusu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10913)


Online travel agencies’ customers have nowadays a wide range of alternatives and are more demanding. Usability is a basic attribute in software quality. Heuristic evaluation is arguably the most popular usability inspection method, well-known and widely used. A heuristic evaluation may be performed based on generic or specific heuristics. Many sets of specific (usually domain-related) usability heuristics were published. Heuristic quality scales to validate and/or evaluate new heuristics were proposed. The paper analyzes evaluators’ perception on three sets of usability heuristics, when evaluating the same product: Nielsen’s generic heuristics, a set of cultural-oriented heuristics for e-Commerce, and a set of heuristics for smartphones applications (SMASH). We made an experiment with 38 Computer Science students, enrolled in a Human-Computer Interaction introductory course, using the online travel agency as case study; the web and mobile versions were evaluated. We assessed students’ perception based on a questionnaire that rates each heuristic individually (Utility, Clarity, Ease of use, Necessity of additional checklist), but also the set of heuristics as a whole (Easiness, Intention of future use, Completeness).


Online travel agency Heuristic evaluation Usability heuristics Heuristic quality 



We thank all the students involved in the experiment. They provided helpful opinions that allowed us to prepare this and (hopefully) further documents.


  1. 1.
    ISO 9241-210: Ergonomics of human-system interaction—Part 210: Human-centered design for interactive systems. International Organization for Standardization, Geneva (2010)Google Scholar
  2. 2.
    Lewis, J.R.: Usability: lessons learned… and yet to be learned. Int. J. Hum.-Comput. Interact. 30(9), 663–684 (2014)CrossRefGoogle Scholar
  3. 3.
    Nielsen, J., Mack, R.L.: Usability Inspection Methods. Wiley, New York (1994)CrossRefGoogle Scholar
  4. 4.
    Hermawati, S., Lawson, G.: Establishing usability heuristics for heuristics evaluation in a specific domain: is there a consensus? Appl. Ergon. 56, 34–51 (2016)CrossRefGoogle Scholar
  5. 5.
    Quiñones, D., Rusu, C.: How to develop usability heuristics: a systematic literature review. Comput. Stand. Interfaces 53, 89–122 (2017)CrossRefGoogle Scholar
  6. 6.
    Nielsen, J.: 10 Usability Heuristics for User Interface Design. Accessed 28 Dec 2017
  7. 7.
    Inostroza, R., Rusu, C., Roncagliolo, S., Rusu, V., Collazos, C.: Developing SMASH: a set of SMArtphone’s uSability Heuristics. Comput. Stand. Interfaces 50, 160–178 (2016)Google Scholar
  8. 8.
    Díaz, J., Rusu, C., Collazos, C.: Experimental validation of a set of cultural-oriented usability heuristics: e-commerce websites evaluation. Comput. Stand. Interfaces 53, 89–122 (2017)CrossRefGoogle Scholar
  9. 9.
    Expedia. Accessed 10 Jan 2018
  10. 10.
    Rusu, C., Rusu, V., Roncagliolo, S., Apablaza, J., Rusu, V.Z.: User experience evaluations: challenges for newcomers. In: Marcus, A. (ed.) DUXU 2015. LNCS, vol. 9186, pp. 237–246. Springer, Cham (2015). Scholar
  11. 11.
    Rusu, C., Rusu, V., Roncagliolo, S., Quiñones, D., Rusu, V.Z., Fardoun, H.M., Alghazzawi, D.M., Collazos, C.A.: Usability heuristics: reinventing the wheel? In: Meiselwitz, G. (ed.) SCSM 2016. LNCS, vol. 9742, pp. 59–70. Springer, Cham (2016). Scholar
  12. 12.
    Rusu, V., Rusu, C., Quiñones, D., Roncagliolo, S., Collazos, C.A.: What happens when evaluating social media’s usability? In: Meiselwitz, G. (ed.) SCSM 2017. LNCS, vol. 10282, pp. 117–126. Springer, Cham (2017). Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Cristian Rusu
    • 1
    Email author
  • Virginica Rusu
    • 2
  • Daniela Quiñones
    • 1
  • Silvana Roncagliolo
    • 1
  • Virginia Zaraza Rusu
    • 1
  1. 1.Pontificia Universidad Católica de ValparaísoValparaísoChile
  2. 2.Universidad de Playa AnchaValparaísoChile

Personalised recommendations