Heuristic Evaluation of Mobile Usability: A Mapping Study

  • André de Lima Salgado
  • André Pimenta Freire
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8512)


The mobile devices market has grown substantially, along with significant developments in mobile interactive technologies. Devices such as tablets, smartphones and others have increasingly become more popular and helped improve the way people interact and exchange information. The aim of this paper is to perform a systematic mapping of the literature regarding the use of heuristic evaluation methods applied on mobile applications. The aims of this research were twofold: analysing what are the most used sets of usability heuristics on usability evaluations of mobile devices, providing a common base to improve mobile design and usability evaluation; analysing details of how usability inspections of mobile applications have been conducted. The results show that different heuristics have been reported in research papers to evaluate usability of mobile devices. The study identified a total of 9 different heuristics sets means of the literature mapping. The traditional set of heuristics proposed by Nielsen and Molich was still the most used set of heuristics in heuristic usability evaluations of mobile devices, but the proposal of new specific heuristics for mobile interfaces has grown substantially.


mobile usability heuristic evaluation usability inspection 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Barricelli, B.R., Devis, Y., Abdelnour-Nocera, J., Wilson, J., Moore, J.: MANTRA: mobile anticoagulant therapy management. In: 2013 7th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth), pp. 278–281. IEEE (2013)Google Scholar
  2. 2.
    Bertini, E., Catarci, T., Dix, A., Gabrielli, S., Kimani, S., Santucci, G.: Appropriating heuristic evaluation for mobile computing. Human-Computer Interaction and Innovation in Handheld, Mobile and Wearable Technologies 20 (2011)Google Scholar
  3. 3.
    Bertini, E., Gabrielli, S., Kimani, S.: Appropriating and assessing heuristics for mobile computing. In: Proceedings of the Working Conference on Advanced Visual Interfaces, pp. 119–126. ACM (2006)Google Scholar
  4. 4.
    Biel, B., Grill, T., Gruhn, V.: Exploring the benefits of the combination of a software architecture analysis and a usability evaluation of a mobile application. Journal of Systems and Software 83(11), 2031–2044 (2010)CrossRefGoogle Scholar
  5. 5.
    Billi, M., Burzagli, L., Catarci, T., Santucci, G., Bertini, E., Gabbanini, F., Palchetti, E.: A unified methodology for the evaluation of accessibility and usability of mobile applications. Universal Access in the Information Society 9(4), 337–356 (2010)CrossRefGoogle Scholar
  6. 6.
    Conde, A., et al.: An Intelligent Tutoring System Oriented to the Integration of People with Intellectual Disabilities. In: Demazeau, Y., Dignum, F., Corchado, J.M., Bajo, J., Corchuelo, R., Corchado, E., Fernández-Riverola, F., Julián, V.J., Pawlewski, P., Campbell, A. (eds.) Trends in PAAMS. AISC, vol. 71, pp. 639–647. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  7. 7.
    Fetaji, M., Fetaji, B.: Comparing developed MLUAT (mobile learning usability attribute testing) methodology with qualitative user testing method and heuristics evaluation. In: Proceedings of the 12th International Conference on Computer Systems and Technologies, pp. 516–523. ACM (2011)Google Scholar
  8. 8.
    Gielkens, C., Wetzel, R.: A framework for usability evaluation of mobile mixed reality games. In: Herrlich, M., Malaka, R., Masuch, M. (eds.) ICEC 2012. LNCS, vol. 7522, pp. 401–404. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  9. 9.
    Gielkens, C.: A framework for usability evaluation of mobile mixed reality games. Faculty of Science Theses (2012)Google Scholar
  10. 10.
    Heo, J., Ham, D.H., Park, S., Song, C., Yoon, W.C.: A framework for evaluating the usability of mobile phones based on multi-level, hierarchical model of usability factors. Interacting with Computers 21(4), 263–275 (2009)CrossRefGoogle Scholar
  11. 11.
    Inostroza, R., Rusu, C., Roncagliolo, S., Jimnez, C., Rusu, V.: Usability Heuristics for Touchscreen-based Mobile Devices. In: 2012 Ninth International Conference on Information Technology: New Generations (ITNG), pp. 662–667. IEEE (2012)Google Scholar
  12. 12.
    Huang, C.H., Wang, C.M.: Usability Analysis in Gesture Operation of Interactive E-Books on Mobile Devices. In: Marcus, A. (ed.) Design, User Experience, and Usability, Pt I, HCII 2011. LNCS, vol. 6769, pp. 573–582. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  13. 13.
    ISO, I., FCD, I.: 25000, Software Engineering-Software Product Quality Requirements and Evaluation (SQuaRE)-Guide to SQuaRE. International Organization for Standardization, Geneva (2004)Google Scholar
  14. 14.
    Karahoca, A., Bayraktar, E., Tatoglu, E., Karahoca, D.: Information system design for a hospital emergency department: A usability analysis of software prototypes. Journal of Biomedical Informatics 43(2), 224–232 (2010)CrossRefGoogle Scholar
  15. 15.
    Karampelas, P., Akoumianakis, D., Stephanidis, C.: Usability inspection of the WardInHand prototype. In: Universal Access in Health Telematics, pp. 197–208. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  16. 16.
    Kitchenham, B.: Procedures for performing systematic reviews. Keele, UK, Keele University 33 (2004)Google Scholar
  17. 17.
    Kitchenham, B.A., Charters, S.: Guidelines for performing systematic literature reviews in software engineering (2007)Google Scholar
  18. 18.
    Korhonen, H., Koivisto, E.M.: Playability heuristics for mobile games. In: Proceedings of the 8th Conference on Human-Computer Interaction with Mobile Devices and Services, pp. 9–16. ACM (2006)Google Scholar
  19. 19.
    Longoria, R.G., McGee, M., Nash, E.: Heuristics for Designing Mobile Applications. In: Designing Software for the Mobile Context, pp. 109–134. Springer, London (2004)CrossRefGoogle Scholar
  20. 20.
    Marcus, A., Abromowitz, S., Abulkhair, M.F.: Heuristic Evaluation of iCalamityGuide Application. In: Marcus, A. (ed.) DUXU 2013, Part III. LNCS, vol. 8014, pp. 130–139. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  21. 21.
    Monetate: More Bad News for Email?. Ecommerce Quarterly (EQ3) (2013)Google Scholar
  22. 22.
    Nayebi, F., Desharnais, J.M., Abran, A.: The state of the art of mobile application usability evaluation. In: 2012 25th IEEE Canadian Conference on Electrical & Computer Engineering (CCECE), pp. 1–4. IEEE (2012)Google Scholar
  23. 23.
    Nielsen, J., Budiu, R.: Mobile usability. Pearson Education (2012)Google Scholar
  24. 24.
    Nielsen, J., Molich, R.: Heuristic evaluation of user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 249–256. ACM (1990)Google Scholar
  25. 25.
    Pierotti, D.: HE Checklist. Xerox Corporation, (last accessed on February 7, 2014)
  26. 26.
    Po, S., Howard, S., Vetere, F., Skov, M.B.: Heuristic evaluation and mobile usability: Bridging the realism gap. In: Brewster, S., Dunlop, M.D. (eds.) Mobile HCI 2004. LNCS, vol. 3160, pp. 49–60. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  27. 27.
    Salazar, L.H.A., Lacerda, T., von Wangenheim, C.G., Barbalho, R.A.: Customization of usability heuristics for mobile phones. In: Companion Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems, pp. 37–38. Brazilian Computer Society (2012) (in Portuguese)Google Scholar
  28. 28.
    Schönfelder, R., Schmalstieg, D.: Augmented reality for industrial building acceptance. In: Virtual Reality Conference, VR 2008, pp. 83–90. IEEE (2008)Google Scholar
  29. 29.
    Soomro, S., Wan Ahmad, W.F., Sulaiman, S.: Evaluation of Mobile Games Using Playability Heuristics. In: Zaman, H.B., Robinson, P., Olivier, P., Shih, T.K., Velastin, S. (eds.) IVIC 2013. LNCS, vol. 8237, pp. 264–274. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  30. 30.
    Varsaluoma, J.: Scenarios in the Heuristic Evaluation of Mobile Devices: Emphasizing the Context of Use. In: Kurosu, M. (ed.) HCD 2009. LNCS, vol. 5619, pp. 332–341. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  31. 31.
    Wahab, N.A., Osman, A., Ismail, M.H.: Engaging children to science subject: a heuristic evaluation of mobile learning prototype. In: 2010 Second International Conference on Computer Engineering and Applications (ICCEA), vol. 2, pp. 513–516. IEEE (2010)Google Scholar
  32. 32.
    Zaibon, S.B., Shiratuddin, N.: Heuristics evaluation strategy for mobile game-based learning. In: 2010 6th IEEE International Conference on Wireless, Mobile and Ubiquitous Technologies in Education (WMUTE), pp. 127–131. IEEE (2010)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • André de Lima Salgado
    • 1
  • André Pimenta Freire
    • 1
  1. 1.Computer Science DepartmentFederal University of LavrasLavrasBrazil

Personalised recommendations