Skip to main content
SpringerLink
Log in

Empirical Investigation of Usability Evaluation Methods for Mobile Applications Using Evidence-Based Approach

  • Conference paper
  • First Online:
Microservices in Big Data Analytics

Abstract

Mobile learning or m-learning is novel learning medium, and consequently, there is a lot of research required to design usable m-learning applications. With the advent of new m-learning applications and their indulgence in imparting education, it poses new usability challenges. M-learning has to be investigated from various perspectives for its effectiveness and efficiency. So to have an effective and usable m-learning application, it is quintessential to discover an appropriate set of usability evaluation methods [UEMs] to evaluate the usability of m-learning application. For the aforesaid purpose, an evidence-based study of UEMs is carried out in this paper to compare and then assess different UEMs. To bridge the gaps between research evidence and software development practices and to avoid expensive and ineffective decision making during application development, an evidence-based approach is suggested by [1, 2]. Evidence-based study is the process of systematically finding, evaluating, and using contemporary research conclusions as the basis for decision making. An evidence-based study is required before the adoption of UEM/UEMs because sufficient evidences should be gathered as a decision factor before testing an application. This study presents an empirical analysis for selecting effectual UEM(s) for a set of mobile learning applications using evidence-based approach [EBA].

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Dybå, T., Bergersen, G.R., Sjøberg, D.I.K.: Evidence-based software engineering. In: Perspectives on Data Science for Software Engineering, pp. 149–153 (2016)

    Chapter  Google Scholar 

  2. Kitchenham, B., Charters, S.M.: Guidelines for Performing Systematic Literature Reviews in Software Engineering (2007)

    Google Scholar 

  3. Vatankhah, N., Wei, K.T., Letchmunan, S.: Usability measurement of Malaysian online tourism websites. Int. J. Softw. Eng. Appl. 8(12), 1–18 (2014)

    Google Scholar 

  4. Paz, F., Pow-Sang, J.A.: A systematic mapping review of usability evaluation methods for software development process. Int. J. Softw. Eng. Appl. 10(1), 165–178 (2016)

    Google Scholar 

  5. Schubert, D., Mühlstedt, J., Bullinger, A.C.: Usability assessment of medical devices from a user perspective: results of a focus group discussion. In: Challenges and Opportunities in Health Care Management, pp. 223–235. Springer, Cham (2015)

    Google Scholar 

  6. Ardito, C., De Marsico, M., Lanzilotti, R., Levialdi, S., Roselli, T., Rossano, V., Tersigni, M.: Usability of E-learning tools. In: Ai’04, pp. 80–84 (2004)

    Google Scholar 

  7. Salvador, C., Nakasone, A., Pow-Sang, J.A.: A systematic review of usability techniques in agile methodologies. In: Proceedings of the 7th Euro American Conference on Telematics and Information Systems, p. 17. ACM (2014)

    Google Scholar 

  8. Fenton, N., Pfleeger, S.L.: Software metrics: a rigorous and practical approach. International Thomson Computer Press (2nd edn.) (1994)

    Google Scholar 

  9. Mathur, P., Chande, S.V.: Usability testing methods for mobile learning applications. Int. J. Comput. Sci. Mob. Appl. 5(10), 1–9 (2017)

    Google Scholar 

  10. Petticrew, M., Roberts, H.: Systematic Reviews in the Social Sciences: A Practical Guide. In Blackwell Publishing (2006)

    Google Scholar 

  11. Nayebi, F., Desharnais, J.M., Abran, A.: The state of the art of mobile application usability evaluation. In: 2012 25th IEEE Canadian Conference on Electrical & Computer Engineering (CCECE), pp. 1–4. IEEE (2012)

    Google Scholar 

  12. Ji, Y.G., Park, J.H., Lee, C., Yun, M.H.: A usability checklist for the usability evaluation of mobile phone user interface. Int. J. Hum.-Comput. Interact. 20(3), 207–231 (2006)

    Article  Google Scholar 

  13. Harrison, R., Flood, D., Duce, D.: Usability of mobile applications: literature review and rationale for a new usability model. J. Interact. Sci. 1(1), 1 (2013)

    Article  Google Scholar 

  14. Dirin, A., Laine, T.H.: User experience in mobile augmented reality: emotions, challenges. Opport. Best Pract. Comput. 7(2), 33 (2018)

    Google Scholar 

  15. Marwan, M.E., Madar, A.R., Fuad, N.: Development of Mobile EEF learning system (MEEFLS) for mobile learning implementation in Kolej Poly-Tech MARA (KPTM). Development 1, 6183 (2014)

    Google Scholar 

  16. Wang, M., Ng, J.W.P.: Intelligent mobile cloud education: smart anytime-anywhere learning for the next generation campus environment. In: 8th International Conference on Intelligent Environments (IE), pp. 149–156 (2012)

    Google Scholar 

  17. Malik, M.U., Nasir, H., Javed, A.: An efficient objective quality model for agile application development. Int. J. Comput. Appl. 85(8) (2014)

    Google Scholar 

  18. Wu, W.H., Jim Wu, Y.C., Chen, C.Y., Kao, H.Y., Lin, C.H., Huang, S.H.: Review of trends from mobile learning studies: a meta-analysis. Comput. Educat. 59, 2, 817–827 (2012)

    Article  Google Scholar 

  19. Mahenge, M.P., Mwangoka, J.W.: Mobile-based system for cost-effective e-learning contents delivery in resource and bandwidth constrained learning environments. Knowl. Manag. E-Learn. 6(4), 449 (2014)

    Google Scholar 

  20. Furió, D., GonzáLez-Gancedo, S., Juan, M.C., Seguí, I., Rando, N.: Evaluation of learning outcomes using an educational iPhone game vs. traditional game. Comput. Educ. 64, 1–23 (2013)

    Article  Google Scholar 

  21. Wang, M., Vogel, D., Ran, W.: Creating a performance-oriented e-learning environment: a design science approach. Inf. Manag. 48(7), 260–269 (2011)

    Article  Google Scholar 

  22. Solano, A., Collazos, C.A., Rusu, C., Fardoun, H.M.: Combinations of methods for collaborative evaluation of the usability of interactive software systems. Advanc. Human-Comput. Interact. (2016)

    Google Scholar 

  23. AlRoobaea, R.S., Al-Badi, A.H., Mayhew, P.J.: A framework for generating a domain specific inspection evaluation method: A comparative study on social networking websites. In: Science and Information Conference (SAI), pp. 757–767. IEEE (2013)

    Google Scholar 

  24. Garcia-Cabot, A., de-Marcos, L., Garcia-Lopez, E.: An empirical study on m-learning adaptation: Learning performance and learning contexts. Comput. Educ. 82, 450–459 (2015)

    Article  Google Scholar 

  25. Kearney, M., Maher, D.: Mobile learning in maths teacher education: using iPads to support pre-service teachers professional development. Austr. Educat. Comput. 27(3), 76–84 (2013)

    Google Scholar 

  26. Hussain, A., Mkpojiogu, E.O., Mortada, S., Yue, W.S.: Mobile experience evaluation of an e-Reader app. J. Telecommun. Electr. Comput. Eng. (JTEC), 10(1–10), 11–15

    Google Scholar 

  27. Katy, H.M.: Measuring usability for application software using the quality in use integration measurement model (Doctoral dissertation, Universiti Tun Hussein Onn Malaysia)

    Google Scholar 

  28. Muñoz-Cristóbal, J.A., Rodríguez-Triana, M.J., Gallego-Lema, V., Arribas-Cubero, H.F., Asensio-Pérez, J.I., Martínez- Monés, A.: Monitoring for awareness and reflection in ubiquitous learning environments. Int. J. Hum.-Comput. Interact. 34(2), 146–165 (2018)

    Article  Google Scholar 

  29. Paz, F., Pow-Sang, J.A., Collazos, C.: Validation of a Usability Evaluation Protocol based on the Heuristic Inspection Method: An Experimental Case Study in the Web Domain (2016)

    Google Scholar 

  30. Hussein, I., Mahmud, M., Tap, M., Osman, A. (2012). User Experience Design (UXD): A survey of user interface development practices in Malaysia

    Google Scholar 

  31. Billi, M., Burzagli, L., Catarci, T., Santucci, G., Bertini, E., Gabbanini, F., Palchetti, E.: A unified methodology for the evaluation of accessibility and usability of mobile applications. Univ. Access Inf. Soc. 9(4), 337–356 (2010)

    Article  Google Scholar 

  32. Navarro, C.X., Molina, A.I., Redondo, M.A., Juárez-Ramírez, R.: Framework to evaluate M-learning systems: a technological and pedagogical approach. IEEE Revista Iberoamericana de Tecnologias del Aprendizaje 11(1), 33–40 (2016)

    Article  Google Scholar 

  33. Emang, D.W.A.B., Lukman, R.N.I.R., Kamarulzaman, M.I.S., Zaaba, Z.F.: Usability studies on e- learning platforms: Preliminary study in USM. In: AIP Conference Proceedings, vol. 1891, no. 1, p. 020040. AIP Publishing (2018)

    Google Scholar 

  34. Fiotakis, G., Raptis, D., Avouris, N.: Considering cost in usability evaluation of mobile applications: who, where and when. In: IFIP Conference on Human-Computer Interaction, pp. 231–234. Springer, Berlin, Heidelberg (2009, August)

    Chapter  Google Scholar 

  35. Fredrikson, R.: Emulating a Native Mobile Experience with Cross-platform Applications (2018)

    Google Scholar 

  36. Hussain, A., Mkpojiogu, E.O., Musa, J.A., Mortada, S.: A user experience evaluation of Amazon Kindle mobile application. In: AIP Conference Proceedings, vol. 1891, no. 1, pp. 020–060 (2017, October)

    Google Scholar 

  37. Nguyen, N., Muilu, T., Dirin, A., Alamäki, A.: An interactive and augmented learning concept for orientation week in higher education. Int. J. Educ. Technol. High. Educ. 15(1), 35 (2018)

    Article  Google Scholar 

  38. Palalas, A., Wark, N.: Design principles for an adult literacy mobile learning solution. In: Proceedings of the 16th World Conference on Mobile and Contextual Learning, p. 27. ACM (2017, October)

    Google Scholar 

  39. Vukovac, D.P., Kirinic, V., Klicek, B.: A comparison of usability evaluation methods for e-learning systems. DAAAM International Scientific Book, pp. 271–289 (2010)

    Google Scholar 

  40. Alrobai, A.A., AlRoobaea, R.S., Al-Badi, A.H., Mayhew, P.J.: Investigating the usability of e-catalogues systems: modified heuristics vs. user testing. J. Technol. Res. 4, 1 (2013)

    Google Scholar 

  41. Brown, M.E., Hocutt, D.L.: Learning to use, useful for learning: a usability study of Google apps for education. J. Usability Stud. 10(4), 160–181 (2015)

    Google Scholar 

  42. Lira, W., Ferreira, R., de Souza, C., Carvalho, S.: Experimenting on the cognitive walkthrough with users. In: Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices & Services, pp. 613–618. ACM (2014, September)

    Google Scholar 

  43. Ivanc, D., Vasiu, R., Onita, M.: Usability evaluation of a LMS mobile web interface. In: Information and Software Technologies, pp. 348–361. Springer (2012)

    Google Scholar 

  44. Shivade, B., Sharma, M.: Usability analyzer tool: a usability evaluation tool for android based mobile application. Int. J. Emerg. Trends Technol. Comput. Sci. (IJETTCS) 3(3), 247–252 (2014)

    Google Scholar 

  45. Yáñez Gómez, R., Cascado Caballero, D., Sevillano, J.L.: Heuristic evaluation on mobile interfaces: a new checklist. Sci. World J. (2014)

    Google Scholar 

  46. Leichtenstern, K., André, E., Rehm, M.: Tool-supported user-centred prototyping of mobile applications. In: Mobile and Handheld Computing Solutions for Organizations and End-Users, pp. 203–224. IGI Global (2013)

    Google Scholar 

  47. Semertzidis, K.: Mobile Application Development to Enhance Higher Education Lectures. University of York (2013)

    Google Scholar 

  48. Dirin, A., Nieminen, M.: State-of-the-art of m-learning usability and user experience. In: The Fourth International Conference on e-Learning (ICEL2013), pp. 130–139. The Society of Digital Information and Wireless Communication (2013)

    Google Scholar 

  49. Liaw, S.S., Huang, H.M.: Perceived satisfaction, perceived usefulness and interactive learning environments as predictors to self-regulation in e-learning environments. Comput. Educ. 60(1), 14–24 (2013)

    Article  Google Scholar 

  50. Freire, L.L., Arezes, P.M., Campos, J.C.: A literature review about usability evaluation methods for e-learning platforms. Work 41(Suppl. 1), 1038–1044 (2012)

    Google Scholar 

  51. Nagro, S., Campion, R.: A method for multimedia user interface design for mobile learning. In: Computing Conference, pp. 585–590. IEEE (2017)

    Google Scholar 

  52. Herskovic, V., Ochoa, S.F., Pino, J.A., Neyem, H.A.: The Iceberg effect: behind the user interface of mobile collaborative systems. J. UCS 17(2), 183–201 (2011)

    Google Scholar 

  53. Ma, X., Yan, B., Chen, G., Zhang, C., Huang, K., Drury, J.: A toolkit for usability testing of mobile applications. In: International Conference on Mobile Computing, Applications, and Services, pp. 226–245. Springer Berlin Heidelberg (2011, October)

    Google Scholar 

  54. Rahmat, H., Zulzalil, H., Ghani, A.A.A., Kamaruddin, A.: An approach towards development of evaluation framework for usability of smartphone applications. In: 2015 9th Malaysian Software Engineering Conference MySEC, pp. 178–182. IEEE

    Google Scholar 

  55. Ma, X., Yan, B., Chen, G., Zhang, C., Huang, K., Drury, J., Wang, L.: Design and implementation of a toolkit for usability testing of mobile apps. Mobile Networks and Applications 18(1), 81–97 (2013)

    Article  Google Scholar 

  56. Reis, R.A., Fontão, A.D.L., Gomes, L.L., Dias-Neto, A.C.: Usability evaluation approaches for (Ubiquitous) mobile applications: a systematic mapping study. In: Proceedings of International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies. UBICOMM (2015)

    Google Scholar 

  57. Mahenge, M.P., Mwangoka, J.W.: Knowledge management e-learning. Learning 6(4), 449–463 (2014)

    Google Scholar 

  58. Baran, E., Uygun, E., Altan, T.: Examining preservice teachers’ criteria for evaluating educational mobile apps. J. Educ. Comput. Res. 54(8), 1117–1141 (2017)

    Article  Google Scholar 

  59. Briz-Ponce, L., Pereira, A., Carvalho, L., Juanes-Méndez, J.A., García-Peñalvo, F.J.: Learning with mobile technologies–Students’ behavior. Comput. Hum. Behav. 72, 612–620 (2017)

    Article  Google Scholar 

  60. Fitzpatrick, J.: A Usability Evaluation Research of a Web based E-Learning Application (Doctoral dissertation, Dublin, National College of Ireland) (2015)

    Google Scholar 

  61. Gerald, R.E.: Freak the Mighty: A Quest Through Friendship (2017)

    Google Scholar 

  62. Marwan, M.E., Madar, A.R., Fuad, N.: Development of mobile EEF learning system (MEEFLS) for mobile learning implementation in Kolej Poly-Tech MARA (KPTM). Development 1(6183), 54 (2014)

    Google Scholar 

  63. Losada, B., Urretavizcaya, M., Gil, J.M.L., Fernández-Castro, I.: Applying usability engineering in InterMod agile development methodology: a case study in a mobile application. J. UCS, 19(8), 1046–1065 (2013)

    Google Scholar 

  64. Inostroza, R., Rusu, C., Roncagliolo, S., Rusu, V.: Usability heuristics for touchscreen-based mobile devices: update. In: Proceedings of the 2013 Chilean Conference on Human-Computer Interaction, pp. 24–29. ACM (2013, November)

    Google Scholar 

  65. Dirin, A., Nieminen, M.: mLUX: usability and user experience development framework for m- learning. Int. J. Interact. Mob. Technol. (iJIM) 9(3), 37–51 (2015)

    Article  Google Scholar 

  66. Heo, J., Ham, D.H., Park, S., Song, C., Yoon, W.C.: A framework for evaluating the usability of mobile phones based on multi-level, hierarchical model of usability factors. Interact. Comput. 21(4), 263–275 (2009)

    Article  Google Scholar 

  67. Yeh, S.W., Wu, T.Y.: Applying mobile annotation APPs in EFL reading: students’ perceptions and experiences. In: EdMedia: World Conference on Educational Media and Technology, pp. 1546–1550 (2015)

    Google Scholar 

  68. Hussain, A.B., Abbas, S.A.A., Abdulwaheed, M.S., Mohammed, R.G., Abdullah Abdulhussein, A.: Usability evaluation of mobile game applications. Systemat. Rev. Environ. 2, 5 (2015)

    Google Scholar 

  69. Bertschler, M., Gritz, P.N., Gvozden, A., Jandl, C., Pfersmann, W., Scheucher, T.S., Schmiedl, G.: Exam Preparation for Medical Students: Recommendations for the Development of an M-Learning Application

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, ISIM, Jaipur, India

    Dr. Priyanka Mathur & Dr. Swati V. Chande

Authors
  1. Dr. Priyanka Mathur
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dr. Swati V. Chande
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Priyanka Mathur .

Editor information

Editors and Affiliations

  1. Department of Information Technology, Swami Keshvanand Institute of Technology, Jaipur, Rajasthan, India

    Anil Chaudhary

  2. Department of Computer Science and Engineering, Swami Keshvanand Institute of Technology, Jaipur, Rajasthan, India

    Chothmal Choudhary

  3. Department of Computer Science and Engineering, Swami Keshvanand Institute of Technology, Jaipur, Rajasthan, India

    Mukesh Kumar Gupta

  4. Postdoctoral Research Fellow, University of Padua, Padua, Italy

    Chhagan Lal

  5. Department of Computer Science and Engineering, Swami Keshvanand Institute of Technology, Jaipur, Rajasthan, India

    Tapas Badal

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mathur, P., Chande, S.V. (2020). Empirical Investigation of Usability Evaluation Methods for Mobile Applications Using Evidence-Based Approach. In: Chaudhary, A., Choudhary, C., Gupta, M., Lal, C., Badal, T. (eds) Microservices in Big Data Analytics. Springer, Singapore. https://doi.org/10.1007/978-981-15-0128-9_9

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-0128-9_9

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-0127-2

  • Online ISBN: 978-981-15-0128-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation