Interplay Between Usability and Information System Continuance: An Extended Model

  • Aleksandra SobodićEmail author
  • Igor Balaban
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 972)


This paper proposes a model to investigate the relationship between Expectation-Confirmation Model (ECM) widely used in Information System (IS) research and main usability factors. The target domain is CRISS platform that represents a unique cloud-based digital learning platform, based on the most advanced pedagogical methodologies and technological solutions, that allows guided acquisition, evaluation and certification of digital competences in primary and secondary schools. Based on the research model, a survey instrument to measure the user’s continuance intention of using the CRISS platform is also developed. Such model and the instrument can help researchers to explain the expected sustainability of an IS, and to enrich the understanding of its post-adoption use. Also, the study results contribute to the current knowledge of ECM and usability field in terms of other factors other than the original affecting the users’ intention to use a digital platform for assessment and digital competence acquisition.


Usability Expectation-Confirmation Model Continuance intention Digital competence 



This study was carried out as a part of “Demonstration of a scalable and cost-effective cloud-based digital learning infrastructure through the Certification of digital competences in primary and secondary schools” (CRISS) project funded by European Union’s Horizon 2020 research and innovation program under Grant Agreement No 732489.


  1. 1.
    European Council: Recommendation of the European Parliament and the Council on key competencies for lifelong learning (2006).
  2. 2.
    Bhattacherjee, A.: Understanding information systems continuance: an expectation confirmation model. MIS Q. 25, 351–370 (2001)CrossRefGoogle Scholar
  3. 3.
    Oliver, R.L.: A cognitive model of the antecedents and consequences of satisfaction decisions. J. Mark. Res. 17, 460 (1980)CrossRefGoogle Scholar
  4. 4.
    Harpur, P.-A., De Villiers, M.R.: MUUX-E, a framework of criteria for evaluating the usability, user experience and educational features of m-learning environments. S. Afr. Comput. J. 56, 1–21 (2015)Google Scholar
  5. 5.
    Daramola, O., Oladipupo, O., Afolabi, I., Olopade, A.: Heuristic evaluation of an institutional E-learning system: a Nigerian case. Int. J. Emerg. Technol. Learn. 12, 26–42 (2017)CrossRefGoogle Scholar
  6. 6.
    Ardito, C., Costabile, M.F., De Marsico, M., Lanzilotti, R., Levialdi, S., Roselli, T., Rossano, V.: An approach to usability evaluation of e-learning applications. Univ. Access Inf. Soc. 4, 270–283 (2006)CrossRefGoogle Scholar
  7. 7.
    Esmeria, G.J., Seva, R.R.: Web usability : a literature review. Presented at the DLSU Research Congress 2017. De La Salle University, Manila (2017)Google Scholar
  8. 8.
    Weinerth, K., Koenig, V., Brunner, M., Martin, R.: Concept maps: a useful and usable tool for computer-based knowledge assessment? a literature review with a focus on usability. Comput. Educ. 78, 201–209 (2014)CrossRefGoogle Scholar
  9. 9.
    Bhattacherjee, A., Premkumar, G.: Understanding changes in belief and attitude toward information technology usage: a theoretical model and longitudinal test understanding changes in belief and attitude toward information tech nology usage: a theoretical model and longitudinal test1. MIS Q. 28, 229–254 (2004)CrossRefGoogle Scholar
  10. 10.
    Wu, I.L., Huang, C.Y.: Analysing complaint intentions in online shopping: the antecedents of justice and technology use and the mediator of customer satisfaction. Behav. Inf. Technol. 34, 69–80 (2015)CrossRefGoogle Scholar
  11. 11.
    Pee, L.G., Jiang, J., Klein, G.: Signaling effect of website usability on repurchase intention. Int. J. Inf. Manag. 39, 228–241 (2018)CrossRefGoogle Scholar
  12. 12.
    Hew, J.J., Lee, V.H., Ooi, K.B., Lin, B.: Mobile social commerce: the booster for brand loyalty? Comput. Hum. Behav. 59, 142–154 (2016)CrossRefGoogle Scholar
  13. 13.
    Shang, D., Wu, W.: Understanding mobile shopping consumers’ continuance intention. Ind. Manag. Data Syst. 117, 213–227 (2017)CrossRefGoogle Scholar
  14. 14.
    Song, B., Wang, W.: Instant messaging continuance: a media choice theory perspective. Front. Bus. Res. China 5, 537–558 (2011)CrossRefGoogle Scholar
  15. 15.
    Oghuma, A.P., Libaque-Saenz, C.F., Wong, S.F., Chang, Y.: An expectation-confirmation model of continuance intention to use mobile instant messaging. Telemat. Inform. 33, 34–47 (2016)CrossRefGoogle Scholar
  16. 16.
    Lin, W.S.: Perceived fit and satisfaction on web learning performance: IS continuance intention and task-technology fit perspectives. Int. J. Hum Comput Stud. 70, 498–507 (2012)CrossRefGoogle Scholar
  17. 17.
    Alraimi, K.M., Zo, H., Ciganek, A.P.: Understanding the MOOCs continuance: the role of openness and reputation. Comput. Educ. 80, 28–38 (2015)CrossRefGoogle Scholar
  18. 18.
    Daghan, G., Akkoyunlu, B.: Modeling the continuance usage intention of online learning environments. Comput. Hum. Behav. 60, 198–211 (2016)CrossRefGoogle Scholar
  19. 19.
    Junjie, Z.: Exploring the factors affecting learners’ continuance intention of MOOCS for online collaborative learning: an extended ECM perspective. Australas. J. Educ. Technol. 33, 123–135 (2017)Google Scholar
  20. 20.
    Pang, L., Jen, C.C.: Inclusive dyslexia-friendly collaborative online learning environment: Malaysia case study. Educ. Inf. Technol. 23, 1023–1042 (2018)CrossRefGoogle Scholar
  21. 21.
    Joo, Y.J., Kim, N., Kim, N.H.: Factors predicting online university students’ use of a mobile learning management system (m-LMS). Educ. Technol. Res. Dev. 64, 611–630 (2016)CrossRefGoogle Scholar
  22. 22.
    Stone, R.W., Baker-Eveleth, L.: Students’ expectation, confirmation, and continuance intention to use electronic textbooks. Comput. Hum. Behav. 29, 984–990 (2013)CrossRefGoogle Scholar
  23. 23.
    Hopkins, N., Tate, M., Sylvester, A., Johnstone, D.: Motivations for 21st century school children to bring their own device to school. Inf. Syst. Front. 19, 1191–1203 (2017)CrossRefGoogle Scholar
  24. 24.
    Joo, Y.J., Park, S., Shin, E.K.: Students’ expectation, satisfaction, and continuance intention to use digital textbooks. Comput. Hum. Behav. 69, 83–90 (2017)CrossRefGoogle Scholar
  25. 25.
    Ifinedo, P.: Roles of perceived fit and perceived individual learning support in students’ weblogs continuance usage intention. Int. J. Educ. Technol. High. Educ. 15, 7 (2018)CrossRefGoogle Scholar
  26. 26.
    Wang, R.-B., Du, C.-T.: Mobile social network sites as innovative pedagogical tools: factors and mechanism affecting students’ continuance intention on use. J. Comput. Educ. 1, 353–370 (2014)CrossRefGoogle Scholar
  27. 27.
    Mouakket, S., Bettayeb, A.M.: Investigating the factors influencing continuance usage intention of learning management systems by university instructors. Int. J. Web Inf. Syst. 11, 491–509 (2015)CrossRefGoogle Scholar
  28. 28.
    Kourouthanassis, P., Lekakos, G., Gerakis, V.: Should i stay or should i go? the moderating effect of self-image congruity and trust on social networking continued use. Behav. Inf. Technol. 34, 190–203 (2015)CrossRefGoogle Scholar
  29. 29.
    Shackel, B., Richardson, S.: Human Factors for Informatics Usability. Cambridge University Press, Cambridge (1991)zbMATHGoogle Scholar
  30. 30.
    ISO 9241-11: Ergonomics of human-system interaction - Part 11: Usability: Definitions and concepts. (2018)Google Scholar
  31. 31.
    Shackel, B.: Usability - context, framework, definition, design and evaluation. Interact. Comput. 21, 339–346 (2009)CrossRefGoogle Scholar
  32. 32.
    ISO/IEC 25010: Systems and software engineering - Systems and software Quality Requirementes and Evaluation (SQuaRE) – System and software quality models. (2011)Google Scholar
  33. 33.
    Albert, W., Tullis, T.: Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics. Morgan Kaufmann, Burlington (2013)Google Scholar
  34. 34.
    Bevan, N., Carter, J., Harker, S.: ISO 9241-11 revised: what have we learnt about usability since 1998? vol. 9169, pp. 143–151 (2015). Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)Google Scholar
  35. 35.
    Guárdia, L., Maina, M., Juliá, A.: Digital competence assessment system: supporting teachers with the CRISS platform. In: Central European Conference on Information and Intelligent Systems, Varazdin (2017)Google Scholar
  36. 36.
    Islam, A.K.M.N., Mäntymäki, M., Bhattacherjee, A.: Towards a decomposed expectation confirmation model of it continuance: the role of usability. Commun. Assoc. Inf. Syst. 40, 502–523 (2017)Google Scholar
  37. 37.
    Baker-Eveleth, L., Stone, R.W.: Usability, expectation, confirmation, and continuance intentions to use electronic textbooks. Behav. Inf. Technol. 34, 992–1004 (2015)CrossRefGoogle Scholar
  38. 38.
    Nascimento, B., Oliveira, T., Tam, C.: Wearable technology: what explains continuance intention in smartwatches? J. Retail. Consum. Serv. 43, 157–169 (2018)CrossRefGoogle Scholar
  39. 39.
    Bevan, N., Carter, J., Earthy, J., Geis, T., Harker, S.: New ISO standards for usability, usability reports and usability measures. In: Kurosu, M. (ed.) Lecture Notes in Computer Science. pp. 268–278. Springer (2016)Google Scholar
  40. 40.
    Eveleth, D.M., Baker-Eveleth, L.J., Stone, R.W.: Potential applicants’ expectation-confirmation and intentions. Comput. Hum. Behav. 44, 183–190 (2015)CrossRefGoogle Scholar
  41. 41.
    Hertzum, M.: Images of usability. Int. J. Hum. Comput. Interact. 26, 567–600 (2010)CrossRefGoogle Scholar
  42. 42.
    Limayem, M., Cheung, C.M.K.: Understanding information systems continuance: the case of internet-based learning technologies. Inf. Manag. 45, 227–232 (2008)CrossRefGoogle Scholar
  43. 43.
    Moore, G.C., Benbasat, I.: Development of an instrument to measure the perceptions of adopting an information technology innovation. Inf. Syst. Res. 2, 192–222 (1991)CrossRefGoogle Scholar
  44. 44.
    Lewis, B.R., Snyder, C.A., Rainer, R.K.: An empirical assessment of the information resource management construct. J. Manag. Inf. Syst. 12, 199–223 (1995)CrossRefGoogle Scholar
  45. 45.
    Lewis, J.R.: IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int. J. Hum. Comput. Interact. 7, 57–78 (1995)CrossRefGoogle Scholar
  46. 46.
    Lund, B.A.M.: Measuring usability with the USE questionnaire. Usability Interface 8, 3–6 (2001)Google Scholar
  47. 47.
    Finstad, K.: Interacting with computers the usability metric for user experience. Interact. Comput. 22, 323–327 (2010)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Faculty of Organization and InformaticsUniversity of ZagrebVaraždinCroatia

Personalised recommendations