Abstract
Travel websites are extensively used by travelers for their travel bookings, yet little is known about the hedonic effectiveness of such experiences for the customer. The end users of these websites are customers who may not always be sophisticated information system (IS) users. Further, traditional utility based measures of customer evaluation are dated with respect to the interactive nature of the technology in use and the hedonic benefits that may result from the use of the technology. The evaluation of IS needs to include hedonic measures facilitated by the interactive technology in addition to the traditional utility based measures. We propose and test an evaluation model for retail travel websites that combines the traditional utility based measures with hedonic measures which collectively create a more comprehensive measure for the IS evaluation of consumer focused websites. Thus rooted in theory, the model extends DeLone and McLean’s model of IS Success by adding the construct of User Experience. The model was tested on a sample of 255 customers of travel websites targeted at the Indian market. The results indicate that both utility based and hedonic measures are important factors for customer IS (travel website in this study) evaluation. The larger implications for theory and practice of IS evaluation are explained.
Similar content being viewed by others
References
Adam Mahmood, M. O., Burn, J. M., Gemoets, L. A., & Jacquez, C. (2000). Variables affecting information technology end-user satisfaction: A meta-analysis of the empirical literature. International Journal of Human-Computer Studies, 52(4), 751–771.
Agourram, H., & Ingham, J. (2007). The impact of national culture on the meaning of information system success at the user level. Journal of Enterprise Information Management, 20(6), 641–656.
Aiken, M., Gu, L., & Wang, J. (2013). Task knowledge and task-technology fit in a virtual team. International Journal of Management, 30(1), 3.
Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50, 179–211.
Aladwani, A. M., & Palvia, P. C. (2002). Developing and validating an instrument for measuring user-perceived web quality. Information Management, 39(6), 467–476.
Bagozzi, R. P., Yi, Y., & Phillips, L. W. (1991). Assessing construct validity in organizational research. Administrative Science Quarterly, 421–458.
Ballantine, P. W. (2005). Effects of interactivity and product information on consumer satisfaction in an online retail setting. International Journal of Retail & Distribution Management, 33(6), 461–471.
Barclay, D., Higgins, C., & Thompson, R. (1995). The partial least squares (PLS) approach to causal modeling: Personal computer adoption and use as an illustration. Technology Studies, 2(2), 285–309.
Barnes, S. J., & Vidgen, R. T. (2003). An integrative approach to the assessment of e-commerce quality. Journal of Electronic Commerce Research, 3(3), 114–127.
Beauregard, R., & Corriveau, P. (2007). User experience quality: A conceptual framework for goal setting and measurement. In Digital Human Modeling, Springer Berlin Heidelberg, 325–332.
Berezina, K., Cobanoglu, C., Miller, B. L., & Kwansa, F. A. (2012). The impact of information security breach on hotel guest perception of service quality, satisfaction, revisit intentions and word-of-mouth. International Journal of Contemporary Hospitality Management, 24(7), 991–1010.
Berry, L. L., Wall, E. A., & Carbone, L. P. (2006). Service clues and customer assessment of the service experience: Lessons from marketing. The Academy of Management Perspectives, 20(2), 43–57.
Bhattacherjee, A. (2001a). Understanding information systems continuance: An expectation-confirmation model. MIS Quarterly, 351–370.
Bhattacherjee, A. (2001b). An empirical analysis of the antecedents of electronic commerce service continuance. Decision Support Systems, 32(2), 201–214.
Bilgihan, A., Okumus, F., Nusair, K., & Bujisic, M. (2014). Online experiences: Flow theory, measuring online customer experience in e-commerce and managerial implications for the lodging industry. Information Technology & Tourism, 14(1), 49–71.
Bressolles, G. (2006). La Qualite de service electronique: NetQual. Proposition d’uneechelle de mesure appliqué a user experience sites marchands et effets moderateurs. Rescherche et Applications en Marketing, 21(3), 19–45.
Casaló, L. V., Flavián, C., & Guinalíu, M. (2008). The role of satisfaction and website usability in developing customer loyalty and positive word-of-mouth in the e-banking services. International Journal of Bank Marketing, 26(6), 399–417.
Celik, H. E., & Yilmaz, V. (2011). Extending the technology acceptance model for adoption of e-shopping by consumers in Turkey. Journal of Electronic Commerce Research, 12(2), 152–164.
Chang, H. H., & Chen, S. W. (2009). Consumer perception of interface quality, security, and loyalty in electronic commerce. Information Management, 46(7), 411–417.
Chen, C. W. D., & Cheng, C. Y. J. (2009). Understanding consumer intention in online shopping: A respecification and validation of the DeLone and McLean model. Behaviour & Information Technology, 28(4), 335–345.
Cheng, S., & Cho, V. (2010). An integrated model of employees' behavioral intention toward innovative information and communication technologies in travel agencies. Journal of Hospitality & Tourism Research. doi:10.1177/1096348010384598.
Childers, T. L., Carr, C. L., Peck, J., & Carson, S. (2001). Hedonic and utilitarian motivations for online retail shopping behavior. Journal of Retailing, 77(4), 511–535.
Chin, W. W. (1998). The partial least squares approach to structural equation modeling. Modern Methods for Business Research, 295(2), 295–336.
Chiou, W. C., Lin, C. C., & Perng, C. (2011). A strategic website evaluation of online travel agencies. Tourism Management, 32(6), 1463–1473.
Cho, N., & Park, S. (2001). Development of electronic commerce user-consumer satisfaction index (ECUSI) for internet shopping. Industrial Management & Data Systems, 101(8), 400–406.
Chong, H., Cates, D., & Rauniar, R. (2010). Validity of DeLone and McLean's e-commerce model in B2C student loan industry. Journal of International Technology and Information Management, 19(1), 75–111.
Conway, J. M., & Lance, C. E. (2010). What reviewers should expect from authors regarding common method bias in organizational research. Journal of Business and Psychology, 25(3), 325–334.
Cormany, D., & Baloglu, S. (2011). Medical travel facilitator websites: An exploratory study of web page contents and services offered to the prospective medical tourist. Tourism Management, 32(4), 709–716.
Crowston, K., Howison, J., & Annabi, H. (2006). Information systems success in free and open source software development: Theory and measures. Software Process: Improvement and Practice, 11(2), 123–148.
Csikszentmihalyi, M., & LeFevre, J. (1989). Optimal experience in work and leisure. Journal of Personality and Social Psychology, 56(5), 815–822.
Davis, F. D. (1989). Perceived usefulness, perceived ease of use and user acceptance of information technology. MIS Quarterly, 13(3), 319–340.
DeLone, W. H., & McLean, E. R. (1992). Information systems success: The quest for the dependent variable. Information Systems Research, 3(1), 60–95.
DeLone, W. H., & McLean, E. R. (2003). The DeLone and McLean model of information systems success: A ten-year update. Journal of Information Systems Management, 19(4), 9–26.
DeLone, W. H., & McLean, E. R. (2004). Measuring e-commerce success: Applying the DeLone & McLean information systems success model. International Journal of Electronic Commerce, 9(1), 31–47.
Deng, L., Turner, D. E., Gehling, R., & Prince, B. (2010). User experience, satisfaction, and continual usage intention of IT. European Journal of Information Systems, 19(1), 60–75.
Dichter, A. & Seitzman, N. (2015) Facebook and the future of travel. McKinsey & Company. Resource document. McKinsey&Company. http://www.mckinsey.com/insights/travel_transportation/facebook_and_the_future_of_travel. Accessed 1 December, 2015.
Ding, X. D., Huang, Y., & Verma, R. (2011). Customer experience in online financial services: A study of behavioral intentions for techno-ready market segments. Journal of Service Management, 22(3), 344–366.
Dorobat, I. (2014). Models for measuring e-learning success in universities: A literature review. Informatica Economica, 18(3), 77–90.
Efron, B., & Tibshirani, R. J. (1994). An Introduction to the Bootstrap (57). CRC press.
Eom, S., Ashill, N. J., Arbaugh, J. B., & Stapleton, J. L. (2012). The role of information technology in e-learning systems success. Human Systems Management, 31(3), 147–163.
Faiola, A., & Matei, S. A. (2005). Cultural cognitive style and web design: Beyond a behavioral inquiry into computer-mediated communication. Journal of Computer-Mediated Communication, 11, 375–394. doi:10.1111/j.1083-6101.2006.tb00318.x.
Fishbein, M., & Ajzen, I. (1977). Belief, Attitude, Intention and Behavior: An Introduction to Theory and Research. Reading: Addison-Wesley.
Flavia’n, C., Guinalı’u, M., & Gurrea, R. (2006). The role played by perceived usability, satisfaction and consumer trust on website loyalty. Information & Management. The International Journal of Information Systems Applications, 43(1), 1–14.
Forlizzi, J., & Battarbee, K. (2004). Understanding experience in interactive systems. In Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, And Techniques, pp. 261–268. ACM.
Forlizzi, J., & Ford, S. (2000). The building blocks of experience: An early framework for interaction designers. In Proceedings of the 3rd Conference On Designing Interactive Systems: Processes, Practices, Methods, and Techniques, pp. 419–423. ACM.
Fornell, C., & Bookstein, F. L. (1982). Two structural equation models: LISREL and PLS applied to consumer exit-voice theory. Journal of Marketing Research, 440–452.
Fornell, C., & Larcker, D. F. (1981). Structural equation models with unobservable variables and measurement error: Algebra and statistics. Journal of Marketing Research, 382–388.
Geffen, D., & Straub, D. W. (2005). A practical guide to factorial validity using PLS-graph: Tutorial and annotated example. Communications of the Association for Information Systems, 16(1), 5.
Grover, V., & Lyytinen, K. (2015). New state of play in information systems research: The push to the edges. MIS Quarterly, 39(2), 271–296.
Hair, J. F., Black, W. C., Babin, J. B., Anderson, R. E., & Tatham, R. L. (2011). Multivariate Data Analysis (6th ed.) New Delhi, Pearson.
Halawi, L. A., McCarthy, R. V., & Aronson, J. E. (2007). An empirical investigation of knowledge management systems' success. Journal of Computer Information Systems, 48(2), 121–135.
Hasan, L., Morris, A., & Probets, S. (2012). A comparison of usability evaluation methods for evaluating E-commerce websites. Behaviour & Information Technology, 31(7), 707–737.
Hassenzahl, M. (2004). The interplay of beauty, goodness, and usability in interactive products. Human-Computer Interaction, 19(4), 319–349.
Hassenzahl M (2008) User experience (UX). Proceedings of the 20th International Conference of the Association Francophone d'Interaction Homme-Machine on - IHM '08. doi:10.1145/1512714.1512717
Hassenzahl, M., & Tractinsky, N. (2006). User experience- a research agenda. Behaviour & Information Technology, 25(2), 91–97.
Hassenzahl M, Platz A, Burmester M, Lehner K (2000) Hedonic and ergonomic quality aspects determine a software's appeal. Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '00. doi:10.1145/332040.332432
Hodza, P. (2009). Evaluating user experience of experiential GIS. Transactions in GIS, 13(5–6), 503–525.
Hsu, H. Y., & Tsou, H. T. (2011). Understanding customer experiences in online blog environments. International Journal of Information Management, 31(6), 510–523.
Huang, E. (2012). Online experiences and virtual goods purchase intention. Internet Research, 22(3), 252–274.
Huang, C. Y., Chou, C. J., & Lin, P. C. (2010). Involvement theory in constructing bloggers’ intention to purchase travel products. Tourism Management, 31(4), 513–526.
Hulland, J. (1999). Use of partial least squares (PLS) in strategic management research: A review of four recent studies. Strategic Management Journal, 20(2), 195–204.
IAMAI & IMRB (2013). Digital Commerce, Mumbai, India: Ray, S. http://www.iamai.in/pdf/AnnualReport201314LowRes.pdf . Accessed 10 November, 2015.
IAMAI & IMRB (2014). Internet in India 2014. Mumbai, India
Igbaria, M., Schiffman, S. J., & Wieckowski, T. J. (1994). The respective roles of perceived usefulness and perceived fun in the acceptance of microcomputer technology. Behaviour and Information Technology, 13(6), 349–361.
Iivari, J. (2005). An empirical test of the DeLone-McLean model of information system success. Database for Advances in Information Systems, 36(2), 8–27 http://search.proquest.com/docview/196629704?accountid=86687 , Accessed 2 October, 2015.
Jeong, C., Holland, S., Jun, S. H., & Gibson, H. (2012). Enhancing destination image through travel website information. International Journal of Tourism Research, 14(1), 16–27.
Jiang, Z., Chan, J., Tan, B. C., & Chua, W. S. (2010). Effects of interactivity on website involvement and purchase intention. Journal of the Association for Information Systems, 11(1), 1.
Kang, M., & Schuett, M. A. (2013). Determinants of sharing travel experiences in social media. Journal of Travel and Tourism Marketing, 30(1/2), 93–107.
Kao, Y.-F., Huang, L.-S., & Yang, M.-H. (2007). Effects of experiential elements on experiential satisfaction and loyalty intentions: A case study of the super basketball league in Taiwan. International Journal of Revenue Management, 1(1), 79–96.
Karapanos E, Zimmerman J, Forlizzi J, Martens J-B (2009) User experience over time. Proceedings of the 27th international conference on Human factors in computing systems - CHI 09. doi:10.1145/1518701.1518814
Khalifa, M., & Liu, V. (2004). The state of research on information system satisfaction. Journal of Information Technology Theory and Application (JITTA), 5(4), 37–49.
Khan, T. (2015). Chaning the Travel Plan. Business Today. http://www.businesstoday.in/magazine/trends/online-travel-agencies-strategy-change-domestic-air-travel/story/215499.html. Accessed 2 November, 2015.
Kim, Y. (2002). Consumer value: An application to mall and internet shopping. International Journal of Retail and Distribution Management, 30(12), 595–602.
Kim, S. (2011). Web-interactivity dimensions and shopping experiential value. Journal of Internet Business, 9, 1.
Kim, Dan and Steinfield, Charles, “Consumers Mobile Internet Service Satisfaction and their Continuance Intentions” (2004). AMCIS 2004 Proceedings. 332. http://aisel.aisnet.org/amcis2004/332.
Kim, K. J., & Bonk, C. J. (2002). Cross-cultural comparisons of online collaboration. Journal of Computer-Mediated Communication, 8. doi:10.1111/j.1083-6101.2002.tb00163.x.
Kim, S., & Eastin, M. S. (2011). Hedonic tendencies and the online consumer: An investigation of the online shopping process. Journal of Internet Commerce, 10(1), 68–90.
Kim, J. H., Kim, M., & Lennon, S. J. (2007). Information components of apparel retail web sites: Task relevance approach. Journal of Fashion Marketing and Management, 11(4), 494–510.
Kleist, V. F. (2003). An approach to evaluating e-business information systems projects. Information Systems Frontiers, 5(3), 249–263.
Knijnenburg, B. P., Willemsen, M. C., Gantner, Z., Soncu, H., & Newell, C. (2012). Explaining the user experience of recommender systems. User Modeling and User-Adapted Interaction, 22(4–5), 441–504.
Kohler, T., Fueller, J., Matzler, K., & Stieger, D. (2011). Co-creation in virtual worlds: The design of the user experience. MIS Quarterly, 35(3), 773–788.
Koo, C., Wati, Y., & Chung, N. (2013). A study of mobile and internet banking service: Applying for IS success model. Asia Pacific Journal of Information Systems, 23(1), 65–86.
Landrum, H. T., Prybutok, V. R., Strutton, D., & Zhang, X. (2008). Examining the merits of usefulness versus use in an information service quality and information system success web-based model. Information Resources Management Journal (IRMJ), 21(2), 1–17.
Law, R., Qi, S., & Buhalis, D. (2010). Progress in tourism management: A review of website evaluation in tourism research. Tourism Management, 31(3), 297–313.
Law, R., Buhalis, D., & Cobanoglu, C. (2014). Progress on information and communication technologies in hospitality and tourism. International Journal of Contemporary Hospitality Management, 26(5), 727. http://search.proquest.com/docview/1660173334?accountid=86687 . Accessed 2 October, 2015.
Lee, C. H., & Cranage, D. A. (2011). Personalisation–privacy paradox: The effects of personalisation and privacy assurance on customer responses to travel web sites. Tourism Management, 32(5), 987–994.
Lee, S., & Koubek, R. J. (2010). The effects of usability and web design attributes on user preference for e-commerce web sites. Computers in Industry, 61(4), 329–341.
Lim, H., & Shiode, N. (2011). The impact of online shopping demand on physical distribution networks: A simulation approach. International Journal of Physical Distribution & Logistics Management, 41(8), 732–749.
Lowry, P. B., Gaskin, J. E., Twyman, N. W., Hammer, B., & Roberts, T. L. (2013). Taking “fun and games” seriously: Proposing the hedonic-motivation system adoption model (HMSAM). Journal of the Association for Information Systems, 141(1), 617–671.
McGill, T., Hobbs, V., & Klobas, J. (2003). User developed applications and information systems success: A test of DeLone and McLean's model. Information Resources Management Journal (IRMJ), 16(1), 24–45.
Merrilees, B., & Fry, M. L. (2002). Corporate branding: A framework for e-retailers. Corporate Reputation Review, 5(2–3), 2–3.
Molla, A., & Licker, P. S. (2001). E-commerce systems success: An attempt to extend and respecify the DeLone and McLean model of IS success. Journal of Electronic Commerce Research, 2(4), 1–11.
Mun, H. J., Yun, H., Kim, E. A., Hong, J. Y., & Lee, C. C. (2010). Research on factors influencing intention to use DMB using extended IS success model. Information Technology and Management, 11(3), 143–155.
Nunnally, J. C., & Bernstein, I. H. (1994). Psychological theory. New York: McGraw-Hill.
Nusair, K., & Parsa, H. G. (2011). Introducing flow theory to explain the interactive online shopping experience in a travel context. International Journal of Hospitality & Tourism Administration, 12(1), 1–20.
Octane Research (2015). e-Travel marketing India: path to purchase. http://octaneresearch.in/wp-content/uploads/2015/01/e-Travel-Marketing-India.pdf . Accessed 7 October, 2015.
Palmer, J. W. (2002). Web site usability, design, and performance metrics. Information Systems Research., 13(2), 151–167.
Parasuraman, A., Zeithaml, V. A., & Malhotra, A. (2005). E-S-QUAL: A multiple-item scale for assessing electronic service quality. Journal of Service Research, 7(3), 213–235.
Park, C. H., & Kim, Y. G. (2006). The effect of information satisfaction and relational benefit on consumers' online shopping site commitments. Journal of Electronic Commerce in Organizations (JECO), 4(1), 70–90.
Pavlou, P. A., Liang, H., & Xue, Y. (2007). Understanding and mitigating uncertainty in online exchange relationships: A principal-agent perspective. MIS Quarterly, 31(1), 105–136.
Petter, S., DeLone, W., & McLean, E. R. (2012). The past, present, and future of information systems success. Journal of the Association for Information Systems., 13(5), 2.
Petter, S., DeLone, W., & McLean, E. R. (2013). Information systems success: The quest for the independent variables. Journal of Management Information Systems, 29(4), 7–62.
Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879.
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012). Sources of method bias in social science research and recommendations on how to control it. Annual Review of Psychology, 63, 539–569.
Proctor, R. W., & Vu, K.-P. L. (2010). Cumulative knowledge and progress in human factors. Annual Review of Psychology, 61, 623–651.
Rana, N. P., Williams, M. D., & Dwivedi, Y. K. (2012). Evaluating suitability of alternative theoretical paradigm for examining citizen adoption of e-government. In tGov Workshop 2012 May, 8–9.
Ringle, C., Wende, S., & Will, A. (2005). SmartPLS (Version 2.0 M3). Germany: University of Hamburg.
Rose, S., Hair, N., & Clark, M. (2011). Online customer experience: A review of the business-to-consumer online purchase context. International Journal of Management Reviews, 13(1), 24–39.
Rose, S., Clark, M., Samouel, P., & Hair, N. (2012). Online customer experience in e-retailing: An empirical model of antecedents and outcomes. Journal of Retailing, 88(2), 308–322.
Rowley, J. (2006). An analysis of the e-service literature: Towards a research agenda. Internet Research, 16(3), 339–359.
Sabherwal, R., Jeyaraj, A., & Chowa, C. (2006). Information system success: Individual and organizational determinants. Management Science, 52(12), 1849–1864.
Schaupp, L. C., Belanger, F., & Fan, W. (2009). Examining the success of websites beyond e-commerce: An extension of the information systems success model. Journal of Computer Information Systems, 49(4), 42–52.
Seddon, P. B., & Kiew, M. Y. (1996). A partial test and development of DeLone and McLean's model of IS success. Australasian Journal of Information Systems, 4(1).
Semeijn, J., Van Riel, A. C., Van Birgelen, M. J., & Streukens, S. (2005). E-services and offline fulfilment: How e-loyalty is created? Managing Service Quality, 15(2), 182–194.
Song, J., & Zahedi, F. M. (2005). A theoretical approach to web design in e-commerce: A belief reinforcement model. Management Science, 51(8), 1219–1235.
Sykes, T. A., Venkatesh, V., & Gosain, S. (2009). Model of acceptance with peer support: A social network perspective to understand employees' system use. MIS Quarterly, 371–393.
Tarafdar, M., & Zhang, J. (2005). Analysis of critical website characteristics: A cross-category study of successful websites. Journal of Computer Information Systems, 46(2), 14.
Taylor, S., & Todd, P. A. (1995). Understanding information technology usage: A test of competing models. IS Research, 6(2), 144–176.
Teece, D. J. (2007). Explicating dynamic capabilities: The nature and microfoundations of (sustainable) enterprise performance. Strategic Management Journal, 28(13), 1319–1350.
Thong, J. Y., Hong, S. J., & Tam, K. Y. (2006). The effects of post-adoption beliefs on the expectation-confirmation model for information technology continuance. International Journal of Human-Computer Studies, 64(9), 799–810.
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 425–478.
Wang, Y. S. (2008). Assessing e-commerce systems success: A respecification and validation of the DeLone and McLean model of information systems success. Information Systems Journal, 18(5), 529–557.
Wang, Y. S., & Liao, Y. W. (2008). Assessing eGovernment systems success: A validation of the DeLone and McLean model of information systems success. Government Information Quarterly, 25(4), 717–733.
Wang, Y. S., & Tang, T. I. (2003). Assessing customer perceptions of web sites service quality in digital marketing environments. Journal of End User Computing, 15(3), 14–31.
Wong, K. K. (2013). Partial least squares structural equation modeling (PLS-SEM) techniques using SmartPLS. Marketing Bulletin, 24, 1–32.
Wu, G. (2006). Conceptualizing and measuring the perceived interactivity of websites. Journal of Current Issues & Research in Advertising, 28(1), 87–104.
Wu, J. H., & Wang, Y. M. (2006). Measuring KMS success: A respecification of the DeLone and McLean's model. Information Management, 43(6), 728–739.
Yaghmaie, F. (2003). Content validity and its estimation. Journal of Medical Education, 3(1), 25–27.
Yilmazsoy, B., Saad, M., & Cicmil, S. (2009). Users' perceptions of the free, virtual-only service experience. The Service Industries Journal, 29(7), 1007–1019.
Yoo, B., & Donthu, N. (2001). Developing a scale to measure perceived quality of an internet shopping site (SITEQUAL). Quarterly Journal of Electronic Commerce, 2(1), 31–46.
Zhang, P., Von Dran, G. M., Blake, P., & Pipithsuksunt, V. (2001). Important design features in different web site domains: An empirical study of user perceptions. E-Service, 1(1), 77–91.
Zviran, M., & Erlich, Z. (2003). Measuring IS user satisfaction: Review and implications. Communications of the Association for Information Systems, 12(1), 5.
Author information
Authors and Affiliations
Corresponding authors
Appendix
Appendix
Rights and permissions
About this article
Cite this article
Wani, M., Raghavan, V., Abraham, D. et al. Beyond utilitarian factors: User experience and travel company website successes. Inf Syst Front 19, 769–785 (2017). https://doi.org/10.1007/s10796-017-9747-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10796-017-9747-1