Abstract
The volume of customers’ feedback that is available online is rising every year. Traditional approaches to service quality evaluation use questionnaires and leave existing online feedback from consumers aside. The possible reason is that harnessing the consumers’ feedback is a difficult task that requires employing text mining methods. Therefore, we decided to shed light on service quality research that uses consumers’ feedback as a source of information and text mining methods as a part of the quality evaluation.
We conducted a systematic literature review of journal articles that focuses on service quality evaluation with the use of text mining methods.
We found that text mining is a promising method for service quality research. On the other hand, we identified four challenges that arose from the reviewed article inconsistencies regarding quality measure, quality dimensions, the level of analysis, and sentiment analysis methods.
Future research is needed to validate quality evaluation measures and separate them from customer satisfaction measures, to argue when is suitable to use quality dimensions from literature and when identify service-specific quality dimensions, and to focus more on aspect level of quality analysis. There were also no attempts among studies to use the current state of art classification technologies, such as deep learning, or experiment with word embedding.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Abdi, A., Shamsuddin, S.M., Hasan, S., Piran, J.: Deep learning-based sentiment classification of evaluative text based on multi-feature fusion. Inf. Process. Manage. 56(4), 1245–1259 (2019). https://doi.org/10.1016/j.ipm.2019.02.018
Alanezi, M.A., Kamil, A., Basri, S.: A proposed instrument dimensions for measuring e-government service quality. Int. J. U- E-Serv. Sci. Technol. 3(4), 1–17 (2010)
Ali, F., et al.: Transportation sentiment analysis using word embedding and ontology-based topic modeling. Knowl.-Based Syst. 174, 27–42 (2019). https://doi.org/10.1016/j.knosys.2019.02.033
Ashton, T., Evangelopoulos, N., Prybutok, V.R.: Exponentially weighted moving average control charts for monitoring customer service quality comments. Int. J. Serv. Stand. 8(3), 230 (2013). https://doi.org/10.1504/IJSS.2013.057237
Ashton, T., Evangelopoulos, N., Prybutok, V.R.: Quantitative quality control from qualitative data: control charts with latent semantic analysis. Qual. Quant. 49(3), 1081–1099 (2014). https://doi.org/10.1007/s11135-014-0036-5
Bogicevic, V., Yang, W., Bujisic, M., Bilgihan, A.: Visual data mining: analysis of airline service quality attributes. J. Qual. Assur. Hospitality Tourism 18(4), 509–530 (2017). https://doi.org/10.1080/1528008X.2017.1314799
Chakrabarti, S., Trehan, D., Makhija, M.: Assessment of service quality using text mining - evidence from private sector banks in India. Int. J. Bank Market. 36(4), 594–615 (2018). https://doi.org/10.1108/IJBM-04-2017-0070
Choudhury, K.: Service quality and word of mouth: a study of the banking sector. Int. J. Bank Market. 32(7), 612–627 (2014). https://doi.org/10.1108/IJBM-12-2012-0122
Chowdhury, J., Reardon, J., Srivastava, R.: Alternative modes of measuring store image: an empirical assessment of structured versus unstructured measures. J. Market. Theory Pract. 6(2), 72–86 (1998). https://doi.org/10.1080/10696679.1998.11501797
Duan, W., Cao, Q., Yu, Y., Levy, S.: mining online user-generated content: using sentiment analysis technique to study hotel service quality. In: 2013 46th Hawaii International Conference on System Sciences, pp. 3119–3128 (2013). https://doi.org/10.1109/HICSS.2013.400
Duan, W., Yu, Y., Cao, Q., Levy, S.: Exploring the impact of social media on hotel service performance. Cornell Hospitality Q. 57(3), 282–296 (2016). https://doi.org/10.1177/1938965515620483
El-Bayoumi, J.G.: Evaluating IT service quality using SERVQUAL. In: Proceedings of the ACM SIGUCCS 40th Annual Conference on Special Interest Group on University and College Computing Services - SIGUCCS 2012, p. 15. ACM Press, New York (2012). https://doi.org/10.1145/2382456.2382461
Gitto, S., Mancuso, P.: Improving airport services using sentiment analysis of the websites. Tourism Manage. Persp. 22, 132–136 (2017). https://doi.org/10.1016/j.tmp.2017.03.008
Gnewuch, U., Morana, S., Adam, M., Maedche, A.: Measuring service encounter satisfaction with customer service chatbots using sentiment analysis. In: Proceedings of the 14th International Conference on Wirtschaftsinformatik (WI2019), pp. 0–11 (2019)
Gotlieb, J.B., Grewal, D., Brown, S.W.: Consumer satisfaction and perceived quality: complementary or divergent constructs? J. Appl. Psychol. 79(6), 875–885 (1994)
Grönroos, C.: A service quality model and its marketing implications. Eur. J. Market. 18(4), 36–44 (1984). https://doi.org/10.1108/EUM0000000004784
Haghighi, N.N., Liu, X.C., Wei, R., Li, W., Shao, H.: Using Twitter data for transit performance assessment: a framework for evaluating transit riders’ opinions about quality of service. Public Transp. 10(2), 363–377 (2018). https://doi.org/10.1007/s12469-018-0184-4
Hailong, Z., Wenyan, G., Bo, J.: Machine learning and lexicon based methods for sentiment classification: a survey. In: Proceedings - 11th Web Information System and Application Conference, WISA 2014, pp. 262–265 (2014). https://doi.org/10.1109/WISA.2014.55
He, W., Tian, X., Hung, A., Akula, V., Zhang, W.: Measuring and comparing service quality metrics through social media analytics: a case study. IseB 16(3), 579–600 (2017). https://doi.org/10.1007/s10257-017-0360-0
Bogicevic, V., Yang, W., Bilgihan, A., Bujisic, M.: Airport service quality drivers of passenger satisfaction. Tourism Rev. 68(4), 3–18 (2013). https://doi.org/10.1108/TR-09-2013-0047
James, T.L., Villacis Calderon, E.D., Cook, D.F.: Exploring patient perceptions of healthcare service quality through analysis of unstructured feedback. Expert Syst. Appl. 71, 479–492 (2017). https://doi.org/10.1016/j.eswa.2016.11.004
Jiang, J.J., Klein, G., Carr, C.L.: Measuring information system service quality: SERVQUAL from the other side. MIS Q. 26(2), 145–166 (2002). https://doi.org/10.2307/4132324
Kettinger, W.J., Lee, C.C.: Perceived service quality and user satisfaction with the information services function. Decis. Sci. 25(5–6), 737–766 (1994). https://doi.org/10.1111/j.1540-5915.1994.tb01868.x
Kettinger, W.J., Lee, C.C.: Pragmatic perspectives on the measurement of information systems service quality. MIS Q. 21(2), 223–240 (1997). https://doi.org/10.2307/249421
Kim, D.: CTQ for service quality management using web-based VOC: with focus on hotel business. J. Theoret. Appl. Inf. Technol. 96(22), 7464–7472 (2018)
Kim, D., Yu, S.J.: Hotel review mining for targeting strategy: focusing on Chinese free independent traveler. J. Theoret. Appl. Inf. Technol. 95(18), 4436–4445 (2017)
Ladhari, R.: Alternative measures of service quality: a review. Managing Serv. Qual. 18(1), 65–86 (2008). https://doi.org/10.1108/09604520810842849
Leong, L.Y., Hew, T.S., Lee, V.H., Ooi, K.B.: An SEM-artificial-neural-network analysis of the relationships between SERVPERF, customer satisfaction and loyalty among low-cost and full-service airline. Expert Syst. Appl. 42(19) (2015). https://doi.org/10.1016/j.eswa.2015.04.043
Li, Y.N., Tan, K.C., Xie, M.: Measuring web-based service quality. Total Qual. Manage. 13(5), 685–700 (2002). https://doi.org/10.1080/0954412022000002072
Lin, S.M.: Analysis of service satisfaction in web auction logistics service using a combination of Fruit fly optimization algorithm and general regression neural network. Neural Comput. Appl. 22(3–4), 783–791 (2013). https://doi.org/10.1007/s00521-011-0769-1
Lo, S.: Web service quality control based on text mining using support vector machine. Expert Syst. Appl. 34(1), 603–610 (2008). https://doi.org/10.1016/j.eswa.2006.09.026
López, A., Detz, A., Ratanawongsa, N., Sarkar, U.: What patients say about their doctors online: a qualitative content analysis. J. Gen. Intern. Med. 27(6), 685–692 (2012). https://doi.org/10.1007/s11606-011-1958-4
Ma, X., Zeng, J., Peng, L., Fortino, G., Zhang, Y.: Modeling multi-aspects within one opinionated sentence simultaneously for aspect-level sentiment analysis. Future Gener. Comput. Syst. 93, 304–311 (2019). https://doi.org/10.1016/j.future.2018.10.041
Miranda, M.D., Sassi, R.J.: Using sentiment analysis to assess customer satisfaction in an online job search company. In: Abramowicz, W., Kokkinaki, A. (eds.) BIS 2014. LNBIP, vol. 183, pp. 17–27. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-11460-6_2
Mogaji, E., Erkan, I.: Insight into consumer experience on UK train transportation services. Travel Behav. Soc. 14, 21–33 (2019). https://doi.org/10.1016/j.tbs.2018.09.004
Palese, B., Usai, A.: The relative importance of service quality dimensions in E-commerce experiences. Int. J. Inf. Manage. 40, 132–140 (2018). https://doi.org/10.1016/j.ijinfomgt.2018.02.001
Palese, B., Piccoli, G.: Online reviews as a measure of service quality. In: 2016 Pre-ICIS SIGDSA/IFIP WG8.3 Symposium, Dublin 2016 (2016)
Parasuraman, A., Berry, L.L., Zeithaml, V.A.: Refinement and reassessment of the SERVQUAL scale. J. Retail. 67(4), 420–450 (1991)
Parasuraman, A., Zeithaml, V.A., Berry, L.L.: SERVQUAL: a multiple-item scale for measuring consumer perceptions of service quality. J. Retail. 64(1), 12–40 (1988)
Park, E., Jang, Y., Kim, J., Jeong, N.J., Bae, K., del Pobil, A.P.: Determinants of customer satisfaction with airline services: an analysis of customer feedback big data. J. Retail. Consum. Serv. 51(April), 186–190 (2019). https://doi.org/10.1016/j.jretconser.2019.06.009
Pitt, L.F., Watson, R.T., Kavan, C.B.: Measuring information systems service quality: concerns for a complete canvas. MIS Q. 21(2), 209–221 (1997). https://doi.org/10.2307/249420
Qu, Z., Zhang, H., Li, H.: Determinants of online merchant rating: content analysis of consumer comments about Yahoo merchants. Decis. Support Syst. 46(1), 440–449 (2008). https://doi.org/10.1016/j.dss.2008.08.004
Ramanathan, R., Karpuzcu, H.: Comparing perceived and expected service using an AHP model: An application to measure service quality of a company engaged in pharmaceutical distribution. Opsearch 48(2), 136–152 (2011). https://doi.org/10.1007/s12597-010-0022-1
Ray, P., Chakrabarti, A.: A mixed approach of deep learning method and rule-based method to improve aspect level sentiment analysis. Appl. Comput. Inform. (2019). https://doi.org/10.1016/j.aci.2019.02.002
Rezaeinia, S.M., Rahmani, R., Ghodsi, A., Veisi, H.: Sentiment analysis based on improved pre-trained word embeddings. Expert Syst. Appl. 117, 139–147 (2019). https://doi.org/10.1016/j.eswa.2018.08.044
Song, B., Lee, C., Yoon, B., Park, Y.: Diagnosing service quality using customer reviews: an index approach based on sentiment and gap analyses. Serv. Bus. 10(4), 775–798 (2015). https://doi.org/10.1007/s11628-015-0290-1
VanDyke, T.P., Kappelman, L.A., Prybutok, V.R.: Measuring information systems service quality: concerns on the use of the SERVQUAL questionnaire. MIS Q. 21(2), 195–208 (1997). https://doi.org/10.2307/249419
Vanparia, B., Tsoukatos, E.: Comparision of SERVQUAL, SERVPERF, BSQ and BANKQUAL scale in banking sector. In: Confronting Contemporary Business Challenges Through Management Innovation, pp. 2405–2430 (2013)
Xiong, S., Lv, H., Zhao, W., Ji, D.: Towards Twitter sentiment classification by multi-level sentiment-enriched word embeddings. Neurocomputing 275, 2459–2466 (2018). https://doi.org/10.1016/j.neucom.2017.11.023
Yadav, A., Vishwakarma, D.K.: Sentiment analysis using deep learning architectures: a review. Artif. Intell. Rev. 53(6), 4335–4385 (2019). https://doi.org/10.1007/s10462-019-09794-5
Yang, Z., Jun, M., Peterson, R.T.: Measuring customer perceived online service quality: scale development and managerial implications. Int. J. Oper. Prod. Manage. 24(11), 1149–1174 (2004). https://doi.org/10.1108/01443570410563278
Zhao, G., Qian, X., Lei, X., Mei, T.: Service quality evaluation by exploring social users’ contextual information. IEEE Trans. Knowl. Data Eng. 1–1 (2016). https://doi.org/10.1109/TKDE.2016.2607172
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Vencovský, F. (2020). Service Quality Evaluation Using Text Mining: A Systematic Literature Review. In: Buchmann, R.A., Polini, A., Johansson, B., Karagiannis, D. (eds) Perspectives in Business Informatics Research. BIR 2020. Lecture Notes in Business Information Processing, vol 398. Springer, Cham. https://doi.org/10.1007/978-3-030-61140-8_11
Download citation
DOI: https://doi.org/10.1007/978-3-030-61140-8_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-61139-2
Online ISBN: 978-3-030-61140-8
eBook Packages: Computer ScienceComputer Science (R0)