Skip to main content

Service Quality Evaluation Using Text Mining: A Systematic Literature Review

  • Conference paper
  • First Online:
Perspectives in Business Informatics Research (BIR 2020)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 398))

Included in the following conference series:

Abstract

The volume of customers’ feedback that is available online is rising every year. Traditional approaches to service quality evaluation use questionnaires and leave existing online feedback from consumers aside. The possible reason is that harnessing the consumers’ feedback is a difficult task that requires employing text mining methods. Therefore, we decided to shed light on service quality research that uses consumers’ feedback as a source of information and text mining methods as a part of the quality evaluation.

We conducted a systematic literature review of journal articles that focuses on service quality evaluation with the use of text mining methods.

We found that text mining is a promising method for service quality research. On the other hand, we identified four challenges that arose from the reviewed article inconsistencies regarding quality measure, quality dimensions, the level of analysis, and sentiment analysis methods.

Future research is needed to validate quality evaluation measures and separate them from customer satisfaction measures, to argue when is suitable to use quality dimensions from literature and when identify service-specific quality dimensions, and to focus more on aspect level of quality analysis. There were also no attempts among studies to use the current state of art classification technologies, such as deep learning, or experiment with word embedding.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Abdi, A., Shamsuddin, S.M., Hasan, S., Piran, J.: Deep learning-based sentiment classification of evaluative text based on multi-feature fusion. Inf. Process. Manage. 56(4), 1245–1259 (2019). https://doi.org/10.1016/j.ipm.2019.02.018

    Article  Google Scholar 

  2. Alanezi, M.A., Kamil, A., Basri, S.: A proposed instrument dimensions for measuring e-government service quality. Int. J. U- E-Serv. Sci. Technol. 3(4), 1–17 (2010)

    Google Scholar 

  3. Ali, F., et al.: Transportation sentiment analysis using word embedding and ontology-based topic modeling. Knowl.-Based Syst. 174, 27–42 (2019). https://doi.org/10.1016/j.knosys.2019.02.033

    Article  Google Scholar 

  4. Ashton, T., Evangelopoulos, N., Prybutok, V.R.: Exponentially weighted moving average control charts for monitoring customer service quality comments. Int. J. Serv. Stand. 8(3), 230 (2013). https://doi.org/10.1504/IJSS.2013.057237

    Article  Google Scholar 

  5. Ashton, T., Evangelopoulos, N., Prybutok, V.R.: Quantitative quality control from qualitative data: control charts with latent semantic analysis. Qual. Quant. 49(3), 1081–1099 (2014). https://doi.org/10.1007/s11135-014-0036-5

    Article  Google Scholar 

  6. Bogicevic, V., Yang, W., Bujisic, M., Bilgihan, A.: Visual data mining: analysis of airline service quality attributes. J. Qual. Assur. Hospitality Tourism 18(4), 509–530 (2017). https://doi.org/10.1080/1528008X.2017.1314799

    Article  Google Scholar 

  7. Chakrabarti, S., Trehan, D., Makhija, M.: Assessment of service quality using text mining - evidence from private sector banks in India. Int. J. Bank Market. 36(4), 594–615 (2018). https://doi.org/10.1108/IJBM-04-2017-0070

    Article  Google Scholar 

  8. Choudhury, K.: Service quality and word of mouth: a study of the banking sector. Int. J. Bank Market. 32(7), 612–627 (2014). https://doi.org/10.1108/IJBM-12-2012-0122

    Article  Google Scholar 

  9. Chowdhury, J., Reardon, J., Srivastava, R.: Alternative modes of measuring store image: an empirical assessment of structured versus unstructured measures. J. Market. Theory Pract. 6(2), 72–86 (1998). https://doi.org/10.1080/10696679.1998.11501797

    Article  Google Scholar 

  10. Duan, W., Cao, Q., Yu, Y., Levy, S.: mining online user-generated content: using sentiment analysis technique to study hotel service quality. In: 2013 46th Hawaii International Conference on System Sciences, pp. 3119–3128 (2013). https://doi.org/10.1109/HICSS.2013.400

  11. Duan, W., Yu, Y., Cao, Q., Levy, S.: Exploring the impact of social media on hotel service performance. Cornell Hospitality Q. 57(3), 282–296 (2016). https://doi.org/10.1177/1938965515620483

    Article  Google Scholar 

  12. El-Bayoumi, J.G.: Evaluating IT service quality using SERVQUAL. In: Proceedings of the ACM SIGUCCS 40th Annual Conference on Special Interest Group on University and College Computing Services - SIGUCCS 2012, p. 15. ACM Press, New York (2012). https://doi.org/10.1145/2382456.2382461

  13. Gitto, S., Mancuso, P.: Improving airport services using sentiment analysis of the websites. Tourism Manage. Persp. 22, 132–136 (2017). https://doi.org/10.1016/j.tmp.2017.03.008

    Article  Google Scholar 

  14. Gnewuch, U., Morana, S., Adam, M., Maedche, A.: Measuring service encounter satisfaction with customer service chatbots using sentiment analysis. In: Proceedings of the 14th International Conference on Wirtschaftsinformatik (WI2019), pp. 0–11 (2019)

    Google Scholar 

  15. Gotlieb, J.B., Grewal, D., Brown, S.W.: Consumer satisfaction and perceived quality: complementary or divergent constructs? J. Appl. Psychol. 79(6), 875–885 (1994)

    Article  Google Scholar 

  16. Grönroos, C.: A service quality model and its marketing implications. Eur. J. Market. 18(4), 36–44 (1984). https://doi.org/10.1108/EUM0000000004784

    Article  Google Scholar 

  17. Haghighi, N.N., Liu, X.C., Wei, R., Li, W., Shao, H.: Using Twitter data for transit performance assessment: a framework for evaluating transit riders’ opinions about quality of service. Public Transp. 10(2), 363–377 (2018). https://doi.org/10.1007/s12469-018-0184-4

    Article  Google Scholar 

  18. Hailong, Z., Wenyan, G., Bo, J.: Machine learning and lexicon based methods for sentiment classification: a survey. In: Proceedings - 11th Web Information System and Application Conference, WISA 2014, pp. 262–265 (2014). https://doi.org/10.1109/WISA.2014.55

  19. He, W., Tian, X., Hung, A., Akula, V., Zhang, W.: Measuring and comparing service quality metrics through social media analytics: a case study. IseB 16(3), 579–600 (2017). https://doi.org/10.1007/s10257-017-0360-0

    Article  Google Scholar 

  20. Bogicevic, V., Yang, W., Bilgihan, A., Bujisic, M.: Airport service quality drivers of passenger satisfaction. Tourism Rev. 68(4), 3–18 (2013). https://doi.org/10.1108/TR-09-2013-0047

    Article  Google Scholar 

  21. James, T.L., Villacis Calderon, E.D., Cook, D.F.: Exploring patient perceptions of healthcare service quality through analysis of unstructured feedback. Expert Syst. Appl. 71, 479–492 (2017). https://doi.org/10.1016/j.eswa.2016.11.004

    Article  Google Scholar 

  22. Jiang, J.J., Klein, G., Carr, C.L.: Measuring information system service quality: SERVQUAL from the other side. MIS Q. 26(2), 145–166 (2002). https://doi.org/10.2307/4132324

    Article  Google Scholar 

  23. Kettinger, W.J., Lee, C.C.: Perceived service quality and user satisfaction with the information services function. Decis. Sci. 25(5–6), 737–766 (1994). https://doi.org/10.1111/j.1540-5915.1994.tb01868.x

    Article  Google Scholar 

  24. Kettinger, W.J., Lee, C.C.: Pragmatic perspectives on the measurement of information systems service quality. MIS Q. 21(2), 223–240 (1997). https://doi.org/10.2307/249421

    Article  Google Scholar 

  25. Kim, D.: CTQ for service quality management using web-based VOC: with focus on hotel business. J. Theoret. Appl. Inf. Technol. 96(22), 7464–7472 (2018)

    Google Scholar 

  26. Kim, D., Yu, S.J.: Hotel review mining for targeting strategy: focusing on Chinese free independent traveler. J. Theoret. Appl. Inf. Technol. 95(18), 4436–4445 (2017)

    Google Scholar 

  27. Ladhari, R.: Alternative measures of service quality: a review. Managing Serv. Qual. 18(1), 65–86 (2008). https://doi.org/10.1108/09604520810842849

    Article  Google Scholar 

  28. Leong, L.Y., Hew, T.S., Lee, V.H., Ooi, K.B.: An SEM-artificial-neural-network analysis of the relationships between SERVPERF, customer satisfaction and loyalty among low-cost and full-service airline. Expert Syst. Appl. 42(19) (2015). https://doi.org/10.1016/j.eswa.2015.04.043

  29. Li, Y.N., Tan, K.C., Xie, M.: Measuring web-based service quality. Total Qual. Manage. 13(5), 685–700 (2002). https://doi.org/10.1080/0954412022000002072

    Article  Google Scholar 

  30. Lin, S.M.: Analysis of service satisfaction in web auction logistics service using a combination of Fruit fly optimization algorithm and general regression neural network. Neural Comput. Appl. 22(3–4), 783–791 (2013). https://doi.org/10.1007/s00521-011-0769-1

    Article  Google Scholar 

  31. Lo, S.: Web service quality control based on text mining using support vector machine. Expert Syst. Appl. 34(1), 603–610 (2008). https://doi.org/10.1016/j.eswa.2006.09.026

    Article  Google Scholar 

  32. López, A., Detz, A., Ratanawongsa, N., Sarkar, U.: What patients say about their doctors online: a qualitative content analysis. J. Gen. Intern. Med. 27(6), 685–692 (2012). https://doi.org/10.1007/s11606-011-1958-4

    Article  Google Scholar 

  33. Ma, X., Zeng, J., Peng, L., Fortino, G., Zhang, Y.: Modeling multi-aspects within one opinionated sentence simultaneously for aspect-level sentiment analysis. Future Gener. Comput. Syst. 93, 304–311 (2019). https://doi.org/10.1016/j.future.2018.10.041

    Article  Google Scholar 

  34. Miranda, M.D., Sassi, R.J.: Using sentiment analysis to assess customer satisfaction in an online job search company. In: Abramowicz, W., Kokkinaki, A. (eds.) BIS 2014. LNBIP, vol. 183, pp. 17–27. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-11460-6_2

    Chapter  Google Scholar 

  35. Mogaji, E., Erkan, I.: Insight into consumer experience on UK train transportation services. Travel Behav. Soc. 14, 21–33 (2019). https://doi.org/10.1016/j.tbs.2018.09.004

    Article  Google Scholar 

  36. Palese, B., Usai, A.: The relative importance of service quality dimensions in E-commerce experiences. Int. J. Inf. Manage. 40, 132–140 (2018). https://doi.org/10.1016/j.ijinfomgt.2018.02.001

    Article  Google Scholar 

  37. Palese, B., Piccoli, G.: Online reviews as a measure of service quality. In: 2016 Pre-ICIS SIGDSA/IFIP WG8.3 Symposium, Dublin 2016 (2016)

    Google Scholar 

  38. Parasuraman, A., Berry, L.L., Zeithaml, V.A.: Refinement and reassessment of the SERVQUAL scale. J. Retail. 67(4), 420–450 (1991)

    Google Scholar 

  39. Parasuraman, A., Zeithaml, V.A., Berry, L.L.: SERVQUAL: a multiple-item scale for measuring consumer perceptions of service quality. J. Retail. 64(1), 12–40 (1988)

    Google Scholar 

  40. Park, E., Jang, Y., Kim, J., Jeong, N.J., Bae, K., del Pobil, A.P.: Determinants of customer satisfaction with airline services: an analysis of customer feedback big data. J. Retail. Consum. Serv. 51(April), 186–190 (2019). https://doi.org/10.1016/j.jretconser.2019.06.009

    Article  Google Scholar 

  41. Pitt, L.F., Watson, R.T., Kavan, C.B.: Measuring information systems service quality: concerns for a complete canvas. MIS Q. 21(2), 209–221 (1997). https://doi.org/10.2307/249420

    Article  Google Scholar 

  42. Qu, Z., Zhang, H., Li, H.: Determinants of online merchant rating: content analysis of consumer comments about Yahoo merchants. Decis. Support Syst. 46(1), 440–449 (2008). https://doi.org/10.1016/j.dss.2008.08.004

    Article  Google Scholar 

  43. Ramanathan, R., Karpuzcu, H.: Comparing perceived and expected service using an AHP model: An application to measure service quality of a company engaged in pharmaceutical distribution. Opsearch 48(2), 136–152 (2011). https://doi.org/10.1007/s12597-010-0022-1

    Article  Google Scholar 

  44. Ray, P., Chakrabarti, A.: A mixed approach of deep learning method and rule-based method to improve aspect level sentiment analysis. Appl. Comput. Inform. (2019). https://doi.org/10.1016/j.aci.2019.02.002

    Article  Google Scholar 

  45. Rezaeinia, S.M., Rahmani, R., Ghodsi, A., Veisi, H.: Sentiment analysis based on improved pre-trained word embeddings. Expert Syst. Appl. 117, 139–147 (2019). https://doi.org/10.1016/j.eswa.2018.08.044

    Article  Google Scholar 

  46. Song, B., Lee, C., Yoon, B., Park, Y.: Diagnosing service quality using customer reviews: an index approach based on sentiment and gap analyses. Serv. Bus. 10(4), 775–798 (2015). https://doi.org/10.1007/s11628-015-0290-1

    Article  Google Scholar 

  47. VanDyke, T.P., Kappelman, L.A., Prybutok, V.R.: Measuring information systems service quality: concerns on the use of the SERVQUAL questionnaire. MIS Q. 21(2), 195–208 (1997). https://doi.org/10.2307/249419

    Article  Google Scholar 

  48. Vanparia, B., Tsoukatos, E.: Comparision of SERVQUAL, SERVPERF, BSQ and BANKQUAL scale in banking sector. In: Confronting Contemporary Business Challenges Through Management Innovation, pp. 2405–2430 (2013)

    Google Scholar 

  49. Xiong, S., Lv, H., Zhao, W., Ji, D.: Towards Twitter sentiment classification by multi-level sentiment-enriched word embeddings. Neurocomputing 275, 2459–2466 (2018). https://doi.org/10.1016/j.neucom.2017.11.023

    Article  Google Scholar 

  50. Yadav, A., Vishwakarma, D.K.: Sentiment analysis using deep learning architectures: a review. Artif. Intell. Rev. 53(6), 4335–4385 (2019). https://doi.org/10.1007/s10462-019-09794-5

    Article  Google Scholar 

  51. Yang, Z., Jun, M., Peterson, R.T.: Measuring customer perceived online service quality: scale development and managerial implications. Int. J. Oper. Prod. Manage. 24(11), 1149–1174 (2004). https://doi.org/10.1108/01443570410563278

    Article  Google Scholar 

  52. Zhao, G., Qian, X., Lei, X., Mei, T.: Service quality evaluation by exploring social users’ contextual information. IEEE Trans. Knowl. Data Eng. 1–1 (2016). https://doi.org/10.1109/TKDE.2016.2607172

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Filip Vencovský .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Vencovský, F. (2020). Service Quality Evaluation Using Text Mining: A Systematic Literature Review. In: Buchmann, R.A., Polini, A., Johansson, B., Karagiannis, D. (eds) Perspectives in Business Informatics Research. BIR 2020. Lecture Notes in Business Information Processing, vol 398. Springer, Cham. https://doi.org/10.1007/978-3-030-61140-8_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-61140-8_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-61139-2

  • Online ISBN: 978-3-030-61140-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics