Skip to main content

Estimating True Ratings from Online Consumer Reviews

  • Conference paper
  • First Online:
German-Japanese Interchange of Data Analysis Results

Abstract

Online consumer reviews have emerged in the last decade as a promising starting point for monitoring and analyzing individual opinions about products and services. Especially the corresponding “star” ratings are frequently used by marketing researchers to address various aspects of electronic word-of-mouth (eWOM). But there also exist several studies which raise doubts about the general reliability of posted ratings. Against this background, we introduce a new framework based on the Beta Binomial True Intentions Model suggested by Morrison (J Mark Res 43(2):65–74, 1979) to accommodate the possible uncertainty inherent in the ratings contained in online consumer reviews. We show that, under certain conditions, the suggested framework is suitable to estimate “true” ratings from posted ones which proves advantageous in the case of rating-based predictions, e.g. with respect to the willingness to recommend a product or service. The theoretical considerations are illustrated by means of synthetic and real data.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Abulaish M, Jahiruddin, Doja MN, Ahmad T (2009) Feature and opinion mining for customer review summarization. In: Recognition and machine intelligence. Lecture notes in computer science, vol 5909. Springer, Berlin/Heidelberg, pp 219–224

    Google Scholar 

  • Chen Y, Fay S, Wang Q (2003) Marketing implications of online consumer product reviews. Working paper, Department of Marketing, University of Florida

    Google Scholar 

  • Chen PY, Wu SY, Yoon J (2004) The impact of online recommendations and consumer feedback on sales. In: Proceedings of the 24th international conference on information systems (ICIS), Washington, DC, pp 711–724

    Google Scholar 

  • Chevalier JA, Mayzlin D (2006) The effect of word of mouth on sales: online book reviews. J Mark Res 43(3):345–354

    Article  Google Scholar 

  • Dellarocas C, Awad NF, Zhang XM (2004) Exploring the value of online reviews to organizations: implications for revenue forecasting and planning. In: Proceedings of the 24th international conference on information systems (ICIS), Washington, DC, pp 379–386

    Google Scholar 

  • Dellarocas C, Gao G, Narayan R (2010) Are consumers more likely to contribute online reviews for hit or niche products? J Manag Inf Syst 27(2):127–157

    Article  Google Scholar 

  • Godes D, Mayzlin D (2004) Using online conversations to study word-of-mouth communication. Mark Sci 23(4):545–560

    Article  Google Scholar 

  • Hao L, Li X, Tan Y, Xu J (2011) The economic value of ratings in app market. http://ssrn.com/abstract=1892584

  • Healy MJR, Goldstein H (1978) Regression to the mean. Ann Hum Biol 5(3):277–280

    Article  Google Scholar 

  • Hu N, Pavlou PA, Zhang J (2006) Can online reviews reveal a product’s true quality? Empirical findings and analytical modeling of online word-of-mouth communication. In: Proceedings of the 7th ACM conference on electronic commerce, Ann Arbor, pp 324–330

    Google Scholar 

  • Hu N, Zhang J, Pavlou PA (2009) Overcoming the j-shaped distribution of product reviews. Commun ACM 52(10):144

    Article  Google Scholar 

  • Jamieson LF, Bass FM (1989) Adjusting stated intention measures to predict trial purchase of new products: a comparison of models and methods. J Mark Res 26(3):336–345

    Article  Google Scholar 

  • Jiang B, Chen P (2007) An economic analysis of online product reviews and ratings. http://ssrn.com/abstract=1023302

  • Joeckel S (2007) The impact of experience: the influences of user and online review ratings on the performance of video games in the us market. In: Situated play: proceedings of the 2007 digital games research association conference, Tokyo, pp 629–638. http://www.digra.org/dl/db/07312.08365.pdf

  • Juster FT (1966) Consumer buying intentions and purchase probability: an experiment in survey design. J Am Stat Assoc 61(315):658–696

    Article  Google Scholar 

  • Kalton G, Kasprzyk D (1982) Imputing for missing survey responses. In: Proceedings of the section on survey research methods, Cincinnati. American Statistical Association, pp 22–33

    Google Scholar 

  • Kalwani MU, Silk AJ (1982) On the reliability and predictive validity of purchase intention measures. Mark Sci 1(3):243–286

    Article  Google Scholar 

  • Lee J, Park DH, Han I (2011) The different effects of online consumer reviews on consumers’ purchase intention depending on trust in online shopping mall: an advertising perspective. Internet Res 21(2):187–206

    Article  Google Scholar 

  • Li X, Hitt LM (2008) Self-selection and information role of online product reviews. Inf Syst Res 19(4):456–474

    Article  Google Scholar 

  • Li X, Hitt LM (2010) Price effects in online product reviews: an analytical model and empirical analysis. Manag Inf Syst Q 34(4):809–831

    Google Scholar 

  • Lilien GL, Kotler P, Moorthy KS (1992) Marketing models. Prentice Hall, Englewood Cliffs

    Google Scholar 

  • Liu B (2010) Sentiment analysis and subjectivity. In: Indurkhya N, Damerau FJ (eds) Handbook of natural language processing. CRC, Boca Raton, pp 627–666

    Google Scholar 

  • Liu B, Hu M, Cheng J (2005) Opinion observer: analyzing and comparing opinions on the web. In: WWW’05: proceedings of the 14th international conference on world wide web, Chiba. ACM, pp 342–351

    Google Scholar 

  • Manning CD, Raghavan P, Schuetze H (2010) Introduction to information retrieval. Cambridge University Press, New York

    Google Scholar 

  • Moe WW, Schweidel DA (2011) Online product opinions: incidence, evaluation and evolution. http://ssrn.com/abstract=1525205

  • Moe WW, Trusov M (2011) The value of social dynamics in online product ratings forums. J Mark Res 48(3):444–456

    Article  Google Scholar 

  • Morrison DG (1979) Purchase intentions and purchase behavior. J Mark Res 43(2):65–74

    Article  Google Scholar 

  • Sande IG (1982) Imputation in surveys: coping with reality. Am Stat 36(3):145–152

    Article  Google Scholar 

  • Thomas ML, Mullen LG, Fraedrich J (2011) Increased word-of-mouth via strategic-related marketing. Int J Nonprofit Volunt Sect Mark 16(1):36–49

    Article  Google Scholar 

  • Tsang ASL, Prendergast G (2009) Is a “star” worth a thousand words? The interplay between movie review texts and rating valences. Eur J Mark 43(11/12):1269–1280

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Reinhold Decker .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Schindler, D., Lüpke, L., Decker, R. (2014). Estimating True Ratings from Online Consumer Reviews. In: Gaul, W., Geyer-Schulz, A., Baba, Y., Okada, A. (eds) German-Japanese Interchange of Data Analysis Results. Studies in Classification, Data Analysis, and Knowledge Organization. Springer, Cham. https://doi.org/10.1007/978-3-319-01264-3_21

Download citation

Publish with us

Policies and ethics