Quantitative Marketing and Economics

, Volume 16, Issue 3, pp 289–339 | Cite as

Aggregation of consumer ratings: an application to

  • Weijia (Daisy) Dai
  • Ginger JinEmail author
  • Jungmin Lee
  • Michael Luca


Because consumer reviews leverage the wisdom of the crowd, the way in which they are aggregated is a central decision faced by platforms. We explore this “rating aggregation problem” and offer a structural approach to solving it, allowing for (1) reviewers to vary in stringency and accuracy, (2) reviewers to be influenced by existing reviews, and (3) product quality to change over time. Applying this to restaurant reviews from, we construct an adjusted average rating and show that even a simple algorithm can lead to large information efficiency gains relative to the arithmetic average.


User generated content Crowdsourcing E-commerce Learning Yelp 

JEL Classification

D8 L15 L86 


  1. Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6), 716–723.CrossRefGoogle Scholar
  2. Akerlof, G.A. (1980). A theory of social custom, of which unemployment may be one consequence. Quarterly Journal of Economics, 94(4), 749–75.CrossRefGoogle Scholar
  3. Alevy, J.E., Haigh, M.S., & List, J.A. (2007). Information cascades: evidence from a field experiment with financial market professionals. The Journal of Finance, 62(1), 151–180.CrossRefGoogle Scholar
  4. Ariely, D., Bracha, A., & Meier, S. (2009). Doing good or doing well? Image motivation and monetary incentives in behaving prosocially. American Economic Review, 99(1), 544–555.CrossRefGoogle Scholar
  5. Banerjee, A.V. (1992). A simple model of herd behavior. The Quarterly Journal of Economics, 107(3), 797–817.CrossRefGoogle Scholar
  6. Bénabou, R., & Tirole, J. (2006). Incentives and prosocial behavior. American Economic Review, 96(5), 1652–1678.CrossRefGoogle Scholar
  7. Bikhchandani, S., Hirshleifer, D., & Welch, I. (1992). A Theory of Fads, Fashion, Custom and Cultural Change as Informational Cascades. Journal of Political Economy, 100(5), 992–1026.CrossRefGoogle Scholar
  8. Brown, J., Hossain, T., & Morgan, J. (2010). Shrouded attributes and information suppression: evidence from the field. Quarterly Journal of Economics, 125(2), 859–876.CrossRefGoogle Scholar
  9. Chen, Y., Maxwell Harper, F., Konstan, J., & Li, S.X. (2010). Social comparison and contributions to online communities: a field experiment on MovieLens. American Economic Review, 100(4), 1358–1398.CrossRefGoogle Scholar
  10. Chevalier, J.A., & Mayzlin, D. (2006). The effect of word of mouth on sales: online book reviews. Journal of Marketing Research, 43(3), 345–354.CrossRefGoogle Scholar
  11. Duan, W., Bin, G., & Whinston, A.B. (2008). Do online reviews matter? an empirical investigation of panel data. Decision Support Systems, 45(4), 1007–1016.CrossRefGoogle Scholar
  12. Eyster, E., & Rabin, M. (2010). Naïve Herding in Rich-Information Settings. American Economic Journal: Microeconomics, 2(4), 221–243.Google Scholar
  13. Fradkin, A., Grewal, E., & Holtz, D. (2017). he Determinants of Online Review Informativeness: Evidence from Field Experiments on Airbnb. working paper.Google Scholar
  14. Ghose, A., Ipeirotis, P., & Li, B. (2012). Designing Ranking Systems for Hotels on Travel Search Engines by Mining User-Generated and Crowd-Sourced Content. Marketing Science.Google Scholar
  15. Glazer, J., McGuire, T.G., Cao, Z., & Zaslavsky, A. (2008). Using global ratings of health plans to improve the quality of health care. Journal of Health Economics, 27(5), 1182–95.CrossRefGoogle Scholar
  16. Godes, D., & Mayzlin, D. (2004). Using Online Conversations to Study Word-of-Mouth Communication. Marketing Science, 23(4), 545–560.CrossRefGoogle Scholar
  17. Godes, D., & Silva, J.C. (2012). Sequential and temporal dynamics of online opinion. Marketing Science, 31(3), 448–473.CrossRefGoogle Scholar
  18. Hu, N., Zhang, J., & Pavlou, P. (2009). Overcoming the J-shaped distribution of product reviews. Communication ACM.Google Scholar
  19. Li, X., & Hitt, L. (2008). Self-selection and information role of online product reviews. Information Systems Research, 19(4), 456–474.CrossRefGoogle Scholar
  20. Ljungqvist, L., & Sargent, T.J. (2012). Recursive macroeconomic theory, 3Edition. Cambridge: MIT Press.Google Scholar
  21. Luca, M. (2011). Reviews, Reputation, and Revenue: The Case of Harvard Business School working paper.Google Scholar
  22. Luca, M., & Smith, J. (2013). Salience in Quality Disclosure: Evidence from The US News College Rankings. Journal of Economics & Management Strategy.Google Scholar
  23. Luca, M., & Zervas, G. (2016). Fake it till you make it: reputation, competition, and Yelp review fraud. Management Science.Google Scholar
  24. Mayzlin, D., Dover, Y., & Chevalier, J.A. (2014). Promotional Reviews: an Empirical Investigation of Online Review Manipulation. American Economic Review.Google Scholar
  25. Miller, N., Resnick, P., & Zeckhauser, R.J. (2005). Eliciting informative feedback: the peer- prediction method. Management Science, 51(9), 1359–1373.CrossRefGoogle Scholar
  26. Moe, W.W., & Trusov, M. (2011). The value of social dynamics in online product ratings forums. Journal of Marketing Research, 48(3), 444–456.CrossRefGoogle Scholar
  27. Moe, W.W., & Schweidel, D.A. (2012). Online product opinions: incidence, evaluation, and evolution. Marketing Science, 31(3), 372–386.CrossRefGoogle Scholar
  28. Muchnik, L., Aral, S., & Taylor, S.J. (2013). Social influence bias: a randomized experiment. Science, 341(6146), 647–651.CrossRefGoogle Scholar
  29. Nosko, C., & Tadelis, S. (2015). The Limits of reputation in platform Markets: an empirical analysis and field experiment. NBER Working Paper No. 20930, January 2015.Google Scholar
  30. Pope, D. (2009). Reacting to rankings: evidence from America’s best hospitals. Journal of Health Economics, 28(6), 1154–1165.CrossRefGoogle Scholar
  31. Wang, Q., Goh, K.Y., & Lu, X. (2012). How does user generated content influence consumers’ new product exploration and choice diversity? An empirical analysis of product reviews and consumer variety seeking behaviors. Working paper.Google Scholar
  32. Wang, Z. (2010). Anonymity, Social Image, and the Competition for Volunteers: A Case Study of the Online Market for Reviews. The B.E. Journal of Economic Analysis & Policy.Google Scholar
  33. Welch, G., & Bishop, G. (2001). An introduction to the Kalman filter. In Proceedings of the Siggraph Course, Los Angeles.Google Scholar
  34. Wu, C., Che, H., Chan, T.Y., & Lu, X. (2015). The Economic Value of Online Reviews. Marketing Science, 34(5), 739–754.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2017

Authors and Affiliations

  1. 1.Lehigh UniversityBethlehemUSA
  2. 2.University of Maryland & NBERCollege ParkUSA
  3. 3.Seoul National UniversitySeoulSouth Korea
  4. 4.Harvard Business SchoolBostonUSA

Personalised recommendations