The Social Aspect of Voting for Useful Reviews
Word-of-mouth is being replaced by online reviews on products and services. To identify the most useful reviews, many web sites enable readers to vote on which reviews they find useful. In this work we use three hypotheses to predict which reviews will be voted useful. The first is that useful reviews induce feelings. The second is that useful reviews are both informative and expressive, thus contain less adjectives while being longer. The third hypothesis is that the reviewer’s history can be used as a predictor. We devise impact metrics similar to the scientific metrics for assessing the impact of a scholar, namely h-index, i 5 -index. We analyze the performance of our hypotheses over three datasets collected from Yelp and Amazon. Our surprising and robust results show that the only good predictor to the usefulness of a review is the reviewer’s impact metrics score. We further devise a regression model that predicts the usefulness rating of each review. To further understand these results we characterize reviewers with high impact metrics scores and show that they write reviews frequently, and that their impact scores increase with time, on average. We suggest the term local celebs for these reviewers, and analyze the conditions for becoming local celebs on sites.
KeywordsRoot Mean Square Error Recommender System Impact Score Online Review Impact Metrics
Unable to display preview. Download preview PDF.
- 2.Kim, S.-M., Pantel, P., Chklovski, T., Pennacchiotti, M.: Automatically assessing review helpfulness. In: Proceedings of the 2006 Conference on Empirical MNLP, pp. 423–430 (2006)Google Scholar
- 3.Lu, Y., Tsaparas, P., Ntoulas, A., Polanyi, L.: Exploiting social context for review quality prediction. In: Proceedings of the 19th International Conference on WWW, pp. 691–700. ACM (2010)Google Scholar
- 10.Levi, A., Mokryn, O., Diot, C., Taft, N.: Finding a needle in a haystack of reviews: cold start context-based hotel recommender system. In: Proceedings of the Sixth ACM Conference on Recommender Systems, pp. 115–122. ACM (2012)Google Scholar
- 11.Levi, A., Mokryn, O.: The social aspect of voting for useful reviews (2014), http://www.cs.mta.ac.il/~ossi/Pubs/LM2013.pdf