Ranking Online Services by Aggregating Ordinal Preferences

  • Ying Chen
  • Xiao-dong FuEmail author
  • Kun Yue
  • Li Liu
  • Li-jun Liu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9998)


With the increase of the number of online services, it is more and more difficult for customers to make the decision on service selection. Services ranking mechanism is an important service for e-commerce that facilitates consumers’ decision-making process. Traditional services ranking methods ignore the fact that customers cannot rate services under the same criteria, which leads to the ratings are actually incomparable. In this paper, we propose to exploit the ordinal preferences rather than cardinal ratings to rank online services. Ordinal preferences are elicited from filled ratings so that the intensity of ratings is ignored. We construct a directed graph to depict the set of pairwise preferences between services. Then, the strongest paths of the directed graph are identified and the evaluation values of services are calculated based on the strongest paths. We prove our method satisfies some important conditions that a reasonable services ranking method should satisfy. Experiments using real data of movie ratings demonstrate that the proposed method is advantageous over previous methods, and so the proposed method can rank services effectively even the ratings are given by customers with inconsistent criteria. In addition, the experiments also verify that it is more difficult to manipulate the ranking result of our method than existing methods.


Online services ranking Ordinal preference Inconsistent rating criteria Manipulation 



This work was partially supported by the National Natural Science Foundation of China (Grand 61462056, 61472345, 61462051, 81560296), the Applied Fundamental Research Project of Yunnan Province (Grand No. 2014FA028, 2014FA023, 2014FB133).


  1. 1.
    Jøsang, A., Ismail, R., Boyd, C.: A survey of trust and reputation systems for online service provision. Decis. Support Syst. 43, 618–644 (2007)CrossRefGoogle Scholar
  2. 2.
    Yao, Y., Ruohomaa, S., Xu, F.: Addressing common vulnerabilities of reputation systems for electronic commerce. J. Theor. Appl. Electr. Commer. Res. 7(1), 1–20 (2012)CrossRefGoogle Scholar
  3. 3.
    Malaga, R.A.: Web-based reputation management systems: problems and suggested solutions. Electr. Commer. Res. 1(4), 403–417 (2001)CrossRefzbMATHGoogle Scholar
  4. 4.
    Abdul-Muhmin, A.G.: Contingent decision behavior: effect of number of alternatives to be selected on consumers’ decision processes. J. Consum. Psychol. 8(1), 91–111 (1999)CrossRefGoogle Scholar
  5. 5.
    Zhang, K,, Narayanan, R., Choudhary, A.: Voice of the customers: mining online customer reviews for product feature-based ranking. In: Proceedings of the 3rd Conference on Online Social Networks, p. 11 (2010)Google Scholar
  6. 6.
    Feng, Q., Hwang, K., Dai, Y.: Rainbow product ranking for upgrading e-commerce. IEEE Internet Comput. 13(5), 72–80 (2009)CrossRefGoogle Scholar
  7. 7.
    Najmi, E., Hashmi, K., Malik, Z., et al.: CAPRA: a comprehensive approach to product ranking using customer reviews. Computing 97(8), 843–867 (2015)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Gangothri, V., et al.: Engender product ranking and recommendation using customer feedback. In: Suresh, L.V., Panigrahi, B.K. (eds.) Proceedings of the International Conference on Soft Computing Systems, pp. 851–859. Springer, India (2016)CrossRefGoogle Scholar
  9. 9.
    Najmi, E., Hashmi, K., Malik, Z., et al.: CAPRA: a comprehensive approach to product ranking using customer reviews. Computing 1–25 (2015)Google Scholar
  10. 10.
    Tang, J., Gao, H., Dassarma, A., et al.: Trust evolution: modeling and its applications (2013)Google Scholar
  11. 11.
    Mohanty, B.K., Passi, K.: Web based information for product ranking in e-business: a fuzzy approach. In: Proceedings of the 8th International Conference on Electronic commerce: The New e-Commerce: Innovations for Conquering Current Barriers, Obstacles and Limitations to Conducting Successful Business on the Internet, pp. 558–563. ACM (2006)Google Scholar
  12. 12.
    Ghose, A., Ipeirotis, P.G., Li, B.: Designing ranking systems for hotels on travel search engines by mining user-generated and crowd sourced content. Mark. Sci. 31(3), 493–520 (2012)CrossRefGoogle Scholar
  13. 13.
    Zhang, M., Guo, X., Chen, G., et al.: Predicting consumer information search benefits for personalized online product ranking: a confidence-based approach (2014)Google Scholar
  14. 14.
    Schulze, M.: A new monotonic, clone-independent, reversal symmetric, and condorcet-consistent single-winner election method. Soc. Choice Welfare 36(2), 267–303 (2011)MathSciNetCrossRefzbMATHGoogle Scholar
  15. 15.
    Jøsang, A., Guo, G., Pini, M.S., Santini, F., Xu, Y.: Combining recommender and reputation systems to produce better online advice. In: Torra, V., Narukawa, Y., Navarro-Arribas, G., Meg\’ıas, D. (eds.) MDAI 2013. LNCS, vol. 8234, pp. 126–138. Springer, Heidelberg (2013)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  • Ying Chen
    • 1
  • Xiao-dong Fu
    • 1
    • 2
    Email author
  • Kun Yue
    • 3
  • Li Liu
    • 1
    • 2
  • Li-jun Liu
    • 1
    • 2
  1. 1.Kunming University of Science and TechnologyKunmingChina
  2. 2.Yunnan Provincial Key Laboratory of Computer ApplicationKunmingChina
  3. 3.Yunnan UniversityKunmingChina

Personalised recommendations