Classification Approach towards Ranking and Sorting Problems

  • Shyamsundar Rajaram
  • Ashutosh Garg
  • Xiang Sean Zhou
  • Thomas S. Huang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2837)


Recently, ranking and sorting problems have attracted the attention of researchers in the machine learning community. By ranking, we refer to categorizing examples into one of K categories. On the other hand, sorting refers to coming up with the ordering of the data that agrees with some ground truth preference function. As against standard approaches of treating ranking as a multiclass classification problem, in this paper we argue that ranking/sorting problems can be solved by exploiting the inherent structure present in data. We present efficient formulations that enable the use of standard binary classification algorithms to solve these problems, however the structure is still captured in our formulations. We further show that our approach subsumes the various approaches that were developed in the past. We evaluate our algorithm on both synthetic datasets and for a real world image processing problem. The results obtained demonstrate the superiority of our algorithm over multiclass classification and other similar approaches for ranking/sorting data.


Kernel Function Synthetic Data Difference Vector Ordinal Regression Ranking Problem 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Cohen, W., Schapire, R., Singer, Y.: Learning to order things. Artificial Intelligence Research 10, 243–279 (1999)zbMATHMathSciNetGoogle Scholar
  2. 2.
    Crammer, K., Singer, Y.: Pranking with ranking. In: Dietterich, T.G., Becker, S., Ghahramani, Z. (eds.) Advances in Neural Information Processing Systems 14, MIT Press, Cambridge (2002)Google Scholar
  3. 3.
    Frank, E., Hall, M.: A simple approach to ordinal classification. In: Flach, P.A., De Raedt, L. (eds.) ECML 2001. LNCS (LNAI), vol. 2167, p. 145. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  4. 4.
    Herbrich, R., Graepel, T., Obermayer, K.: Large margin rank boundaries for ordinal regression. In: Advances in Large Margin Classifiers, pp. 115–132. MIT Press, Cambridge (2000)Google Scholar
  5. 5.
    Horn, B.K.P.: Focusing. Technical Report AIM-160, Massachusetts Institute of Technology (May 1968)Google Scholar
  6. 6.
    Jarvis, R.A.: Focus optimisation criteria for computer image processing. Microscope 24(2), 163–180 (1976)Google Scholar
  7. 7.
    Lebanon, G., Lafferty, J.: Cranking: Combining rankings using conditional probability models on permutations. In: Proceedings of the 19th International Conference on Machine Learning (ICML), Morgan Kaufmann Publishers, San Francisco (2002)Google Scholar
  8. 8.
    Lee, T.S.: Image representation using 2d gabor wavelets. IEEE Transactions on Pattern Analysis and Machine Intelligence 18(10), 959–971 (1996)CrossRefGoogle Scholar
  9. 9.
    Littlestone, N.: Learning quickly when irrelevant attributes abound: A new linear threshold algorithm. Machine Learning 2(4), 115–132 (1988)Google Scholar
  10. 10.
    Schlag, J.F., Sanderson, A.C., Neumann, C.P., Wimberly, F.C.: Implementation of automatic focusing algorithms for a computer vision system with camera control. Technical Report CMU-RI-TR-83-14, Carnegie Mellon University (August 1983)Google Scholar
  11. 11.
    Smola, A., Schlkopf, B.: A tutorial on support vector regression. In NeuroCOLT2 Technical Report NC2-TR-1998-030 (1998)Google Scholar
  12. 12.
    Roth, D., Har-Paled, S., Zimak, D.: Constraint classification: A new approach to multiclass classification. In: 13th Interntional Conference on Algorithmic Learning Theory, pp. 365– 379 (2002)Google Scholar
  13. 13.
    Pfahringer, B., Kramer, S., Widmer, G., de Groeve, M.: Prediction of ordinal classes using regression trees. In: International Syposium on Methodologies for Intelligent Systems, pp. 426–434 (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Shyamsundar Rajaram
    • 1
  • Ashutosh Garg
    • 2
  • Xiang Sean Zhou
    • 3
  • Thomas S. Huang
    • 1
  1. 1.University of IllinoisUrbana
  2. 2.IBM Almaden Research CenterSan Jose
  3. 3.Siemens Corporate ResearchPrinceton

Personalised recommendations