MINLIP: Efficient Learning of Transformation Models

  • Vanya Van Belle
  • Kristiaan Pelckmans
  • Johan A. K. Suykens
  • Sabine Van Huffel
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5768)


This paper studies a risk minimization approach to estimate a transformation model from noisy observations. It is argued that transformation models are a natural candidate to study ranking models and ordinal regression in a context of machine learning. We do implement a structural risk minimization strategy based on a Lipschitz smoothness condition of the transformation model. Then, it is shown how the estimate can be obtained efficiently by solving a convex quadratic program with O(n) linear constraints and unknowns, with n the number of data points. A set of experiments do support these findings.


Support vector machines ranking models ordinal regression 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Agarwal, S., Graepel, T., Herbrich, R., Har-Peled, S., Roth, D.: Generalization bounds for the area under the ROC curve. Journal of Machine Learning Research 6, 393–425 (2005)MathSciNetzbMATHGoogle Scholar
  2. 2.
    Breese, J.S., Heckerman, D., Kadie, C.: Empirical Analysis of Predictive Algorithms for Collaborative Filtering. In: Proceedings of the 14th Conference on Uncertainty in Artificial Intelligence, pp. 43–52 (1998)Google Scholar
  3. 3.
    Cheng, S.C., Wei, L.J., Ying, Z.: Predicting Survival Probabilities with Semiparametric Transformation Models. Journal of the American Statistical Association 92(437), 227–235 (1997)MathSciNetCrossRefzbMATHGoogle Scholar
  4. 4.
    Chu, W., Keerthi, S.S.: New approaches to support vector ordinal regression. In: ICML, pp. 145–152 (2005)Google Scholar
  5. 5.
    Clémençon, S., Lugosi, G., Vayatis, N.: Ranking and Scoring Using Empirical Risk Minimization. In: Auer, P., Meir, R. (eds.) COLT 2005. LNCS (LNAI), vol. 3559, pp. 1–15. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  6. 6.
    Dabrowska, D.M., Doksum, K.A.: Partial likelihood in transformation models with censored data. Scandinavian Journal of Statistics 15(1), 1–23 (1988)MathSciNetzbMATHGoogle Scholar
  7. 7.
    Herbrich, R., Graepel, T., Obermayer, K.: Large margin rank boundaries for ordinal regression. In: Advances in Large Margin Classifiers, pp. 115–132. MIT Press, Cambridge (2000)Google Scholar
  8. 8.
    Kalbfleisch, J.D., Prentice, R.L.: The Statistical Analysis of Failure Time Data. Wiley series in probability and statistics. Wiley, Chichester (2002)CrossRefzbMATHGoogle Scholar
  9. 9.
    Koenker, R., Geling, O.: Reappraising Medfly Longevity: A Quantile Regression Survival Analysis. Journal of the American Statistical Association 96(454), 458–468 (2001)MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    Pelckmans, K., Suykens, J.A.K., De Moor, B.: A Risk Minimization Principle for a Class of Parzen Estimators. In: Advances in Neural Information Processing Systems 20, pp. 1–8. MIT Press, Cambridge (2008)Google Scholar
  11. 11.
    Shawe-Taylor, J., Cristianini, N.: Kernel Methods for Pattern Analysis. Cambridge University Press, Cambridge (2004)CrossRefzbMATHGoogle Scholar
  12. 12.
    Suykens, J.A.K., Van Gestel, T., De Brabanter, J., De Moor, B., Vandewalle, J.: Least Squares Support Vector Machines. World Scientific, Singapore (2002)CrossRefzbMATHGoogle Scholar
  13. 13.
    Van Belle, V., Pelckmans, K., Suykens, J.A.K., Vanhuffel, S.: Support Vector Machines for Survival Analysis. In: Proceedings of the Third International Conference on Computational Intelligence in Medicine and Healthcare, CIMED, Plymouth, UK, July 25-27, pp. 1–6 (2007)Google Scholar
  14. 14.
    Vapnik, V.N.: Statistical Learning Theory. Wiley and Sons, Chichester (1998)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Vanya Van Belle
    • 1
  • Kristiaan Pelckmans
    • 1
  • Johan A. K. Suykens
    • 1
  • Sabine Van Huffel
    • 1
  1. 1.Katholieke Universiteit Leuven, ESAT-SCDLeuvenBelgium

Personalised recommendations