Learning Preference Relations from Data

  • Theodoros Evgniou
  • Massimiliano Pontil
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2486)


A number of learning tasks can be solved robustly using key concepts from statistical learning theory. In this paper we first summarize the main concepts of statistical learning theory, a framework in which certain learning from examples problems, namely classification, regression, and density estimation, have been studied in a principled way. We then show how the key concepts of the theory can be used not only for these standard learning from examples problems, but also for many others. In particular we discuss how to learn functions which model a preference relation. The goal is to illustrate the value of statistical learning theory beyond the standard framework it has been used until now.


Statistical learning theory Preference relations 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Ben-Akiva, M. E. and S. R. Lerman. Discrete Choice Analysis: Theory and Application to Travel Demand. MIT Press, Cambridge, Ma., 1995.Google Scholar
  2. [2]
    Alon, N., S. Ben-David, N. Cesa-Bianchi, and D. Haussler. ‘Scale-sensitive dimensions, uniform convergence, and learnability’. Symposium on Foundations of Computer Science, 1993.Google Scholar
  3. [3]
    Carroll, J. D. and P. Green. “Psychometric Methods in Marketing Research: Part I, Conjoint Analysis”. Journal of Marketing Research, 32, November 1995, p. 385–391.Google Scholar
  4. [4]
    Cortes, C. and V. Vapnik. “Support Vector Networks’. Machine Learning 20, 1–25, 1995.Google Scholar
  5. [5]
    Devroye, L., L. Györfi, and G. Lugosi. A Probabilistic Theory of Pattern Recognition, No. 31 in Applications of mathematics. New York: Springer, 1996.zbMATHGoogle Scholar
  6. [6]
    Evgeniou, T., M. Pontil, and T. Poggio. “Regularization Networks and Support Vector Machines’. Adv. In Computational Mathematics, 13, pp 1–50, 2000.zbMATHMathSciNetGoogle Scholar
  7. [7]
    Girosi, F., M. Jones, and T. Poggio. “Regularization theory and neural networks architectures”. Neural Computation 7, 219–269, 1995.CrossRefGoogle Scholar
  8. [8]
    Green, P. and V. Srinivasan. “Conjoint Analysis in Marketing: New Developments with Implications for Research and Practice” Journal of Marketing, 54,4, p. 3–19, 1990.CrossRefGoogle Scholar
  9. [9]
    Jaakkola, T. and D. Haussler. “Probabilistic Kernel Regression Models”. In: Proc. of Neural Information Processing Conference, 1998.Google Scholar
  10. [10]
    Kearns, M. and R. Shapire “Efficient distribution-free learning of probabilistic concepts” Journal of Computer and Systems Sciences 48(3), 464–497, 1994.zbMATHCrossRefGoogle Scholar
  11. [11]
    Oppewal, H., J. Louviere, and H. Timmermans. “Modeling Hierarchical Conjoint Processes with Integrated Choice Experiments” Journal of Marketing Research, 31, p. 92–105, 1994.CrossRefGoogle Scholar
  12. [12]
    Sawtooth Software, ‘HB-Reg: Hierarchical Bayes Regression’. URL:
  13. [13]
    Srinivasan, V., A. Jain, and N. Malhotra. “Improving the Predictive Power of Conjoint Analysis by Constrained Parameter Estimation” Journal of Marketing Research, 20,(November), p. 433–438, 1983. [14] Srinivasan, V. and A. Shocker. “Linear Programming Techniques for Multidimensional Analysis of Preferences” Psychometrica, 38,3, p. 337-369, 1973.CrossRefGoogle Scholar
  14. [15]
    Stone, C. J. “Additive Regression and Other Nonparametric Models” Annals of Statistics, 13, p. 689–705, 1985.zbMATHMathSciNetCrossRefGoogle Scholar
  15. [16]
    Tikhonov, A. N. and V. Y. Arsenin. Solutions of Ill-posed Problems. Washington, D. C.: W. H. Winston, 1977.zbMATHGoogle Scholar
  16. [17]
    Vapnik, V. N. Statistical Learning Theory. New York: Wiley, 1998.zbMATHGoogle Scholar
  17. [18]
    Vapnik, V. N. and A. Y. Chervonenkis. “On the Uniform Convergence of Relative Frequencies of events to their probabilities”. Th. Prob. and its Applications 17(2), 264–280, 1971.CrossRefMathSciNetGoogle Scholar
  18. [19]
    Wahba, G. Splines Models for Observational Data. Philadelphia: Series in Applied Mathematics, Vol. 59, SIAM, 1990.Google Scholar
  19. [20]
    Wittink, D. and P. Cattin. “Commercial Use of Conjoint Analysis: An Update” Journal of Marketing, 53,3, p. 91–96, 1989.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Theodoros Evgniou
    • 1
  • Massimiliano Pontil
    • 2
  1. 1.Dipartimento di Ingegneria dell’InformazioneSienaItaly
  2. 2.Technology Management DepartmentINSEADFontainebleauFrance

Personalised recommendations