Abstract
This paper reviews the supervised learning versions of the no-free-lunch theorems in a simplified form. It also discusses the significance of those theorems, and their relation to other aspects of supervised learning.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Buntine, W., and A. Weigend. “Bayesian Back-Propagation.” Complex Systems 5 (1991): 603–643.
Dietterich, T. “Machine Learning.”Ann. Rev. Comp. Sci..4 (1990): 255–306.
Duda, R.O., P.E. Hart, and D.G. Stork.Pattern Classification (2nd ed.). Wiley & Sons, 2000.
Blumer, A., A. Ehrenfeueht, D. Haussler, and M. Warmuth. “Occam’s Razor.”Info. Proc. Lett.24 (1987): 377–380.
Titterington, A., F. Smith, and V. E. Makov.Statistical Analysis of Finite Mixture Distributions. New York: Wiley & Sons, 1985.
Neal, R. “Priors for Infinite Networks.” Technical Report CRG-TR-94–1, Department of Computer Science, University of Toronto, 1994.
Weiss, S. M., and C. A. Kulikowski.Computer Systems that Learn. San Mateo, CA: Morgan Kauffman, 1991.
Wolpert, D. “Filter Likelihoods and Exhaustive Learning.” To appear in Computational Learning Theory and Natural Learning Systems. Volume II: Natural Learning Systems, edited by S. Hanson et al. Cambridge, MA: MIT Press, 1994.
Wolpert, D. “On the Connection Between In-Sample Testing and Generalization Error.” Complex Systems 6 (1992): 47–94.
Wolpert, D. “Bayesian Back-propagation over I-O Functions Rather than Weights.” in Neural Information Processing Systems 6, edited by S. Hanson et al. San Mateo, CA: Morgan-Kauffman, 1994.
Wolpert, D. “The Relationship Between PAC, the Statistical Physics Framework, the Bayesian Framework, and the VC Framework”, In The Mathematics of Generalization, edited by D. H. Wolpert, Addison-Wesley, Reading MA, 1995.
Wolpert, D. “The Lack of a priori Distinctions between Learning Algorithms and the Existence of a priori Distinctions between Learning Algorithms” Neural Computation 8 (1996): 1341–1390, 1391–1421.
Wolpert, D. The Mathematics of Generalization, edited by D. H. Wolpert Addison-Wesley, Reading MA, 1995.
Wolpert, D. “On Bias Plus Variance” Neural Computation 9 (1996): 1211–1244.
Wolpert, D. “Reconciling Bayesian and Non-Bayesian Analysis”, in Maximum Entropy and Bayesian Methods, edited by G. Heidbreder. Boston: Kluwer, 1994.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag London
About this chapter
Cite this chapter
Wolpert, D.H. (2002). The Supervised Learning No-Free-Lunch Theorems. In: Roy, R., Köppen, M., Ovaska, S., Furuhashi, T., Hoffmann, F. (eds) Soft Computing and Industry. Springer, London. https://doi.org/10.1007/978-1-4471-0123-9_3
Download citation
DOI: https://doi.org/10.1007/978-1-4471-0123-9_3
Publisher Name: Springer, London
Print ISBN: 978-1-4471-1101-6
Online ISBN: 978-1-4471-0123-9
eBook Packages: Springer Book Archive