Definition
In Classification learning, an algorithm is presented with a set of classified examples or “instances” from which it is expected to infer a way of classifying unseen instances into one of several “classes”. Instances have a set of features or “attributes” whose values define that particular instance. Numeric prediction, or “regression,” is a variant of classification learning in which the class attribute is numeric rather than categorical. Classification learning is sometimes called supervised because the method operates under supervision by being provided with the actual outcome for each of the training instances. This contrasts with clustering where the classes are not given, and with association learning which seeks any association – not just one that predicts the class.
Historical Background
Classification learning grew out of two strands of...
Recommended Reading
Breiman L, Friedman JH, Olshen RA, Stone CJ. Classification and regression trees. Pacific Grove: Wadsworth; 1984.
Bush RR, Mosteller F. Stochastic models for learning. New York: Wiley; 1955.
Holte RC. Very simple classification rules perform well on most commonly used datasets. Mach Learn. 1993;11:63–91.
Kononebko I. ID3, sequential Bayes, naïve Bayes and Bayesian neural networks. In: Proceedings of 4th European Working Session on Learning; 1989. p. 91–8.
Maron ME, Kuhns JL. On relevance, probabilistic indexing and information retrieval. J ACM. 1960;7(3):216–44.
Minsky ML, Papert S. Perceptrons. Cambridge: MIT Press; 1969.
Nilsson NJ. Learning machines. New York: McGraw-Hill; 1965.
Quinlan JR. Induction of decision trees. Mach Learn. 1986;1(1):81–106.
Quinlan JR. C4.5: programs for machine learning. San Francisco: Morgan Kaufmann; 1993.
Rosenblatt F. Principles of neurodynamics. Washington, DC: Spartan; 1961.
Witten IH, Frank E. Data mining: practical machine learning tools and techniques. 2nd ed. San Francisco: Morgan Kaufmann; 2003.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Section Editor information
Rights and permissions
Copyright information
© 2016 Springer Science+Business Media New York
About this entry
Cite this entry
Witten, I.H. (2016). Classification. In: Liu, L., Özsu, M. (eds) Encyclopedia of Database Systems. Springer, New York, NY. https://doi.org/10.1007/978-1-4899-7993-3_552-2
Download citation
DOI: https://doi.org/10.1007/978-1-4899-7993-3_552-2
Received:
Accepted:
Published:
Publisher Name: Springer, New York, NY
Online ISBN: 978-1-4899-7993-3
eBook Packages: Springer Reference Computer SciencesReference Module Computer Science and Engineering