Skip to main content

Classification

  • Living reference work entry
  • First Online:
Encyclopedia of Database Systems
  • 79 Accesses

Synonyms

Classification learning; Concept learning; Learning with a teacher; Statistical decision techniques; Supervised learning

Definition

In Classification learning, an algorithm is presented with a set of classified examples or “instances” from which it is expected to infer a way of classifying unseen instances into one of several “classes”. Instances have a set of features or “attributes” whose values define that particular instance. Numeric prediction, or “regression,” is a variant of classification learning in which the class attribute is numeric rather than categorical. Classification learning is sometimes called supervised because the method operates under supervision by being provided with the actual outcome for each of the training instances. This contrasts with clustering where the classes are not given, and with association learning which seeks any association – not just one that predicts the class.

Historical Background

Classification learning grew out of two strands of...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Recommended Reading

  1. Breiman L, Friedman JH, Olshen RA, Stone CJ. Classification and regression trees. Pacific Grove: Wadsworth; 1984.

    MATH  Google Scholar 

  2. Bush RR, Mosteller F. Stochastic models for learning. New York: Wiley; 1955.

    Book  MATH  Google Scholar 

  3. Holte RC. Very simple classification rules perform well on most commonly used datasets. Mach Learn. 1993;11:63–91.

    Article  MATH  Google Scholar 

  4. Kononebko I. ID3, sequential Bayes, naïve Bayes and Bayesian neural networks. In: Proceedings of 4th European Working Session on Learning; 1989. p. 91–8.

    Google Scholar 

  5. Maron ME, Kuhns JL. On relevance, probabilistic indexing and information retrieval. J ACM. 1960;7(3):216–44.

    Article  Google Scholar 

  6. Minsky ML, Papert S. Perceptrons. Cambridge: MIT Press; 1969.

    MATH  Google Scholar 

  7. Nilsson NJ. Learning machines. New York: McGraw-Hill; 1965.

    MATH  Google Scholar 

  8. Quinlan JR. Induction of decision trees. Mach Learn. 1986;1(1):81–106.

    Google Scholar 

  9. Quinlan JR. C4.5: programs for machine learning. San Francisco: Morgan Kaufmann; 1993.

    Google Scholar 

  10. Rosenblatt F. Principles of neurodynamics. Washington, DC: Spartan; 1961.

    Google Scholar 

  11. Witten IH, Frank E. Data mining: practical machine learning tools and techniques. 2nd ed. San Francisco: Morgan Kaufmann; 2003.

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ian H. Witten .

Editor information

Editors and Affiliations

Section Editor information

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer Science+Business Media New York

About this entry

Cite this entry

Witten, I.H. (2016). Classification. In: Liu, L., Özsu, M. (eds) Encyclopedia of Database Systems. Springer, New York, NY. https://doi.org/10.1007/978-1-4899-7993-3_552-2

Download citation

  • DOI: https://doi.org/10.1007/978-1-4899-7993-3_552-2

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, New York, NY

  • Online ISBN: 978-1-4899-7993-3

  • eBook Packages: Springer Reference Computer SciencesReference Module Computer Science and Engineering

Publish with us

Policies and ethics