Synonyms
IDF
Definition
The inverse document frequency (IDF) is a statistical weight used for measuring the importance of a term in a text document collection. The document frequency DF of a term is defined by the number of documents in which a term appears.
Key Points
Karen Sparck-Jones first proposed that terms with low document frequency are more valuable than terms with high document frequency during retrieval [2]. In other words, the underlying idea of IDF is that the more frequently the term appears in the collection, the less informative the term is.
In its simplest form, the IDF weight of a term is assigned as follows [3]:
where N is the number of documents in the collection, and DF is the document frequency of the term, i.e., the number of documents in which the term appears.
There have been different variations of the IDF weight in the literature. For example, Robertson and Walker proposed the following formula [1]:...
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Recommended Reading
Robertson SE, Walker S. On relevance weights with little relevance information. In: Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval; 1997. p. 16–24.
Sparck-Jones K. A statistical interpretation of term specificity and its application in retrieval. J Doc. 1972;28(1):11–20.
Sparck-Jones K. Index term weighting. Inf Storage Retr. 1973;9(11):619–33.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Section Editor information
Rights and permissions
Copyright information
© 2018 Springer Science+Business Media, LLC, part of Springer Nature
About this entry
Cite this entry
Ounis, I. (2018). Inverse Document Frequency. In: Liu, L., Özsu, M.T. (eds) Encyclopedia of Database Systems. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8265-9_933
Download citation
DOI: https://doi.org/10.1007/978-1-4614-8265-9_933
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-8266-6
Online ISBN: 978-1-4614-8265-9
eBook Packages: Computer ScienceReference Module Computer Science and Engineering