Abstract
Novelty detection systems aim at reducing redundant documents or sentences from a list of documents chronologically ordered. In the task, sentences appearing later in the list with no new meanings are eliminated. In an accompanying paper, the nature of novelty detection was revealed – Novelty as a combination of the PO (partial overlap) and CO (complete overlap) relations, which can be treated as two classification tasks; theoretical impacts were given. This paper provides what the nature of the task mean empirically. One new method – selected pool – implementing the nature of the task gained improvements on TREC Novelty datasets. New evaluation criteria are given, which are natural from the viewpoint of the nature of novelty detection.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Harman, D.: Overview of the trec 2002 novelty track. In: Proceedings of TREC 2002 (2003)
Salton, G., Buckley, C.: Term weighting approaches in automatic text retrieval. Information Processing and Management 24(5), 513–523 (1988)
Soboroff, I.: Draft overview of the trec 2004 novelty track. In: Proceedings of TREC 2004 (Notebook) (2004)
Soboroff, I., Harman, D.: Overview of the trec 2003 novelty track. In: Proceedings TREC 2003 (2004)
Zhang, M., Lin, C., Liu, Y., Zhao, L., Ma, S.: THUIR at trec 2003: Novelty, robust and web. In: Proceedings of TREC 2003, pp. 556–567 (2004)
Zhang, M., Song, R., Lin, C., Jiang, Z., Jin, Y., Liu, Y., Zhao, L., Ma, S.: Expansion-based technologies in finding relevant and new information: Thu trec2002 novelty track experiments. In: Proceedings of TREC 2002 (2003)
Zhang, Y., Callan, J., Minka, T.: Novelty and redundancy detection in adaptive filtering. In: Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR 2002), pp. 81–88 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhao, L., Zhang, M., Ma, S. (2005). The Empirical Impact of the Nature of Novelty Detection. In: Lee, G.G., Yamada, A., Meng, H., Myaeng, S.H. (eds) Information Retrieval Technology. AIRS 2005. Lecture Notes in Computer Science, vol 3689. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11562382_40
Download citation
DOI: https://doi.org/10.1007/11562382_40
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29186-2
Online ISBN: 978-3-540-32001-2
eBook Packages: Computer ScienceComputer Science (R0)