Abstract
The objective of the Topic Detection and Tracking (TDT) program is to develop technologies that search, organize and structure multilingual, news oriented textual materials from a variety of broadcast news media. This research program uses controlled laboratory simulations of hypothetical systems to test the efficacy of potential technologies, to gauge research progress, and to provide a forum for the exchange of research information. This chapter introduces TDT’s evaluation methodology including: the Linguistic Data Consortium’s TDT corpora, evaluation metrics used in TDT and the five TDT research tasks: Topic Tracking, Link Detection, Topic Detection, First Story Detection, and Story Segmentation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Voorhees, E, Harman, D., “Overview of the Eighth Text REtrieval Conference (TREC-8)”, NIST Special Publication 500–246: The Eighth Text REtrieval Conference (TREC 8)
Fiscus, J., Doddington, G., Garofolo, J., and Martin, A., “NIST’s 1998 Topic Detection and Tracking Evaluation (TDT)”, Fifth European Conf. On Speech Comm. and Tech., Vol. 4, pp. 247–250.
Fiscus, J., and Doddington, G., Results of the 1999 Topic Detection and Tracking Evaluation in Mandarin and English, 6th International Conference on Spoken Language Processing, October 2000, Beijing China, SS(06) –05, paper 320.
TDT Homepage at the National Institute of Standards and Technology, http://www.nist.gov/TDT
Cieri, C., Graff, D., Libermann, M., Martey, N., Strassel, S., “Large, Multilingual, Broadcast News Corpora for Cooperative Research in Topic Detection and Tracking: The TDT-2 and TDT-3 Corpus Efforts”, Second International Conference on Language Resources and Evaluation, 31 May - 2 June, 2000, pp. 925–930.
Linguistic Data Consortium TDT Corpora Homepage, http://www.ldc.upenn.edu/Projects/TDT
Martin, A., Doddington, G., Kamm, T., Ordowski, M., Przybocki, M., “The DET Curve in Assessment of Detection Task Performance”, Eurospeech 1997, Proceedings Volume #4 Pages 1895–1898
Beeferman, D., Berger, A., and Lafferty, J., Text Segmentation Using Exponential Models, In Proceedings of the Second Conference on Empirical Methods in Natural Language Processing, pp. 35–46. 1997
TDT 2000 Evaluation Website, (Includes presentations and papers) http://www.nist.gov
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer Science+Business Media New York
About this chapter
Cite this chapter
Fiscus, J.G., Doddington, G.R. (2002). Topic Detection and Tracking Evaluation Overview. In: Allan, J. (eds) Topic Detection and Tracking. The Information Retrieval Series, vol 12. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-0933-2_2
Download citation
DOI: https://doi.org/10.1007/978-1-4615-0933-2_2
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4613-5311-9
Online ISBN: 978-1-4615-0933-2
eBook Packages: Springer Book Archive