Abstract
In this chapter we describe an evaluation methodology for cross-language text filtering systems which exploits existing test collections that were designed for monolingual evaluations. Our methodology, based on normative relevance assessments by expert users, is well suited for comparing the effect of different cross-language mapping techniques on filtering accuracy. By measuring the degradation introduced by the use of existing test collections, we are able to qualify the broader applicability of our results and to quantify the improvement in evaluation accuracy that would result from development of a test collection tailored to the evaluation of multilingual text filtering systems. From our experiments we conclude that the additional investment required to produce a truly multilingual test collection would be well justified because evaluation of multilingual text filtering techniques appears to be both practical and productive.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer Science+Business Media New York
About this chapter
Cite this chapter
Oard, D.W., Dorr, B.J. (1998). Evaluating Cross-Language Text Filtering Effectiveness. In: Grefenstette, G. (eds) Cross-Language Information Retrieval. The Springer International Series on Information Retrieval, vol 2. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-5661-9_12
Download citation
DOI: https://doi.org/10.1007/978-1-4615-5661-9_12
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4613-7591-3
Online ISBN: 978-1-4615-5661-9
eBook Packages: Springer Book Archive