Abstract
In this paper we propose several merging strategies to integrate the result lists of each intermediate run in distributed MLIR. The prediction of retrieval effectiveness was used to adjust the similarity scores of documents in the result lists. We introduced three factors affecting the retrieval effectiveness, i.e., the degree of translation ambiguity, the number of unknown words and the number of relevant documents in a collection for a given query. The results showed that the normalized-by-top-k merging with translation penalty and collection weight outperformed the other merging strategies except for the raw-score merging.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Braschler, M., Göhring, A., Schäuble, P.: Eurospider at CLEF 2002. In: Peters, C. (ed.) Working Notes for the CLEF 2002 Workshop, pp. 127–132 (2002)
Callan, J.P., Lu, Z., Croft, W.B.: Searching Distributed Collections With Inference Networks. In: Fox, E.A., Ingwersen, P., Fidel, R. (eds.) Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 21–28. ACM Press, New York (1995)
Chen, A.: Cross-language Retrieval Experiments at CLEF 2002. In: Peters, C. (ed.) Working Notes for the CLEF 2002 Workshop, pp. 5–20 (2002)
Lin, W.C., Chen, H.H.: NTU at NTCIR3 MLIR Task. In: Kishida, K., Ishida, E. (eds.) Working Notes of the Third NTCIR Workshop Meeting. Part II: Cross Lingual Information Retrieval Task, pp. 101–105. National Institute of Informatics, Tokyo, Japan (2002)
Lin, W.C., Chen, H.H.: Merging Mechanisms in Multilingual Information Retrieval. In: Peters, C. (ed.) Working Notes for the CLEF 2002 Workshop, pp. 97–102 (2002)
Moulinier, I., Molina-Salgado, H.: Thomson Legal and Regulatory experiments for CLEF 2002. In: Peters, C. (ed.) Working Notes for the CLEF 2002 Workshop, pp. 91–96 (2002)
Oard, D., Diekema, A.: Cross-Language Information Retrieval. Annual Review of Information Science and Technology 33, 223–256 (1998)
Peters, C. (ed.): Working Notes for the CLEF 2002 Workshop (2002)
Robertson, S.E., Walker, S., Beaulieu, M.: Okapi at TREC-7: automatic ad hoc, filtering, VLC and interactive. In: Voorhees, E.M., Harman, D.K. (eds.) Proceedings of the Seventh Text REtrieval Conference (TREC-7). National Institute of Standards and Technology, pp. 253–264 (1998)
Savoy, J.: Report on CLEF-2001 Experiments: Effective Combined Query-Translation Approach. In: Peters, C., Braschler, M., Gonzalo, J., Kluck, M. (eds.) CLEF 2001. LNCS, vol. 2406, pp. 27–43. Springer, Heidelberg (2002)
Savoy, J.: Report on CLEF-2002 Experiments: Combining Multiple Sources of Evidence. In: Peters, C. (ed.) Working Notes for the CLEF 2002 Workshop, pp. 31–46 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lin, WC., Chen, HH. (2004). Merging Results by Predicted Retrieval Effectiveness. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds) Comparative Evaluation of Multilingual Information Access Systems. CLEF 2003. Lecture Notes in Computer Science, vol 3237. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30222-3_19
Download citation
DOI: https://doi.org/10.1007/978-3-540-30222-3_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-24017-4
Online ISBN: 978-3-540-30222-3
eBook Packages: Springer Book Archive