Abstract
This paper describes a new test collection for passage retrieval from health-related Web resources in Spanish. The test collection contains 10,037 health-related documents in Spanish, 37 topics representing complex information needs formulated in a total of 167 natural language questions, and manual relevance assessments of text passages, pooled from multiple systems. This test collection is the first to combine search in a language beyond English, passage retrieval, and health-related resources and topics targeting the general public.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Allan, J.: HARD track overview in TREC 2004 - high accuracy retrieval from documents. In: Proceedings of TREC 2004 (2004)
Dietz, L., Verma, M., Radlinski, F., Craswell, N.: TREC complex answer retrieval overview. In: Proceedings of TREC 2017 (2017)
Habernal, I., et al.: New collection announcement: focused retrieval over the web. In: Proceedings of ACM SIGIR 2016, pp. 701–704 (2016)
Hersh, W., Cohen, A., Roberts, P., Rekapalli, H.: TREC 2006 genomics track overview. In: Proceedings of TREC 2006 (2006)
Hirschberg, D.S.: The longest common subsequence problem. Ph.D. thesis, Princeton, NJ, USA (1975). aAI7623803
Kamps, J., Geva, S., Trotman, A., Woodley, A., Koolen, M.: Overview of the INEX 2008 Ad Hoc track. In: Geva, S., Kamps, J., Trotman, A. (eds.) INEX 2008. LNCS, vol. 5631, pp. 1–28. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-03761-0_1
Keikha, M., Park, J., Croft, W., Sanderson, M.: Retrieving passages and finding answers. In: Proceedings of ADCS 2014, pp. 81–84. ACM (2014)
Kohlschütter, C., Fankhauser, P., Nejdl, W.: Boilerplate detection using shallow text features. In: Proceedings of ACM WSDM 2010, pp. 441–450 (2010)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositionality. Adv. Neural Inf. Process. Syst. 26, 3111–3119 (2013)
Soboroff, I., Griffitt, K., Strassel, S.: The BOLT IR test collections of multilingual passage retrieval from discussion forums. In: Proceedings of ACM SIGIR 2016, pp. 713–716. ACM (2016)
Suominen, H., et al.: Overview of the CLEF eHealth evaluation lab 2018. In: Bellot, P., et al. (eds.) International Conference of the Cross-Language Evaluation Forum for European Languages, vol. 11018, pp. 286–301. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-98932-7_26
Tsatsaronis, G., Balikas, G., Malakasiotis, P., Partalas, I., et al.: An overview of the BIOASQ large-scale biomedical semantic indexing and question answering competition. BMC Bioinform. 16(1), 138 (2015)
Acknowledgments
This is supported by EU H2020 KRISTINA project (645012) and GR Research-Create-Innovate REA project (T1EDK-00686).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Kamateri, E., Tsikrika, T., Symeonidis, S., Vrochidis, S., Minker, W., Kompatsiaris, Y. (2019). A Test Collection for Passage Retrieval Evaluation of Spanish Health-Related Resources. In: Azzopardi, L., Stein, B., Fuhr, N., Mayr, P., Hauff, C., Hiemstra, D. (eds) Advances in Information Retrieval. ECIR 2019. Lecture Notes in Computer Science(), vol 11438. Springer, Cham. https://doi.org/10.1007/978-3-030-15719-7_19
Download citation
DOI: https://doi.org/10.1007/978-3-030-15719-7_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-15718-0
Online ISBN: 978-3-030-15719-7
eBook Packages: Computer ScienceComputer Science (R0)