Abstract
A series of information retrieval experiments was carried out with a computer installed in a medical practice setting for relatively inexperienced physician end-users. Using a commercial MEDLINE product based on the vector space model, these physicians searched just as effectively as more experienced searchers using Boolean searching. The results of this experiment were subsequently used to create a new large medical test collection, which was used in experiments with the SMART retrieval system to obtain baseline performance data as well as compare SMART with the other searchers.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Knowledge Finder Reference Manual.North Andover, MA: Aries Systems Corp., 1988
Hersh W, Hickam D. Impact of a computerized information system in a university general medicine clinic. Clinical Research 1992;40:567A
Salton G, Buckley C. Term-weighting approaches in automatic text retrieval. Info Proc Mgmt 1988; 24 (5): 513–523.
Salton G, Buckley C. Improving retrieval performance by relevance feedback. J Am Soc Info Sci 1990; 41: 288–297.
Belkin N, Cool C, Croft W, Callan J. Effect of multiple query representations on information retrieval system performance. In: Korihage R, Rasmussen E, Willett P, ed. Proceedings of the 16th Annual International ACM Special Interest Group in Information Retrieval. Pittsbrugh, PA: ACM Press, 1993: 339–346.
Fuhr N, Knorz G. Retrieval test evaluation of a rule-based automatic indexing (AIR/PHYS). In: vanRijsbergen C, ed. Research and Development in Information Retrieval. Cambridge: Cambridge University Press,1984: 391–408.
Salton G. A new comparison between conventional indexing (MEDLARS) and automatic text processing (SMART). J Am Soc Info Sci 1972; 23 (2): 75–84.
Salton G, Fox E, Wu H. Extended boolean information retrieval. Comm Assoc Comp Mach 1983; 26: 1022–1036.
Turtle H, Croft W. Evaluation of an inference network-based retrieval model. ACM Transactions on Information Systems 1991; 9: 187–222.
Robertson S, Thompson C. Weighted searching: The CIRT experiment. Informatics 10: Prospects for Intelligent Retrieval. York: ASLIB, 1990: 153–166.
Harman D. Overview of the first Text REtrieval Conference. In: Korthage R, ed. Proceedings of the 16th Annual International ACM Special Interest Group in Information Retrieval. Pittsburgh: ACM Press, 1993: 36–47.
Hersh W, Hickam D. A comparison of two methods for indexing and retrieval from a full-text medical database. Proceedings of the 55th Annual Meeting of the American Society for Information Science. 1992: 221–230.
Hersh W, Hickam D. A performance and failure analysis of SAPHIRE with a MEDLINE test collection. Journal of the American Medical Informatics Association 1994; 1: 51–60.
Haynes R, McKibbon K, Walker C, Ryan N, Fitzgerald D, Ramsden M. Online access to MEDLINE in clinical settings. Ann Int Med 1990; 112 (1): 78–84.
Saracevic T, Kantor P. A study of information seeking and retrieving. III. Searchers, searches, and overlap. J Am Soc Info Sci 1988; 39: 197–216.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1994 Springer-Verlag London Limited
About this paper
Cite this paper
Hersh, W., Buckley, C., Leone, T.J., Hickam, D. (1994). OHSUMED: An Interactive Retrieval Evaluation and New Large Test Collection for Research. In: Croft, B.W., van Rijsbergen, C.J. (eds) SIGIR ’94. Springer, London. https://doi.org/10.1007/978-1-4471-2099-5_20
Download citation
DOI: https://doi.org/10.1007/978-1-4471-2099-5_20
Publisher Name: Springer, London
Print ISBN: 978-3-540-19889-5
Online ISBN: 978-1-4471-2099-5
eBook Packages: Springer Book Archive