Abstract
We investigate extensions of the classical measurement of effectiveness in information retrieval systems, precision and recall, to situations where the answer is modeled by a fuzzy set, such as in cases where each object in the answer is measured by its relevance to the query. The most used fuzzy extension of the classical precision-recall measure based on Zadeh’s relative cardinality appears to be counter-intuitive in some situations. We propose a new approach to the measurement of effectiveness, based on the evaluation of quantified sentences.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Buell and Kraft, 1981a) Buell, D.A. and Kraft, D.H. “A Model for a Weighted
Retrieval Systems“. Journal of the American Society for Information Science 32(3),pp. 211–216.
Buell and Kraft, 1981b) Buell, D.A. and Kraft, D.H. “Performance Measurement in a
Fuzzy Retrieval Enviroment“. In Proc. of the Fourth International Conference on Information Storage and Retrieval,Oakland,CA. ACM/SIGIR Forum, 16(1), pp. 56–62, 1981
(Delgado et.al. 1999) Delgado, M., Sanchez, D. Martin-Bautista, M.J. and Vila, M.A. A Logic Based Definition of Fuzzy Cardinality. Fuzzy Sets and Systems, Submitted.
Delgado, M., Sanchez, D. and Vila, M.A. Fuzzy cardinality based evaluation of quantified sentences. Int. Journal of Approximate Reasoning 23, pp. 2366, 2000.
De Luca, A. and Termini, S. A definition of a nonprobabilistic entropy in the setting of fuzzy sets theory. Information and Control 20, pp. 301–312, 1972.
(Martin-Bautista,2000) Martin-Bautista, M.J., Vila, M.A., Larsen, H.L and Sanchez, D. “Fuzzy Genes: Improving Effectiveness of Information Retrieval”. In Proc. of the IEEE Conference on Evolutionary Computation,San Diego, California. (To appear).
Salton and McGill, 1983) Salton, G. and McGill, M.J. Introduction to Modern Information Retrieval. New York: McGraw-Hill.
Sanchez, D. Adquisicidn de relaciones entre atributos en bases de datos relacionales. Ph. D. Thesis, Dept. of Computer Science and A.I., University of Granada, 1999.
(Sanchez and Pierre, 1994) Sanchez, E. and Pierre, P. “Fuzzy Logic and Genetic Algorithms in Information Retrieval”. In Proc. of the Third International Conference on Fuzzy Logic, Neural Nets and Soft Computing,pp. 29–35, Iizuka, Japan.
Zadeh, 1975) Zadeh, L.A. “The concept of a linguistic variable and its application to
approximate reasoning I, II and III“. Information Sciences, 8,pp. 199–251, 301–357; 9, 43–80.
Zadeh, L.A. A computational approach to fuzzy quantifiers in natural languages. Computing and Mathematics with Applications, 9 (1), pp. 149–184, 1983.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Martín-Bautista, M.J., Sánchez, D., Vila, MA., Larsen, H.L. (2001). Measuring Effectiveness in Fuzzy Information Retrieval. In: Larsen, H.L., Andreasen, T., Christiansen, H., Kacprzyk, J., Zadrożny, S. (eds) Flexible Query Answering Systems. Advances in Soft Computing, vol 7. Physica, Heidelberg. https://doi.org/10.1007/978-3-7908-1834-5_36
Download citation
DOI: https://doi.org/10.1007/978-3-7908-1834-5_36
Publisher Name: Physica, Heidelberg
Print ISBN: 978-3-7908-1347-0
Online ISBN: 978-3-7908-1834-5
eBook Packages: Springer Book Archive