Abstract
An important stage in the process of retrieval of objects from a hypertext database is the creation of a set of inter-nodal links that are intended to represent the relationships existing between objects; this operation is often undertaken manually, just as index terms are often manually assigned to documents in a conventional retrieval system. In this paper, a study is reported in which several different sets of links were inserted, each by a different person, between the paragraphs of each of a number of full-text documents. The degree of similarity between the members of each pair of link-sets (i.e., the degree of inter-linker consistency) was then evaluated. The results indicated that little similarity existed amongst the link-sets, a finding that is comparable with those of studies of inter-indexer consistency, which suggest that there is generally only a low level of agreement between the sets of index terms assigned to a document by different indexers. These latter studies have historically been considered significant on account of their common assumption that there exists a positive relationship between recorded levels of inter-indexer consistency and the levels of retrieval effectiveness that may be achieved by the systems studied. In order to test the validity of making a similar assumption in the context of link-assignment, the paper continues with a description of an investigation into the nature of the relationship existing between (i) the levels of inter-linker consistency obtaining among the group of hypertext databases used in our earlier experiments and (ii) the levels of effectiveness of a number of searches carried out in those databases. An account is given of the implementation of the searches and of the methods used in the calculation of numerical values expressing their effectiveness, and conclusions are drawn regarding the consistency-effectiveness relationship.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Waterworth JA, Chignell MB. A model for information exploration. Hypermedia 1991; 3: 35–58
Leonard LE. Inter-indexer consistency and retrieval effectiveness: measurement of relationships. PhD thesis, Graduate School of Library Science, University of Illinois, Urbana-Champaign, IL, 1975
Leonard LE. Inter-indexer consistency studies, 1954–1975: a review of the literature and summary of study results. Graduate School of Library Science, University of Illinois, Urbana-Champaign, IL, 1977 (Occasional paper no. 131)
Ellis D, Fumer-Hines J, Willett P. Measuring the degree of similarity between objects in text retrieval systems. Perspectives in Information Management 1993; 3: 128–149
Willett, P. Similarity and clustering in chemical information systems. Research Studies Press, Letchworth, 1987
Halasz F, Schwartz M. The Dexter hypertext reference model. In: Moline J, Benigni D, Baronas J (eds) Proceedings of the Hypertext Standardization Workshop. NIST, Gaithersburg, MD, 1990, pp 95–113
Botafogo RA, Rivlin E, Shneiderman B. Structural analysis of hypertexts: identifying hierarchies and useful metrics. ACM Transactions on Information Systems 1992; 10: 142–180
Al-Hawamdeh S, Smith G, Willett, P. Paragraph-based access to full-text documents using a hypertext system. Program 1991; 25: 119–131
Savoy J. Effectiveness of information retrieval systems used in a hypertext environment. Hypermedia 1993; 5: 23–46
Hooper RS. Indexer consistency tests—origin, measurements, results and utilization. IBM, Bethesda, MD, 1965
Sievert MC, Andrews MJ. Indexing consistency in Information Science Abstracts. Journal of the American Society for Information Science 1991; 42: 1–6
GUIDE user manual. OWL International, Bellevue, WA, 1990
Wilson RJ. Introduction to graph theory (3rd ed). Longman, London, 1985
Basak SC, Magnuson VR, Niemi GJ, Regal RR, Veith, GD. Topological indices: their nature, mutual relatedness, and applications. Mathematical Modelling 1987; 8: 300–305
Ellis D, Furner-Hines J, Willett P. On the creation of hypertext links in full-text documents: measurement of interlinker consistency. Journal of Documentation 1994; in press
Ellis D, Fumer-Hines J, Willett P. The manual creation of hypertext links in full-text documents. British Library, London, 1994 (BLRDD report); in preparation
Rada R, Murphy C. Searching versus browsing in hypertext. Hypermedia 1992; 4: 1–30
Su LT. Evaluation measures for interactive information retrieval. Information Processing & Management 1992; 28: 503–516
van Rijsbergen CJ. Information retrieval (2nd ed). Butterworths, London, 1979
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1994 Springer-Verlag London Limited
About this paper
Cite this paper
Ellis, D., Furner-Hines, J., Willett, P. (1994). On the Measurement of Inter-Linker Consistency and Retrieval Effectiveness in Hypertext Databases. In: Croft, B.W., van Rijsbergen, C.J. (eds) SIGIR ’94. Springer, London. https://doi.org/10.1007/978-1-4471-2099-5_6
Download citation
DOI: https://doi.org/10.1007/978-1-4471-2099-5_6
Publisher Name: Springer, London
Print ISBN: 978-3-540-19889-5
Online ISBN: 978-1-4471-2099-5
eBook Packages: Springer Book Archive