Abstract
This paper evaluates to which extent Google retrieved correct answers as responses to queries inferred from factual and topical requests in a digital Ask-a-Librarian service. 100 factual and 100 topical questions were picked from a digital reference service run by public libraries. The queries inferred simulated average Web queries. The top 10 retrieval results were observed for the answer. The inspection was stopped when the first correct answer was identified. Google retrieved correct answers to 42 % of the topical questions and 29 % of factual questions. Results concerning the characteristics of queries and retrieval effectiveness are also presented. Evaluations indicate that public libraries’ reference services answer correctly 55 % of the questions. Thus, Google is not outperforming Ask-a-Librarian service, although it seems to perform relatively satisfactory in retrieving answers to topical questions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Arnold, J., Kaske, N.: Evaluating the quality of a chat service. Portal 5(2), 177–193 (2005)
Broder, A.: A taxonomy of web search. SIGIR Forum 36(2), 3–10 (2002)
Chu, H., Rosenthal, M.: Search engines for the world wide web: A comparative study and evaluation methodology. In: ASIS 1996 Annual Conference Proceedings (1996)
D’Elia, G., Jörgensen, C., Woelfel, J.: The impact of the Internet on public library use. JASIST 53(10), 802–820 (2002)
Gordon, M., Pathak, P.: Finding information on the world wide web: The retrieval effectiveness of search engines. Information Processing & Management 35(2), 141–180 (1999)
Huysmans, F., Hillebrink, C.: The future of the Dutch public library: Ten years on. SCP, The Hague (2008)
Janes, J., Hill, C., Rolfe, A.: Ask-an-Expert services analysis. JASIST 52(13), 1106–1121 (2001)
Kaske, N., Arnold, J.: An unobtrusive evaluation of online real time library reference services. Paper presented at the Library Research Round Table, ALA Annual Conference, Atlanta, GA. (2002), http://www.lib.umd.edu/groups/digref/LRRT.html
Katz, W.A.: Introduction to reference work, vol. 1. McGraw-Hill, Boston (2002)
Kellar, M., Watters, K., Shepherd, M.: A field study characterizing web-based information seeking tasks. JASIST 58(7), 999–1018 (2007)
Krippendorf, K.: Content analysis. Sage, Thousand Oaks (2004)
Kwon, N.: Public library patrons’ use of collaborative chat reference service: The effectiveness of question answering by question type. Library & Information Science Research 29, 70–91 (2007)
Lancaster, W., Warner, A.: Information retrieval today. Information Resources Press, Arlington (1993)
Leighton, W., Srivastava, J.: First 20 precision among world wide web search services. JASIST 50(10), 870–881 (1999)
Lewandowski, D.: The retrieval effectiveness of web search engines: considering results descriptions. Journal of Documentation 64(6), 915–937 (2008)
McCown, F., Bollen, J., Nelson, M.: Evaluation of the NSDL and Google for obtaining pedagogocal resources. In: Rauber, A., Christodoulakis, S., Tjoa, A.M. (eds.) ECDL 2005. LNCS, vol. 3652, pp. 344–355. Springer, Heidelberg (2005)
Numminen, P., Vakkari, P.: Question types in public libraries’ digital reference service in Finland: Comparing 1999 and 2006. JASIST 60 (2009), http://www3.interscience.wiley.com/journal/122219062/abstract DOI: 10.1002/asi.21047
Rose, D., Levinson, D.: Understanding user goals in web search. In: WWW 2004, New York, May 17-22, 2004, pp. 13–19 (2004)
Sormunen, E.: A method of measuring wide range performance of Boolean queries in full-text databases. Acta Universitatis Tamperensis 748. Tampere University Press (2000)
Spink, A., Jansen, B.: Web search: Public searching of the Web. Kluwer, Dordrecht (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Vakkari, P., Taneli, M. (2009). Comparing Google to Ask-a-Librarian Service for Answering Factual and Topical Questions. In: Agosti, M., Borbinha, J., Kapidakis, S., Papatheodorou, C., Tsakonas, G. (eds) Research and Advanced Technology for Digital Libraries. ECDL 2009. Lecture Notes in Computer Science, vol 5714. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04346-8_34
Download citation
DOI: https://doi.org/10.1007/978-3-642-04346-8_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04345-1
Online ISBN: 978-3-642-04346-8
eBook Packages: Computer ScienceComputer Science (R0)