Abstract
Discovery layer systems allow library users to obtain search results from multiple library resources and view results in a consistent format. The implementation of a discovery layer is expected to simplify users’ workflow of searching for scholarly information. Previous studies on discovery layer systems focused on functionality and content, but not quality of search results from the user’s perspective. The objective of this study was to obtain users’ assessment of search results of a discovery layer system (Ex Libris Primo®) and compare that with a widely used scholarly search tool (Google Scholar). Results showed that Primo’s search results relevancy is comparable to Google Scholar, but it received significantly lower usability and preference ratings. A number of usability issues of Primo were also identified from the study. Results of the study are used to improve the interface of Primo and adjust relevancy ranking options. The empirical method of search results assessment and feedback collection used in this study can be extended to similar user-centered system implementation and evaluation efforts.
Keywords
References
Williams, S.C., Foster, A.K.: Promise Fulfilled? An EBSCO Discovery Service Usability Study. Journal of Web Librarianship 5, 179–198 (2011)
Fagan, J.C., Mandernach, M., Nelson, C.S., Paulo, J.R., Saunders, G.: Usability Test Results for Discovery Tool in an Academic Library. Information Technology and Libraries 31, 83–112 (2012)
Meier, J.J., Conkling, T.W.: Google Scholar’s Coverage of the Engineering Literature: An Empirical Study. The Journal of Academic Librarianship 34, 196–201 (2008)
Howland, J.L., Wright, T.C., Boughan, R.A., Roberts, B.C.: How Scholarly is Google Scholar? A Comparison to Library Databases. College & Research Libraries 70, 227–234 (2009)
Callicott, B., Vaughn, D.: Google Scholar vs. Library Scholar: Testing the Performance of Schoogle. Internet Reference Services Quarterly 10, 71–88 (2005)
Neuhaus, C., Neuhaus, E., Asher, A., Wrede, C.: The Depth and Breadth of Google Scholar: An Empirical Study. Portal: Libraries and the Academy 6, 127–141 (2006)
Walters, W.H.: Google Scholar Search Performance: Comparative Recall and Precision. Portal: Libraries and the Academy 9, 5–24 (2009)
Herrera, G.: Google Scholar Users and User Behaviors: An Exploratory Study. College & Research Libraries 72, 316–330 (2011)
Becher, M., Schmidt, K.: Taking Discovery Systems for a Test Drive. Journal of Web Librarianship 5, 199–219 (2011)
Ward, J.L., Shadle, S., Mofjeld, P.: User Experience, Feedback, and Testing. Library Technology Reports 44, 17–23 (2008)
Brooke, J.: SUS - A Quick and Dirty Usability Scale. In: Jordan, P.W., Thomas, B., Weerdmeester, B.A., McClelland, A.L. (eds.) Usability Evaluation in Industry. Taylor & Francis, London (1996)
Mussell, J., Croft, R.: Discovery Layers and the Distance Student: Online Search Habits of Students. Journal of Library & Information Services in Distance Learning 7, 18–39 (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, T. (2013). User-Centered Evaluation of a Discovery Layer System with Google Scholar. In: Marcus, A. (eds) Design, User Experience, and Usability. Web, Mobile, and Product Design. DUXU 2013. Lecture Notes in Computer Science, vol 8015. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39253-5_34
Download citation
DOI: https://doi.org/10.1007/978-3-642-39253-5_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39252-8
Online ISBN: 978-3-642-39253-5
eBook Packages: Computer ScienceComputer Science (R0)