Usability Modeling of Academic Search User Interface

  • Tsangyao ChenEmail author
  • Melissa Gross
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10290)


Usability is a core concept in HCI and is a common quality attribute for the design and evaluation of interactive systems. However, usability is a fluid construct and requires context-specific frameworks to be clearly defined and operationalized. Academic search user interfaces (SUIs) include the search portals of academic and research libraries, digital data repositories, academic data aggregators, and commercial publishers. In addition to information lookup, academic SUIs serve scientific information seeking in learning, exploration, and problem-solving.

Researchers in library and information science (LIS) have intensively studied information seeking behavior. In recent years, exploratory search has gained attention from LIS researchers and experimental SUI features are prototyped to support information seeking. In the meantime, many academic and research libraries have conducted usability evaluation and adopted discovery systems as part of SUIs. However, there is a lack of context-specific usability models for guiding academic SUI implementation and evaluation.

This study takes the perspectives of information seeking tasks and usability contextualization to propose a formative conceptual framework of academic SUI usability. Information seeking tasks from information seeking and behavior models are integrated based on the exploratory search paradigm. Information seeking tasks are mapped to the layered usability construct to shows how academic information seeking tasks may be supported to achieve high usability. Future studies should focus on developing contextualized academic SUI usability models with measurement metrics to guide the empirical implementation and evaluation of academic SUIs.


Usability Search user interface (SUI) Academic search Conceptual modeling Information seeking 


  1. 1.
    Swanson, T.A., Green, J.: Why we are not Google: lessons from a library web site usability study. J. Acad. Librariansh. 37, 222–229 (2011)CrossRefGoogle Scholar
  2. 2.
    Gooding, P.: Exploring the information behaviour of users of Welsh Newspapers Online through web log analysis. J. Doc. 72, 232–246 (2016)CrossRefGoogle Scholar
  3. 3.
    Kroll, S., Forsman, R.: A Slice of Research Life: Information Support for Research in the United States. OCLC Research, Dublin (2010)Google Scholar
  4. 4.
    Nel, M.A., Fourie, I.: Information behavior and expectations of veterinary researchers and their requirements for academic library services. J. Acad. Librariansh. 42, 44–54 (2016)CrossRefGoogle Scholar
  5. 5.
    Bates, M.J.: Many paths to theory: the creative process in the information sciences. In: Sonnenwald, D.H. (ed.) Theory Development in the Information Sciences, pp. 21–49. University of Texas Press, Austin (2016)Google Scholar
  6. 6.
    Wilson, M.L., Kules, B., Schraefel, M.C., Shneiderman, B.: From keyword search to exploration: designing future search interfaces for the web. Found. Trends® Web Sci. 2, 1–97 (2010)CrossRefzbMATHGoogle Scholar
  7. 7.
    Chen, Y.-H., Germain, C.A., Yang, H.: An exploration into the practices of library web usability in ARL academic libraries. J. Am. Soc. Inf. Sci. Technol. 60, 953–968 (2009)CrossRefGoogle Scholar
  8. 8.
    Faulkner, L.: Beyond the five-user assumption: benefits of increased sample sizes in usability testing. Behav. Res. Methods Instrum. Comput. 35, 379–383 (2003)CrossRefGoogle Scholar
  9. 9.
    Hornbæk, K.: Current practice in measuring usability: challenges to usability studies and research. Int. J. Hum.-Comput. Stud. 64, 79–102 (2006)CrossRefGoogle Scholar
  10. 10.
    Jackson, A., Lin, J., Milligan, I., Ruest, N.: Desiderata for exploratory search interfaces to web archives in support of scholarly activities. Presented at the (2016)Google Scholar
  11. 11.
    Shneiderman, B.: The eyes have it: a task by data type taxonomy for information visualizations. In: Proceedings IEEE Symposium on Visual Languages, pp. 336–343. IEEE Computer Society, Boulder (1996)Google Scholar
  12. 12.
    Hearst, M.A., Smalley, P., Chandler, C.: Faceted metadata for information architecture and search. In: CHI Course for CHI. ACM, Montréal (2006)Google Scholar
  13. 13.
    Glowacka, D., Ruotsalo, T., Konuyshkova, K., Kaski, S., Jacucci, G.: Directing exploratory search: reinforcement learning from user interactions with keywords. In: Proceedings of the 2013 International Conference on Intelligent User Interfaces, pp. 117–128. ACM (2013)Google Scholar
  14. 14.
    Medlar, A., Ilves, K., Wang, P., Buntine, W., Glowacka, D.: PULP: a system for exploratory search of scientific literature. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1133–1136. ACM, New York (2016)Google Scholar
  15. 15.
    Singh, J., Nejdl, W., Anand, A.: Expedition: a time-aware exploratory search system designed for scholars. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1105–1108. ACM, New York (2016)Google Scholar
  16. 16.
    Bourg, C., Coleman, R., Erway, R.: Support for the Research Process: An Academic Library Manifesto. OCLC Research, Dublin (2009)Google Scholar
  17. 17.
    Shneiderman, B., Plaisant, C.: Designing the User Interface: Strategies for Effective Human-Computer Interaction. Pearson Education, Inc., Upper Saddle River (2005)Google Scholar
  18. 18.
    Ahmed, S.M.Z., McKnight, C., Oppenheim, C.: A review of research on human-computer interfaces for online information retrieval systems. Electron. Libr. 27, 96–116 (2009)CrossRefGoogle Scholar
  19. 19.
    Pettigrew, K.E., McKechnie, L.E.F.: The use of theory in information science research. J. Am. Soc. Inf. Sci. Technol. 52, 62–73 (2001)CrossRefGoogle Scholar
  20. 20.
    U.S. Department of Health and Human Services.
  21. 21.
    Merholz, P.: Peter in conversation with Don Norman about UX & innovation (2007).
  22. 22.
    Bevan, N., Macleod, M.: Usability measurement in context. Behav. Inf. Technol. 13, 132–145 (1994)CrossRefGoogle Scholar
  23. 23.
    Borgman, C.L.: Designing digital libraries for usability. In: Bishop, A.P., House, N.A.V., Buttenfield, B.P. (eds.) Digital Library Use: Social Practice in Design and Evaluation, pp. 85–118. The MIT Press, Cambridge (2003)Google Scholar
  24. 24.
    Bevan, N., Carter, J., Harker, S.: ISO 9241-11 revised: what have we learnt about usability since 1998? In: Kurosu, M. (ed.) HCI 2015. LNCS, vol. 9169, pp. 143–151. Springer, Cham (2015). doi: 10.1007/978-3-319-20901-2_13 CrossRefGoogle Scholar
  25. 25.
    International Standards Organization: ISO 9241-11:1998(en), Ergonomic requirements for office work with visual display terminals (VDTs) — Part 11: Guidance on usability.
  26. 26.
    Nielsen, J.: Heuristic evaluation. In: Nielsen, J., Mack, R.L. (eds.) Usability Inspection Methods, pp. 25–62. Wiley, New York (1994)Google Scholar
  27. 27.
    Nielsen, J.: Usability 101: Introduction to Usability.
  28. 28.
    Folmer, E., Bosch, J.: Architecting for usability: a survey. J. Syst. Softw. 70, 61–78 (2004)CrossRefGoogle Scholar
  29. 29.
    Heradio, R., Fernandez-Amoros, D., Javier Cabrerizo, F., Herrera-Viedma, E.: A review of quality evaluation of digital libraries based on users’ perceptions. J. Inf. Sci. 38, 269–283 (2012)CrossRefGoogle Scholar
  30. 30.
    Alonso-Ríos, D., Vázquez-García, A., Mosqueira-Rey, E., Moret-Bonillo, V.: Usability: a critical analysis and a taxonomy. Int. J. Hum.-Comput. Interact. 26, 53–74 (2009)CrossRefGoogle Scholar
  31. 31.
    Seffah, A., Donyaee, M., Kline, R.B., Padda, H.K.: Usability measurement and metrics: a consolidated model. Softw. Qual. J. 14, 159–178 (2006)CrossRefGoogle Scholar
  32. 32.
    Alshamari, M., Mayhew, P.: Technical review: current issues of usability testing. IETE Tech. Rev. 26, 402–406 (2009)CrossRefGoogle Scholar
  33. 33.
    Hornbæk, K., Law, E.L.-C.: Meta-analysis of correlations among usability measures. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 617–626. ACM (2007)Google Scholar
  34. 34.
    Fidel, R.: Human Information Interaction: An Ecological Approach to Information Behavior. MIT Press, Cambridge (2012)CrossRefGoogle Scholar
  35. 35.
    Chin, J.P., Diehl, V.A., Norman, K.L.: Development of an instrument measuring user satisfaction of the human-computer interface. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 213–218. ACM, New York (1988)Google Scholar
  36. 36.
    Perlman, G.: Questionnaire for User Interface Satisfaction.
  37. 37.
    Lin, H.X., Choong, Y.Y., Salvendy, G.: A proposed index of usability: a method for comparing the relative usability of different software systems. Behav. Inf. Technol. 16, 267–277 (1997)CrossRefGoogle Scholar
  38. 38.
    Brooke, J.: SUS: a quick and dirty usability scale. In: Jordan, P.W., Thomas, B., Weerdmeester, B.A., McClelland, I.L. (eds.) Usability Evaluation in Industry, pp. 189–194. Taylor & Francis, Milton Park (1996)Google Scholar
  39. 39.
    Vilar, P.: Information behaviour of scholars. Libellarium J. Hist. Writ. 7, 17–39 (2015)CrossRefGoogle Scholar
  40. 40.
    Pennington, B.: ERM UX: electronic resources management and the user experience. Ser. Rev. 41, 194–198 (2015)CrossRefGoogle Scholar
  41. 41.
    Teague-Rector, S., Ballard, A., Pauley, S.K.: The North Carolina State University libraries search experience: usability testing tabbed search interfaces for academic libraries. J. Web Librariansh. 5, 80–95 (2011)CrossRefGoogle Scholar
  42. 42.
    Khabsa, M., Wu, Z., Giles, C.L.: Towards better understanding of academic search. Presented at the (2016)Google Scholar
  43. 43.
    Carpenter, J., Wetheridge, L., Tanner, S.: Researchers of tomorrow: the research behaviour of Generation Y docotral students. British Library and Joint Information Systems Committee (JISC) of the Higher Education Funding Council (HEFCE) (2012)Google Scholar
  44. 44.
    Wilson, T.D.: Models in information behaviour research. J. Doc. 55, 249–270 (1999)CrossRefGoogle Scholar
  45. 45.
    Ingwersen, P.: Cognitive perspectives of information retrieval interaction: elements of a cognitive IR theory. J. Doc. 52, 3–50 (1996)CrossRefGoogle Scholar
  46. 46.
    Saracevic, T.: The stratified model of information retrieval interaction: extension and applications. In: Proceedings of the Annual Meeting-American Society for Information Science, pp. 313–327. Learned Information (Europe) Ltd. (1997)Google Scholar
  47. 47.
    Bates, M.J.: Where should the person stop and the information search interface start? Inf. Process. Manag. 26, 575–591 (1990)CrossRefGoogle Scholar
  48. 48.
    Bates, M.J.: The design of browsing and berrypicking techniques for the online search interface. Online Rev. 13, 407–524 (1989)CrossRefGoogle Scholar
  49. 49.
    Järvelin, K., Ingwersen, P.: Information seeking research needs extension towards tasks and technology. Inf. Res. Int. Electron. J. 10, paper 212 (2004)Google Scholar
  50. 50.
    Kuhlthau, C.C.: Developing a model of the library search process: cognitive and affective aspects. Res. Q. 28, 232–242 (1988)Google Scholar
  51. 51.
    Ellis, D.: A behavioural model for information retrieval system design. J. Inf. Sci. 15, 237–247 (1989)CrossRefGoogle Scholar
  52. 52.
    Belkin, N.J.: Interaction with texts: Information retrieval as information seeking behavior. Inf. Retr. 93, 55–66 (1993)Google Scholar
  53. 53.
    Shneiderman, B., Byrd, D., Croft, W.B.: Clarifying search: a user-interface framework for text searches. D-Lib Mag. 3, 18–20 (1997)Google Scholar
  54. 54.
    Al-Suqri, M.N.: Information-seeking behavior of social science scholars in developing countries: a proposed model. Int. Inf. Libr. Rev. 43, 1–14 (2011)CrossRefGoogle Scholar
  55. 55.
    Kuhlthau, C.C.: Inside the search process: Information seeking from the user’s perspective. J. Am. Soc. Inf. Sci. 42, 361 (1991)CrossRefGoogle Scholar
  56. 56.
    Ellis, D.: A behavioural approach to information retrieval system design. J. Doc. 45, 171–212 (1989)CrossRefGoogle Scholar
  57. 57.
    Moral, C., De Antonio, A., Ferre, X.: A visual UML-based conceptual model of information-seeking by computer science researchers. Inf. Process. Manag. 53, 963–988 (2016)CrossRefGoogle Scholar
  58. 58.
    White, R.W., Kules, B., Bederson, B.: Exploratory search interfaces: categorization, clustering and beyond: report on the XSI 2005 workshop at the human-computer interaction laboratory, University of Maryland. In: ACM SIGIR Forum, pp. 52–56. ACM (2005)Google Scholar
  59. 59.
    Wilson, M.L.: Search User Interface Design. Morgan & Claypool Publishers, San Rafael (2011)Google Scholar
  60. 60.
    Ahn, J., Brusilovsky, P.: Adaptive visualization for exploratory information retrieval. Inf. Process. Manag. 49, 1139–1164 (2013)CrossRefGoogle Scholar
  61. 61.
    Athukorala, K., Głowacka, D., Jacucci, G., Oulasvirta, A., Vreeken, J.: Is exploratory search different? A comparison of information search behavior for exploratory and lookup tasks. J. Assoc. Inf. Sci. Technol. 67, 2635–2651 (2016)CrossRefGoogle Scholar
  62. 62.
    Marchionini, G.: Exploratory search: from finding to understanding. Commun. ACM 49, 41–46 (2006)CrossRefGoogle Scholar
  63. 63.
    Marchionini, G.: Information Seeking in Electronic Environments. Cambridge University Press, Cambridge (1995)CrossRefGoogle Scholar
  64. 64.
    Roux, C.: Using spatialisation to support exploratory search behaviour (2016)Google Scholar
  65. 65.
    Wells, D.: Library discovery systems and their users: a case study from Curtin University library. Aust. Acad. Res. Libr. 47, 92–105 (2016)CrossRefGoogle Scholar
  66. 66.
    Niu, X., Zhang, T., Chen, H.: Study of user search activities with two discovery tools at an academic library. Int. J. Hum.-Comput. Interact. 30, 422–433 (2014)CrossRefGoogle Scholar
  67. 67.
    Hanrath, S., Kottman, M.: Use and usability of a discovery tool in an academic library. J. Web Librariansh. 9, 1–21 (2015)CrossRefGoogle Scholar
  68. 68.
    Xie, I.: Evaluation of digital libraries: criteria and problems from users perspectives. Libr. Inf. Sci. Res. 28, 433–452 (2006)CrossRefGoogle Scholar
  69. 69.
    Chen, Y.-H., Germain, C.A., Rorissa, A.: Defining usability: how library practice differs from published research. Portal-Libr. Acad. 11, 599–628 (2011)CrossRefGoogle Scholar
  70. 70.
    Tsakonas, G., Kapidakis, S., Papatheodorou, C.: Evaluation of user interaction in digital libraries. In: Notes of the DELOS WP7 Workshop on the Evaluation of Digital Libraries, Padua, Italy. Citeseer (2004)Google Scholar
  71. 71.
    Tsakonas, G., Papatheodorou, C.: Analysing and evaluating usefulness and usability in electronic information services. J. Inf. Sci. 32, 400–419 (2006)CrossRefGoogle Scholar
  72. 72.
    Jeng, J.: Usability assessment of academic digital libraries: effectiveness, efficiency, satisfaction, and learnability. Libri 55, 96–121 (2005)CrossRefGoogle Scholar
  73. 73.
    Nielsen, J.: Usability Engineering. AP Professional, Boston (1993)zbMATHGoogle Scholar
  74. 74.
    Joo, S., Lee, J.Y.: Measuring the usability of academic digital libraries: instrument development and validation. Electron. Libr. 29, 523–537 (2011)CrossRefGoogle Scholar
  75. 75.
    Parush, A.: Conceptual Design for Interactive Systems: Designing for Performance and User Experience. Morgan Kaufmann/Elsevier, Amsterdam (2015)Google Scholar
  76. 76.
    Xie, I., Cool, C.: Understanding help seeking within the context of searching digital libraries. J. Am. Soc. Inf. Sci. Technol. 60, 477–494 (2009)CrossRefGoogle Scholar
  77. 77.
    Xie, I., Joo, S., Bennett-Kapusniak, R.: User involvement and system support in applying search tactics. J. Assoc. Inf. Sci. Technol. 68, 1165–1185 (2016)CrossRefGoogle Scholar
  78. 78.
    Palmer, C.L., Teffeau, L.C., Pirmann, C.M.: Scholarly Information Practices in the Online Environment: Themes from the Literature and Implications for Library Service Development. OCLC Research, Dublin (2009)Google Scholar
  79. 79.
    Galitz, W.O.: The Essential Guide to User Interface Design: An Introduction to GUI Design Principles and Techniques. Wiley, Indianapolis (2007)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Florida State UniversityTallahasseeUSA

Personalised recommendations