Skip to main content

Integrating Mixed-Methods for Evaluating Information Access Systems

  • Conference paper
  • First Online:
Experimental IR Meets Multilinguality, Multimodality, and Interaction (CLEF 2015)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9283))

Abstract

The evaluation of information access systems is increasingly making use of multiple evaluation methods. While such studies represent forms of mixed-methods research, they are rarely acknowledged as such. This means that researchers are potentially failing to recognise the challenges and opportunities offered by multi-phase research, particularly in terms of data integration. This paper provides a brief case study of how one framework – Bazely & Kemp’s metaphors for integrated analysis – was employed to formalise data integration for a large exploratory evaluation study.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bazeley, P., Kemp, L.: Mosaics, Triangles, and DNA: Metaphors for Integrated Analysis in Mixed Methods Research. J. Mix. Methods Res. 6(1), 55–72 (2012)

    Article  Google Scholar 

  2. Bryman, A.: Why do researchers integrate/combine/mesh/blend/mix/merge/fuse quantitative and qualitative research? In: Bergman, M.M. (ed.) Advances in Mixed Methods Research, pp. 87–100. SAGE, London (2008)

    Google Scholar 

  3. Denzin, N.K.: The research act: A theoretical introduction to sociological methods. McGraw-Hill, New York (1978)

    Google Scholar 

  4. Denzin, N.K.: Triangulation 2.0. J. Mix. Methods Res. 6(2), 80–88 (2012)

    Google Scholar 

  5. Fidel, R.: Are we there yet?: Mixed methods research in library and information science. Library & Information Science Research 30, 265–272 (2008)

    Article  Google Scholar 

  6. Greene, J.C.: Mixed methods in social inquiry. Jossey-Bass, San Francisco (2007)

    Google Scholar 

  7. Kelly, D.: Methods for Evaluating Interactive Information Retrieval Systems with Users. Foundations and Trends in Information Retrieval 3, 1–224 (2009)

    Article  Google Scholar 

  8. Webb, E.J., Campbell, D.T., Schwartz, R.D., Sechrest, L.: Unobtrusive measures: Nonreactive research in the social sciences. Rand McNally, Chicago (1966)

    Google Scholar 

  9. Woolley, C.M.: Meeting the Mixed Methods Challenge of Integration in a Sociological Study of Structure and Agency. J. Mix. Methods Res. 3(7), 7–25 (2009)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Simon Wakeling .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Wakeling, S., Clough, P. (2015). Integrating Mixed-Methods for Evaluating Information Access Systems. In: Mothe, J., et al. Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2015. Lecture Notes in Computer Science(), vol 9283. Springer, Cham. https://doi.org/10.1007/978-3-319-24027-5_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-24027-5_33

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-24026-8

  • Online ISBN: 978-3-319-24027-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics