Selecting a research method for empirical software engineering research is problematic because the benefits and challenges to using each method are not yet well catalogued. Therefore, this chapter describes a number of empirical methods available. It examines the goals of each and analyzes the types of questions each best addresses. Theoretical stances behind the methods, practical considerations in the application of the methods and data collection are also briefly reviewed. Taken together, this information provides a suitable basis for both understanding and selecting from the variety of methods applicable to empirical software engineering.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bratthall, L. and Jørgensen, M. (2002) Can you trust a single data source exploratory software engineering case study? Journal of Empirical Software Engineering, 7(1), 9–26.
Calhoun, C. (1995) Critical Social Theory: Culture, History, and the Challenge of Difference. Blackwell, Oxford, UK.
Chalmers, A. (1999) What Is This Thing Called Science? 3rd Edition, Hackett Publishing Co, Indianapolis.
Creswell, J.W. (2002) Research Design: Qualitative, Quantitative and Mixed Methods Approaches. 2nd Edition, Sage Publications, Thousand Oaks, CA.
Damian, D. and Chisan, J. (2006) An empirical study of the complex relationships between requirements engineering processes and other processes that lead to payoffs in productivity, quality and risk management, IEEE Transactions on Software Engineering, 32(8), 433–453.
Damian, D.E., Eberlein, A., Shaw, M., and Gaines, B. (2000) Using different communication media in requirements negotiation, IEEE Software, 17(3), 28–36.
Davison, R.M., Martinsons, M.G., and Kock, N. (2004) Principles of canonical action research, Information Systems Journal, 14(1), 65–86.
Dittrich, Y. (2002) Doing Empirical Research on Software Development: Finding a Path Between Understanding, Intervention, and Method Development. In Social Thinking: Software Practice, Y. Dittrich, C. Floyd, and R. Klischewski, Eds. MIT Press.
Dittrich, Y., John, M., Singer, J., and Tessem, B. (2007) Editorial for the Special Issue on Qualitative Software Engineering Research, Information and Software Technology, 49(6), 531–539.
Flyvbjerg, B. (2006) Five misunderstandings about case study research, Qualitative Inquiry, 12(2), 219–245.
Glaser, B.G. and Strauss, A. (1967) Discovery of Grounded Theory: Strategies for Qualitative Research. Sociology Press, Mill Valley, CA.
Gregor, S. (2006) The Nature of Theories in Information Systems, MIS Quarterly, 30(3), 611–642.
Jørgensen, M. and Sjøberg, D.I.K. (2004) Generalization and Theory-Building in Software Engineering Research. IEE Proceedings, Workshop on Empirical Assessment in Software Engineering (EASE’04), at ICSE’04, pp. 29–36.
Kitchenham, B., Pickard, L., and Pfleeger, S.L. (1995) Case studies for method and tool evaluation, IEEE Software, 12(4), 52–62.
Klein, H.K. and Myers, M.D. (1999) A set of principles for conducting and evaluating interpretive field studies in information systems, MIS Quarterly, 23(1), 67–93.
Lau, F. (1999).Towards a framework for action research in information systems studies, Information Technology and People, 12(2), 148–175.
Lincoln, Y.S. and Guba, E.G. (1985) Naturalistic Inquiry. Sage, Beverly Hills, CA.
Littlejohn, S.W. and Foss, K.A. (2004) Theories of Human Communication. 8th Edition, Wadsworth Publishing, Belmont, CA.
McGrath, J.E. (1995) Methodology matters: doing research in the behavioral and social sciences. In Human–Computer Interaction: Toward the Year 2000, R.M. Baecker, J. Grudin, W. Buxton, A., and Greenberg, S., Eds. Morgan Kaufmann Publishers, San Francisco, CA, pp. 152–169.
Meltzoff, J. (1998) Critical Thinking About Research: Psychology and Related Fields. American Psychological Association, Washington DC.
Menand, L. (1997) Pragmatism: A Reader. Vintage Press, New York.
Morse, J.M., Barrett, M., Mayan, M., Olson, K. and Spiers, J. (2002) Verification strategies for establishing reliability and validity in qualitative research, International Journal of Qualitative Methods, 1(2), 1–19.
Robinson, H., Segal, J. and Sharp, H. (2007) Ethnographically-informed empirical studies of software practice, Information and Software Technology, 49(6), 540–551.
Sandelowski, M. (1993) Rigor or rigor mortis: the problem of rigor in qualitative research revisited, Advances in Nursing Science, 16(2), 1–8.
Simon, H. (1996) The Sciences of the Artificial. 3rd Edition, MIT Press, Cambridge, MA.
Singer, J.A. and Vinson, N.G. (2002) Ethical issues in empirical studies of software engineering, IEEE Transactions on Software Engineering, 28(12), 1171–1180.
Varkevisser, C.M., Pathmanathan, I., and Brownlee, A. (2003) Designing and Conducting Health Systems Research Projects: Volume 1–Proposal Development and Fieldwork. Chapter 10: Data Collection Techniques. Available online at http://www.idrc.ca/en/ev-56605–201-1-DO_TOPIC.html.
Vinson, N.G. and Singer, J.A. (2004) Consent issues raised by observational research in organisations, NCEHR Communique, 12(2), 35–36.
Wieringa, R.J. and Heerkens, J.M.G. (2006) The methodological soundness of requirements engineering papers: a conceptual framework and two case studies, Requirements Engineering Journal, 11, 295–307.
Wohlin, C., Runesson, P., Höst, M., Ohlsson, M.C., Regnell, B., and Wesslén, A. (2000) Introduction to Experimentation in Software Engineering. Kluwer Academic Publishers, Boston, MA.
Yin, R.K. (2002) Case Study Research: Design and Methods. Sage, Thousand Oaks, CA.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag London Limited
About this chapter
Cite this chapter
Easterbrook, S., Singer, J., Storey, MA., Damian, D. (2008). Selecting Empirical Methods for Software Engineering Research. In: Shull, F., Singer, J., Sjøberg, D.I.K. (eds) Guide to Advanced Empirical Software Engineering. Springer, London. https://doi.org/10.1007/978-1-84800-044-5_11
Download citation
DOI: https://doi.org/10.1007/978-1-84800-044-5_11
Publisher Name: Springer, London
Print ISBN: 978-1-84800-043-8
Online ISBN: 978-1-84800-044-5
eBook Packages: Computer ScienceComputer Science (R0)