Generalization in IS research: a critique of the conflicting positions of Lee & Baskerville and Tsang & Williams
This paper is a companion to the paper on generalization in IS research by Williams and Tsang published in this edition of the Journal of Information Technology. Its purpose is to discuss the implications of the robust exchange of views about the meaning of the term “generalization” in four papers, two by Lee and Baskerville, and two by Tsang and Williams. The objectives of this paper are, first, to help the reader understand the issues by summarizing the arguments in the various papers, and second, to assess the implications of the debate for future IS research. Our conclusion is that when the papers are interpreted from the perspectives of the respective pairs of authors, most of what they say is sound. However because their perspectives are so different, their differences of opinion are also very real. As a way of showing that neither pair of authors’ conception of generalization is the “last word” on this topic, the paper also compares key concepts from both pairs of authors with those from Seddon and Scheepers. It is argued that although the Seddon and Scheepers’ framework is also not the “last word”, it may prove more useful than either of the two preceding frameworks.
Unable to display preview. Download preview PDF.
- Archer, M., Bhaskar, R., Collier, A., Lawson, T. Norrie, A. (1998). Critical Realism: Essential Readings, Milton Park: Routledge.Google Scholar
- Bhaskar R. (1978). A Realist Theory of Science. Hassocks, Sussex: Harvester, UK.Google Scholar
- Bunge, M. (1996). Finding Philosophy in Social Science, New Haven, CT: Yale University Press.Google Scholar
- Campbell, D. and Stanley, J (1963). Experimental and Quasi-Experimental Designs for Research, Boston MA: Houghton Mifflin.Google Scholar
- Collier, A. (1994). Critical Realism: An Introduction to Roy Bhaskar’s Philosophy, London: Verso Books.Google Scholar
- Cronbach, L.J. (1982). Designing Evaluations of Educational and Social Programs, Jossey-Bass, San Francisco, CA.Google Scholar
- Dubin, R. (1978). Theory Building (Rev. ed.), London: Free Press.Google Scholar
- Eisenhardt, K.M. (1989). Building theories from case study research. Academy of Management Review, 14(4), 532–550.Google Scholar
- Galileo (1610). http://en.wikipedia.org/wiki/Galileo_Galilei (viewed July 2014)
- Geertz, C. (1960). The Religion of Java, Chicago: The Free Press.Google Scholar
- Gillham, B. (2005). Research Interviewing: The Range Of Techniques: A Practical Guide, McGraw-Hill International.Google Scholar
- King, W.R. and He, J. (2005) External validity in survey research, Communications of the AIS, 16, 880–894.Google Scholar
- Kolakowski, L. (1968). The Alienation of Reason: A History of Positivist Thought, Doubleday, Garden City, NY.Google Scholar
- Lee, A.S. and Baskerville, R.L. (2012). Conceptualizing generalizability: new contributions and a reply, MIS Quarterly 36(3), pp. 749–761.Google Scholar
- Mingers, J. (2006). Realising Systems Thinking: Knowledge and Action in Management Science, Springer, New York.Google Scholar
- NASA (2014). Our Solar System: Moons, http://solarsystem.nasa.gov/planets/profile.cfm?Display=Moons (viewed July 2014).
- Peirce, C.S. (1903). A syllabus of certain topics of logic, The Essential Peirce, Vol. 2, Indiana University Press (see also http://www.helsinki.fi/science/commens/terms/abduction.html, viewed July 2013).
- Pettigrew, A.M. (1985a). Contextualist research: a natural way to think, in E. E. Lawler, III, A.M. Mohrman, Jr., S.A. Mohrman, G.E. Ledford, Jr., and T. G. Cummings (eds.), Doing Research that Is Useful for Theory and Practice, San Francisco: Jossey-Bass Publishers, pp. 223–274.Google Scholar
- Pettigrew, A.M. (1985b). Contextualist research and the study of organizational change processes, in E. Mumford, R. Hirschheim, G. Fitzgerald, and T. Wood-Harper (eds.), Research Methods in Information Systems, Amsterdam: Elsevier Science Publishers, B.V. (North-holland), pp. 53–78.Google Scholar
- Seddon, P.B. and Scheepers, R. (2006). Other-settings generalization in IS Research, Proceedings, International Conference on Information Systems, Milwaukee, 1141–1158.Google Scholar
- Shadish, W.R., Cook, T.D. and Campbell, D.T. (2002). Experimental and Quasi-experimental Designs for Generalized Causal Inference. Boston MA: Houghton Mifflin Company.Google Scholar
- Tsang, E.W.K. (2014). Case studies and generalization in information systems research: a critical realist perspective, Journal of Strategic Information Systems, forthcoming.Google Scholar
- Tsang, E.W.K. and Williams, J.N. (2012). Generalization and induction: misconceptions, clarifications, and a classification of induction, MIS Quarterly 36(3), 729–748Google Scholar
- Williams, J.N. and Tsang, E.W.K. (2014). Classifying generalization: paradigm war or abuse of terminology?, Journal of Information Technology Google Scholar
- Yin, R.K. (1994). Case Study Research, Design and Methods, 2nd ed., California: Sage Publications.Google Scholar
- Yin, R.K. (2003). Case Study Research, Design and Methods, 3rd ed., California: Sage Publications.Google Scholar