Abstract
This paper raises and pursues the question of why research utilizing mixed, quantitative and qualitative methods has been so strongly advocated, yet so little achieved. Following an overview of a range of solutions to the call for “ethodological pluralism,” a conceptual framework for understanding the process and outcomes of mixed method research is advanced, and several research studies are used to illustrate the framework. The conceptual framework is based on two dimensions suggested by prior research. Specifically, the framework analyzes various outcomes that emerge from the research — such as different types of contradictions (Robey 1995) and also whether the two methods were employed sequentially or independently. The paper analyzes the relationship between these two dimensions of the framework, offering some possible reasons why mixed-methods studies in which the two methods are employed independently appear to lead to different outcomes.
Chapter PDF
References
Barley, S. R. (1986). “Technology as an Occasional for Structuring: Evidence from Observations of CT Scanners and the Social Order of Radiology Departments.” Administrative Science Quarterly, Volume 31, pp. 78–108.
Barley, S. R. (1990). “The Alignment of Technology and Structure through Roles and Networks.” Administrative Sciences Quarterly, Volume 36, pp. 61–103.
Benbasat, I. (1984). “An Analysis of Research Methodologies.” In W. McFarlan (Editor), Harvard Colloquium on Information Systems Research. Cambridge, Massachusetts: Harvard University Press, pp. 47–88.
Benbasat, I.; Goldstein, D. K.; and Mead, M. (1987). “The Case Research Strategy in Studies of Information Systems.” MIS Quarterly, Volume 11, Number 3, pp. 369–386.
Blanton, J. E.; Watson, H. J.; and Moody, J. (1992). “Toward a Better Understanding of Information Technology Organization: A Comparative Case Study.” MIS Quarterly, Volume 16, Number 4, pp. 531–555.
Brown, C. V., and Magill, S. L. (1994). “Alignment of the IS Functions with the Enterprise: Toward a Model of Antecedents.” MIS Quarterly, Volume 18, Number 4, pp. 371–397.
Campbell, D. T., and Fiske, D. W. (1959). “Convergent and Discriminant Validation by the Multi-trait -Multi-method Matrix.” Psychological Bulletin, Volume 56, pp. 8–105.
Cook, T. D., and Reichardt, D. S. (1970). Quantitative and Qualitative Methods in Evaluation Research. Newbury Park, California: Sage Press.
Daft, R. L., and Lengel, R. H. (1986). “A Proposed Integration among Organizational Information Requirements, Media Richness, and Structural Design.” Management Science, Volume 32, Number 5, pp. 191–233.
Daft, R. L.; Lengel, R. H.; and Trevino, L. K. (1987). “Message Equivocality, Media Selection and Manager Performance: Implications for Information Systems.” MIS Quarterly, Volume 11, Number 3, pp. 355–366.
Davis, M. S. (1971). “That’s Interesting! Towards a Phenomenology of Sociology and a Sociology of Phenomenology.” Philosophy of Social Science, Volume 1, pp. 309–344.
Deans, P. C.; Karwan, K. R.; Goslar, M. D.; Ricks, D. A.; and Toyne, B. (1991). “Identification of Key International Information Systems Issues in U.S.-Based Multinational Corporations.” Journal of Management Information Systems, Volume 7, Number 4, pp. 27–50.
Denzin, N. K. (1978). The Research Act, Second Edition. New York: McGraw-Hill.
DeGross, J. I.; Bostrom, R. P.; and Robey, D. (Editors) (1993). Proceedings of the Fourteenth International Conference on Information Systems. Orlando, Florida
Earl, M. (1993). “Experiences in Strategic Information Systems Planning.” MIS Quarterly, Volume 17, Number 1, pp. 1–24.
Eisenhardt, K. M. (1989). `Building Theories from Case Study Research“ Academy of Management Review, Volume 14, Number 4, pp. 532–550.
Finlay, P. N., and Mitchell, A. (1994). “Perceptions of the Benefits From the Introduction of CASE: An Empirical Study.” MIS Quarterly, Volume 18, Number 4, pp. 353–369.
Fitzgerald, G.; Hirschheim, R.; Mumford, E.; and Wood-Harper, T. (1985). “Information Systems Research Methodology: An Introduction to the Debate.” In E. Mumford, R. Hirschheim, G. Fitzgerald and T. Wood-Harper (Editors), Research Methods in Information Systems. Amsterdam: North-Holland, pp. 3–12.
Fulk, J.; Schmitz, J.; and Steinfield, C. (1990). “A Social Influence Model of Technology Use.” in J. Fulk and C. Steinfield (Editors), Organizations and Communication Technology. Newbury Park, California: Sage Press, pp. 117–140.
Golden-Biddle, K., and Locke, K. (1993). “Appealing Work: An Investigation of How Ethnographic Texts Convince.” Organization Science, Volume 4, Number 4, pp. 595–616.
Grady, K. A., and Wallston, B. S. (1988). Research in Health Care Settings. Newbury Park, California: Sage Press.
Grant, R. A., and Higgins, C. A. (1991). “The Impact of Computerized Performance Monitoring on Service Work: Testing a Causal Model.” Information Systems Research, Volume 2, Number 2, pp. 116–142.
Griffith, T. L., and Northcraft, G. B. (1996). “Cognitive Elements in the Implementation of New Technology: Can Less Information Provide More Benefits?” MIS Quarterly, Volume 20, Number 1, pp. 99–110.
Hackman, J. R., and Oldham, G. (1980). Work Design. Reading, Massachusetts: Addison-Wesley.
Ives, B., and Olson, M. H. (1984). “User Involvement and MIS Success: A Review of Research.” Management Science, Volume 30, Number 5, pp. 586–603.
Jarvenpaa, S., and Ives, B. (1991). “Executive Involvement and Participation in the Management of Information Technology.” MIS Quarterly, Volume 15, Number 2, pp. 205–228.
Jick, T. (1979). “Triangulating on Mixing Qualitative and Quantitative Methods: Triangulation in Action.” Administrative Science Quarterly, Volume 24, pp. 602611.
Jobber, D.; Saunders, J.; Gilding, B.; Hooley, G.; and Hatton-Smoker, J. (1989). “Assessing the Value of a Quality Assurance Certificate for Software: An Exploratory Investigation.” MIS Quarterly, Volume 13, Number 1, pp. 19–31.
Kaplan, B., and Duchon, D. (1988). “Combining Qualitative and Quantitative Methods in Information Systems Research: A Case Study.” MIS Quarterly, Volume 12, Number 4, pp. 571–586.
Kidder, L., and Fine, M. (1987). “Qualitative and Quantitative Methods: When Stories Converge.” In M. M. Mark and R. L. Shotland (Editors), Multiple Methods in Program Evaluation. San Francisco: Jossey-Bass, pp. 57–76.
Konsynski, B. R. (1993). “A Perspective on the `Case Study Approach’ in Evaluating the Business Value of Information Technology.” In R. D. Banker, R. J. Kauffman, and M. Mahmood (Editors), Strategic Information Technology Management. Harrisburg, Pennsylvania: Idea Group Publishing, pp. 15–24.
Kraut, R.; Dumais, S.; and Koch, S. (1989). “Computerization, Productivity and the Quality of Work Life.” Communications of the ACM, Volume 32, Number 2, pp. 220–238.
Lacity, M. C., and Janson, M. (1994). “Understanding Qualitative Data: A Framework of Text Analysis Methods.” Journal of Management Information Systems, Volume 11, Number 2, pp. 137–155.
Lee, A. S. (1989). “A Scientific Methodology for MIS Case Studies.” MIS Quarterly, Volume 13, Number 1, pp. 33–50.
Lee, A. S. (1991). “Integrating Positivist and Interpretivist Research Approaches: Approaches to Organizational Research.” Organization Science, Volume 2, Number 4, pp. 342–365.
Leidner, D. E., and Jarvenpaa, S. L. (1993). “The Information Age Confronts Education: Case Studies on Electronic Classrooms.” Information Systems Research, Volume 4, Number 1, pp. 24–54.
Leonard-Barton, D. (1990). “A Dual Methodology for Case Studies: Synergistic Use of a Longitudinal Single Site with Replicated Multiple Sites.” Organization Science, Volume 1, Number 3, pp. 248–266.
Leavitt, H. J., and Whisler, T. L. (1958). “Management in the 1980s.” Harvard Business Review, November-December, pp. 41–48.
Liker, J. K.; Roitman, D. B.; and Roskies, E. (1987). “Changing Everything All at Once: Work Life and Technological Change.” Sloan Management Review, pp. 2947.
Markus, M. L. (1994). “Electronic Mail as the Medium of Managerial Choice.” Organization Science, Volume 5, Number 4, pp. 502–527.
Markus, M. L., and Robey, D. (1988). “Information Technology and Organizational Change: Causal Structure in Theory and Research.” Management Science, Volume 34, pp. 583–598.
Martin, J. (1982). “A Garbage Can Model of the Research Process.” In J. McGrath, J. Martin and R. Kulka (Editors), Judgment Calls in Research. Beverly Hills: Sage Press, pp. 17–40.
McGrath, J. (1982). “Dilemmatics: The Study of Research Choices and Dilemmas.” In J. McGrath, J. Martin, and R. Kulka (Editors), Judgment Calls in Research. Beverly Hills: Sage Press, pp. 69–102.
Maxwell, J. A. (1993). “Combining Qualitative and Quantitative Methods.” Unpublished manuscript, Harvard University Graduate School of Education.
Maxwell, J. A. (1996). Qualitative Research Design: An Iterative Approach. Thousand Oaks, California: Sage Press.
Mohr, L. B. (1982). Explaining Organizational Behavior. San Francisco: JosseyBass.
Moynihan, T. (1990). “What Chief Executives and Senior Managers Want From
Their IT Departments.“ MIS Quarterly,Volume 14, Number 1, pp. 15–26. Nemeth, C. J. (1986). ”Differential Contributions of Majority and Minority Influence.“ Psychological Review,Volume 93, Number 1, pp. 23–32.
Nissen, H-E. (1985). “Acquiring Knowledge of Information Systems Research in a Methodological Quagmire.” In E. Mumford, R. Hirschheim, G. Fitzgerald and T. Wood-Harper (Editors), Research Methods in Information Systems. Amsterdam: North-Holland, pp. 39–51.
Orlikowski, W. J. (1989). “Division among the Ranks: The Social Implications of CASE Tools for System Developers.” In J. I. DeGross, J. C. Henderson, and B. R. Konsynski (Editors), Proceedings of the Tenth International Conference on Information Systems. Boston, Massachusetts, pp. 199–210.
Orlikowski, W. J. (1993). “CASE Tools as Organizational Change: Investigating Incremental and Radical Changes in Systems Development.” MIS Quarterly, Volume 17, Number 3, pp. 309–340.
Orlikowski, W. J. (1996). “Improvising Organization and Transformation Over Time: A Situated Change Perspective.” Information Systems Research, Volume 17, Number 1, pp. 63–92.
Orlikowski, W. J., and Baroudi, J. J. (1991). “Studying Information Technology in Organizations: Research Approaches and Assumptions.” Information Systems Research, Volume 2, Number 1, pp. 1–28.
Poole, M. S., and Van de Ven, A. H. (1989). “Using Paradox to Build Management and Organization Theories.” Academy of Management Review, Volume 14, pp. 562–578.
Reich, B. H., and Benbasat, I. (1996). “Measuring the Linkage Between Business and Information Technology Objectives.” MIS Quarterly, Volume 20, Number 1, pp. 55–77.
Robey, D. (1995). “Theories that Explain Contradiction: Accounting for the Contradictory Organizational Consequences of Information Technology.” In J. I. DeGross, G. Ariav, C. M. Beath, R. W. Hoyer, and C. Kemerer (Editors), Proceedings of the Sixteenth International Conference on Information Systems. Amsterdam, The Netherlands, pp. 55–63.
Rogers, E. M. (1983). Diffusion of Innovations, Second Edition. New York: Free Press.
Sabherwal, R., and Robey, D. (1995). “Reconciling Variance and Process Strategies for Studying Information System Development.” Information Systems Research, Volume 6, Number 4, pp. 303–327.
Smith, H. J.; Milberg, S. J.; and Burke, S. J. (1996). “Information Privacy: Measuring Individuals’ Concerns about Organizational Practices.” MIS Quarterly, Volume 20, Number 2, pp. 167–196.
Soh, C., and Markus, M. L. (1995). “How IT Creates Business Value: A Process Theory Synthesis.” In J. I. Degross, G. Ariav, C. Beath, R. Hoyer and C. Kemerer (Editors), Proceedings of the Sixteenth International Conference on Information Systems. Amsterdam, The Netherlands, pp. 29–41.
Sutton, R. I., and Rafaeli, A. (1986). “Untangling the Relationship between Displayed Emotions and Organizational Sales: The Case of Convenience Stores.” Academy of Management Journal, Volume 31, Number 3, pp. 461–487.
Trend, M. G. (1979). “On the Reconciliation of Qualitative and Quantitative Analyses: A Case Study.” In T. D. Cook and D. S. Reichardt (Editors), Quantitative and Qualitative Methods in Evaluation Research. Thousand Oaks, California: Sage Press, pp. 68–86.
Trauth, E. M.; Farwell, D. W.; and Lee, D. (1993). “The IS Expectation Gap: Industry Expectations Versus Academic Preparation.” MIS Quarterly, Volume 17, Number 3, pp. 293–303.
Tyran, C. K.; Dennis, A. R.; Vogel, D. R.; and Nunamaker Jr., J. F. (1992). “The Application of Electronic Meeting Technology to Support Strategic Management.” MIS Quarterly, Volume 16, Number 3, pp. 313–334.
Walsham, G. (1995). “The Emergence of Interpretivism in IS Research.” Information Systems Research, Volume 6, Number 4, pp. 376–394.
Watson, R. T. (1990). “Influence on the IS Manager’s Perceptions of Key Issues: Information Scanning and the Relationship With the CEO.” MIS Quarterly, Volume 14, Number 2, pp. 217–231.
Wynekoop, J. L. (1992). “Strategies for Implementation Research: Combining Research Methods.” In J. I. DeGross, J. D. Becker, and J. J. Elam (Editors), Proceedings of the Thirteenth International Conference on Information Systems. Dallas, Texas, pp. 185–193.
Wynekoop, J. L., and Conger, S. A. (1991). “A Review of Computer Aided Software Engineering Research Methods.” In H-E. Nissen, H. K. Klein and R. Hirschheim (Editors), Information Systems Research: Contemporary Approaches and Emergent Traditions. Amsterdam: North-Holland, pp. 301–327.
Wynekoop, J. L., and Russo, N. L. (1993). “System Development Methodologies: Unanswered Questions and the Research-Practice Gap.” In J. I. DeGross, R. P. Bostrom, and D. Robey (Editors), Proceedings of the Fourteenth International Conference on Information Systems. Orlando, Florida, pp. 181–190.
Yin, R. K. (1994). Case Study Research: Design and Methods, Second Edition. Newbury Park, California: Sage Press.
Zack, M. H., and McKenney, J. L. (1995). “Social Context and Interaction in Ongoing Computer-Supported Management Groups.” Organization Science, Volume 6, Number 4, pp. 394–422.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1997 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Gallivan, M.J. (1997). Value in Triangulation: A Comparison of Two Approaches for Combining Qualitative and Quantitative Methods. In: Lee, A.S., Liebenau, J., DeGross, J.I. (eds) Information Systems and Qualitative Research. IFIP — The International Federation for Information Processing. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-35309-8_21
Download citation
DOI: https://doi.org/10.1007/978-0-387-35309-8_21
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4757-5487-2
Online ISBN: 978-0-387-35309-8
eBook Packages: Springer Book Archive