Abstract
The choice of methods for the collection and analyses of data is guided by the analytical approach of Foreign Policy Analysis (FPA), the state of the literature on the politics of caveats, and influenced by caveats be regarded as sensitive information. Research collaboration with military colleges and military scholars is likely to benefit not only the gathering of data but also the interpretation of the empirical material. For theory developing purposes, inductive use of plausibility probing, deviating and “practice”-tracing single case-designs are likely to give epistemological traction. For theory testing, Qualitative Comparative Analysis (QCA) in combination with structured, focused comparison and single-case process tracing designs are promising routes to knowledge in a nascent field of research such as the politics of caveats.
Keywords
- Obstacles to data collection
- Case study design
- Comparable-cases design
- Theory development
- Theory testing
- Qualitative comparative analysis (QCA)
- Plausibility probes
- Process tracing
- Contingent generalization
- Causal mechanisms
- Interaction effects
- Validity
- Reliability
- Scope conditions
- Case selection
- Degrees of freedom
- Multiple conjectural causation
- Causal recipes
- Structured, focused comparison
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Robert E. Stake makes a similar, if not identical distinction in assigning the term “intrinsic” for case study undertaken “because that case, in particular, is of interest” (idiographic), and “instrumental” case study to indicate that the case/s “throw light on matters beyond the case/s studied” (nomothetic) (1995: xi).
- 2.
We will subsequently discuss case selection as a means of making causal inferences in single and multiple case studies.
- 3.
J. Clyde Mitchell defines logical inference as the “the process by which the analyst draws conclusions about the essential linkage between two or more characteristics in terms of some systematic explanatory scheme – some set of theoretical propositions” (1983: 199–200). It follows from this that detailed knowledge of the context is a crucial element in the case study researcher’s capacity to construct generic implications from a case.
- 4.
Such formulated it also becomes evident why we may use the deviant case procedure both for theory-developing and theory-testing purposes. Recall that juxtaposing theoretical constructs and facts is an epistemological two-way street (Moses and Knutsen 2012: 143), which also the plausibility probe and process tracing procedures discussed below are capable of traveling.
- 5.
In addition to the CFP strand of FPA, the other two strands include the study of institutional and psychological mechanisms involved in foreign policy decision-making (Smith et al. 2008: 3–4). More recently, efforts have been made to bridge the gap between IR and FPA (Thies and Breuning 2012; Rynning and Guzzini 2002; Rose 1998; Fearon 1998).
- 6.
Aptly, Jack S. Levy terms the inferential logic of the least-likely case the «Sinatra inference». As fittingly, the logic of the most-likely case is conceptualized the «inverse Sinatra inference» (2002: 442).
- 7.
Note that in the subsequent discussion, we emphasize comparative methods as means of testing theoretical arguments and empirical propositions that can explain patterns and regularities in the social world. Central to such a realist (or naturalist) epistemological position is that we are interested in comparative methods in relation to how case selection and choice of data can contribute to the validation of causal explanations in a nomothetic sense. This is in considerable contrast to the constructivist approach to comparative methods, where the focus is not so much on comparative control for third variables “as for how to preserve and exploit the qualities associated with thickly descriptive narrative” (Moses and Knutsen 2012: 231). The constructivist approach to comparative methods would include emphasizing the “uniqueness, particularity and complexity of social and political phenomena,” and how comparisons can be used “in a less formal sense to challenge existing explanations and to explore possibilities” (ibid.: 245). Finally, constructivist approaches to the social and political world also engage in how meanings are embodied in agency rather than taking material facts at their face value. Hence, constructivist comparative methodology rest on a hermeneutic epistemology, draws on narratives and representations of meaning, and is closer to the idiographic research ambition than the nomothetic. We acknowledge that the constructivist approach to comparative methodology is certain to offer insights as to how we usefully can research the politics of caveats. However, while the epistemological foundation of the empirical research program does not a priori exclude any middle-ground constructivist approach capable of being integrated into an empirical research program (Adler 1997), we dedicate the remainder of the methodology discussion to the uncovering of causal relationships between variables rather than to how the construction of meaning be empirically researched.
- 8.
Everything else being equal, a diachronic extension of cases increases the inferential power of the study and increases the degrees of freedom. However, a diachronic extension of cases also introduces the problem of non-independent observations (autocorrelation).
- 9.
A crisp-set of data implies that data is dichotomized and thus that data is at the nominal level of measurement.
- 10.
The Joint Method of Agreement and Difference (JMAD) has also been referred to by Mill as the Indirect Method of Difference (IMD).
- 11.
An INUS condition is a causal condition that is “an insufficient but necessary part of a condition which is itself unnecessary but sufficient for the result” (Mackie 1965: 245).
- 12.
- 13.
Recall that there is a theory building side to process tracing as well. Applied for theory-developing purposes, the process-tracing case study is geared toward the inductive “practice tracing” of real-life decision-making processes (Pouliot 2015). Here, the effort is to generalize case-specific empirical observations of “many mechanisms linked in causal processes” (Mjøset 2009: 58), develop “analytical narratives” to better understand why certain inputs are associated with certain outputs (Bates et al. 1998), and use “evidence from within a case to develop hypotheses that might explain the case” (Bennett and Checkel 2015: 8).
References
Adler, E. (1997). Seizing the Middle Ground: Constructivism in World Politics. European Journal of International Relations, 3(3), 319–363.
Allison, G., & Zelikow, P. (1999). Essence of Decision. Explaining the Cuban Missile Crisis. New York, NY: Longman.
Almond, G., & Verba, S. (1963). The Civic Culture: Political Attitudes and Democracy in Five Nations. Thousand Oaks, CA: Sage.
Aristotle. (1979 [c.350 BCE]). Politics. Harmondsworth: Penguin.
Auerswald, D. P., & Saideman, S. M. (2014). NATO in Afghanistan: Fighting Together, Fighting Alone. Princeton, NJ: Princeton University Press.
Bartlett, L., & Vavrus, F. (2017). Rethinking Case Study Research. A Comparative Approach. Oxford, UK: Routledge.
Bates, R., Weingast, B., Greif, A., Levi, M., & Rosenthal, J.-L. (1998). Analytic Narratives. Princeton, NJ: Princeton University Press.
Bauman, Z. (1978). Hermeneutics and Social Science: Approaches to Understanding. London: Routledge.
Bennett, A., & Checkel, J. T. (Eds.). (2015). Process Tracing. From Metaphor to Analytical Tool. Cambridge: Cambridge University Press.
Bennett, A., Lepgold, J., & Unger, D. (1994). Burden-Sharing in the Persian Gulf War. International Organization, 48(1), 39–75.
Blaikie, N. (2009). Designing Social Research. Hoboken, NJ: Wiley.
Brady, H. E., & Collier, D. (Eds.). (2010). Rethinking Social Inquiry. Diverse Tools, Shared Standards. New York, NY: Rowman & Littlefield.
Brady, H. E., Collier, D., & Seawright, J. (2010). Refocusing the Discussion of Methodology. In H. E. Brady & D. Collier (Eds.), Rethinking Social Inquiry. Diverse Tools, Shared Standards (pp. 15–32). New York, NY: Rowman & Littlefield.
Brams, S. J. (1994). Theory of Moves. Cambridge: Cambridge University Press.
Brinton, C. (1965). The Anatomy of Revolution. New York, NY: Vintage Books.
Bryman, A. (2001). Social Research Methods. Oxford: Oxford University Press.
Byrne, D., & Ragin, C. C. (Eds.). (2013). The Sage Handbook of Case-Based Methods. London: Sage.
Checkel, J. T. (2006). Tracing Causal Mechanisms. International Studies Review, 8(2), 362–370.
Collier, D. (1993). The Comparative Method. In A. W. Finifter (Ed.), Political Science: The State of the Discipline II (pp. 105–120). Washington, DC: American Political Science Association.
Collier, D. (1999, Winter). Data, Field Work and Extracting New Ideas at Close Range. APSA-CP Newsletter, pp. 1–6.
Cronqvist, L., & Berg-Schlosser, D. (2009). Multi-value QCA (mvQCA). In B. Rihoux & C. C. Ragin (Eds.), Configurational Comparative Methods. Qualitative Comparative Analysis and Related Techniques (pp. 69–86). Los Angeles, CA: Sage.
de Mesquita, B. B. (2000). Principles of International Politics: People’s Power, Preferences, and Perceptions. Washington, DC: QC Press.
Eckstein, H. (1975). Case Study and Theory in Political Science. In F. I. Greenstein & N. W. Polsby (Eds.), Handbook of Political Science (Vol. 7, pp. 119–161). Reading, MA: Addison-Wesley.
Eisenhardt, K. M. (1989). Building Theories from Case Study Research. The Academy of Management Review, 14(4), 532–550.
Elman, C. (2005). Explanatory Typologies in Qualitative Studies of International Politics. International Organization, 59(2), 293–326.
Fearon, J. D. (1998). Domestic Politics, Foreign Policy, and Theories of International Relations. Annual Review of Political Science, 1(3), 289–313.
Fermann, G. (1988). UNEF II – 1973–89: Instrument for forhandlet konfliktløsning (NUPI Report No. 120). Oslo: Norwegian Institute for International Affairs.
Fermann, G. (1992). Internasjonal fredsbevaring 1956–1990. En sammenliknende undersøkelse. Forsvarsstudier 5/1992. Oslo: Institutt for forsvarsstudier. https://brage.bibsys.no/xmlui/bitstream/handle/11250/99313/4/FS0592.pdf.
Fermann, G. (Ed.). (2013). Utenrikspolitikk og norsk krisehåndtering. Oslo: Cappelen Damm Akademika. https://www.cappelendamm.no/_utenrikspolitikk-og-norsk-kriseh%C3%A5ndtering-gunnar-fermann-9788202378691.
Frendreis, J. P. (1983). Explanation of Variation and Detection of Covariation. The Purpose of Logic and Logic of Comparative Analysis. Comparative Political Studies, 16(2), 255–272.
Frost-Nielsen, P. M. (2016). Betingede forpliktelser. Nasjonale reservasjoner i militære koalisjonsoperasjoner. Ph.D. dissertation in Political Science, Department of Sociology and Political Science, Norwegian University of Science and Technology (NTNU), Trondheim.
Frost-Nielsen, P. M. (2017). Conditional Commitments: Why States Use Caveats to Reserve Their Efforts in Military Coalition Operations. Contemporary Security Policy, 38(3), 371–397.
George, A. L. (1979). Case Studies and Theory Development: The Method of Structured Focused Comparison. In P. G. Lauren (Ed.), Diplomatic History: New Approaches (pp. 43–68). New York, NY: Free Press.
George, A. L., & Bennett, A. (2005). Case Studies and Theory Development in Social Sciences. Cambridge, MA: MIT Press.
Gerring, J. (2007). Case Study Research. Principles and Practices. New York, NY: Cambridge University Press.
Hague, R., Harrop, M., & Breslin, S. (Eds.). (1998). Government and Politics: An Introduction. Basingstoke: Macmillan.
Hall, J. R. (2007). Historicity and Socio-historical Research. In W. Outhwaite & S. P. Turner (Eds.), The Sage Handbook of Social Science Methodology (pp. 82–101). London: Sage.
Haney, P. J. (2002). Organizing for Foreign Policy Crises: Presidents, Advisers, and the Management of Decision-Making. Ann Arbor, MI: University of Michigan Press.
Harris, W. A. (1997). On “Scope Conditions” in Sociological Theories. Social and Economic Studies, 46(4), 123–127.
Henriksen, Dag. (2007). NATO’s Gamble. Combining Diplomacy and Airpower in the Kosovo Crisis 1998–1999. Annapolis, MD: Naval Institute Press.
Hudson, V. M. (2005). Foreign Policy Analysis: Actor-Specific Theory and the Ground of International Relations. Foreign Policy Analysis, 1(1), 1–30.
Hudson, V. M. (2007). Foreign Policy Analysis: Classical and Contemporary Theory. Boulder, CO: Rowman and Littlefield.
Husby, G. (2015). Fra hull i luften, til hull i Gaddafis bunker. Bruk av politiske reservasjoner på norsk militærmakt i flernasjonale koalisjonsoperasjoner. En komparativ studie av F-16 bidragene i Kosovo, Afghanistan og Libya. Master Thesis in Political Science, Department of Sociology and Political Science. Norwegian University of Science and Technology (NTNU), Trondheim.
Ingesson, T. (2016). The Politics of Combat: The Political and Strategic Impact of Tactical-Level Subcultures, 1939–1995. Lund: Ph.D. Dissertation, Faculty of Social Sciences and Department of Political Science, Lund University. http://portal.research.lu.se/ws/files/7253766/Tony_Ingesson_Politics_of_Combat.pdf.
Ingesson, T. (2017). Trigger-Happy, Autonomous, and Disobedient: Nordbat 2 and Mission Command in Bosnia. The Strategy Bridge, 20 September. https://thestrategybridge.org/the-bridge/2017/9/20/trigger-happy-autonomous-and-disobedient-nordbat-2-and-mission-command-in-bosnia.
Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2007). Toward a Definition of Mixed Methods Research. Journal of Mixed Methods Research, 1(2), 112–133.
Kawulich, B. B. (2005). Participant Observation as a Data Collection Method. Qualitative Social Research, 6(2). http://www.qualitative-research.net/index.php/fqs/article/view/466/9*96.
Kehr, E. (2012 [1927]). Der Primat der Innenpolitik. Gesammelte Aufsätze zur preußisch-deutschen Sozialgeschichte im 19. und 20. Jahrhundert. Berlin: Walter De Gruyter & Co.
King, G., Keohane, R. O., & Verba, S. (1994). Designing Social Inquiry. Scientific Inference in Quantitative Research. Princeton, NJ: Princeton University Press.
Kögler, H.-H. (2011). Understanding and Interpretation. In W. Outhwaite & S. P. Turner (Eds.), The Sage Handbook of Social Science Methodology (pp. 363–383). London: Sage.
Levy, J. S. (2002). Qualitative Methods in International Relations. In M. Brecher & F. P. Harvey (Eds.), Millennial Reflections on International Studies (pp. 432–454). Ann Arbor, MI: University of Michigan Press.
Levy, J. S. (2007). Theory, Evidence, and Politics in the Evolution of Research Programs. In R. N. Lebow & M. I. Lichbach (Eds.), Theory and Evidence in Comparative Politics and International Relations. New York, NY: Palgrave Macmillan.
Levy, J. S. (2008). Case Studies: Types, Designs, and Logics of Inference. Conflict Management and Peace Science, 25(1), 1–18.
Lieberson, S. (1992). Small N’s and Big Conclusions: An Examination of the Reasoning in Comparative Studies Based on a Small Number of Cases. In C. C. Ragin & H. S. Becker (Eds.), What Is a Case? Exploring the Foundations of Social Inquiry (pp. 105–118). Cambridge: Cambridge University Press.
Lijphart, A. (1971). Comparative Politics and Comparative Method. American Political Science Review, 65(3), 682–698.
Lijphart, A. (1975). The Comparable-Cases Strategy in Comparative Research. Comparative Political Studies, 8(2), 158–177.
Lombardi, B. (2008). All Politics Is Local: Germany, the Bundeswehr, and Afghanistan. International Journal, 63(3), 587–605.
Machiavelli, N. (1961 [1531]). The Prince. Harmondsworth: Penguin.
Mackie, J. L. (1965). Causes and Conditions. American Philosophical Quarterly, 4(2), 245–264.
Mill, J. S. (2002 [1891]). A System of Logic. Honolulu; HI: University Press of the Pacific.
Mitchell, J. Clyde. (1983). Case and Situational Analysis. Sociological Review, 31(2), 187–211.
Mjøset, L. (2009). The Contextualist Approach to Social Science Methodology. In D. Byrne & C. C. Ragin (Eds.), Case-Based Methods (pp. 39–68). London: Sage.
Møller, J. (2015). Statsdannelse, regimeforandring og økonomisk udvikling. Copenhagen: Hans Reitzels Forlag.
Moore, B. (1966). Social Origins of Dictatorship and Democracy. Boston, MA: Beacon Press.
Moses, J. W., & Knutsen, T. L. (2012). Ways of Knowing. Competing Methodologies in Social and Political Science. London: Palgrave Macmillan.
Olson, M. (1971). The Logic of Collective Action: Public Goods and the Theory of Groups. Cambridge, MA: Harvard University Press.
Olson, M., & Zeckhauser, R. (1966). An Economic Theory of Alliances. The Review of Economics and Statistics, 48(3), 266–279.
Outhwaite, W., & Turner, S. P. (Eds.). (2011). The Sage Handbook of Social Science Methodology. London: Sage.
Platt, J. (2007). Case Study. In W. Outhwaite & S. P. Turner (Eds.), The Sage Handbook of Social Science Methodology (pp. 102–127). London: Sage.
Pouliot, V. (2015). Practice Tracing. In A. Bennett & J. T. Checkel (Eds.), Process Tracing. From Metaphor to Analytical Tool (pp. 102–127). Cambridge: Cambridge University Press.
Przeworski, A., & Teune, H. (1970). The Logic of Comparative Social Inquiry. New York, NY: Wiley.
Ragin, C. C. (undated). What Is Qualitative Comparative Analysis? Tucson, AZ: University of Arizona. http://eprints.ncrm.ac.uk/250/1/What_is_QCA.pdf.
Ragin, C. C. (1987). The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies. Oakland, CA: University of California Press.
Ragin, C. C. (1994). Constructing Social Research. The Unity and Diversity of Method. Thousand Oaks, CA: Pine Forge Press.
Ragin, C. C. (2000). Fuzzy-Set Social Science. Chicago, IL: University of Chicago Press.
Ragin, C. C. (2007). Comparative Methods. In W. Outhwaite & S. P. Turner (Eds.), The Sage Handbook of Social Science Methodology (pp. 67–81). London: Sage.
Ragin, C. C. (2008). Redesigning Social Inquiry: Fuzzy Sets and Beyond. Chicago, IL: University of Chicago Press.
Ragin, C. C. (2009). Qualitative Comparative Analysis Using Fuzzy Sets (fsQCA). In B. Rihoux & C. C. Ragin (Eds.), Configurational Comparative Methods. Qualitative Comparative Analysis and Related Techniques (pp. 87–122). Los Angeles, CA: Sage.
Ragin, C. C., & Becker, H. S. (Eds.). (1992). What Is a Case? Exploring the Foundations of Social Inquiry. Cambridge: Cambridge University Press.
Rihoux, B. (2013). QCA 25 Years After “The Comparative Method”: Mapping, Challenges, and Innovations—Mini-Symposium. Political Research Quarterly, 66(2), 167–235.
Rihoux, B., & De Meur, G. (2009). Crisp-Set Qualitative Comparative Analysis. In B. Rihoux & C. C. Ragin (Eds.), Configurational Comparative Methods. Qualitative Comparative Analysis and Related Techniques (pp. 33–68). Los Angeles, CA: Sage.
Rihoux, B., & Ragin, C. C. (Eds.). (2009). Configurational Comparative Methods. Qualitative Comparative Analysis and Related Techniques. Los Angeles, CA: Sage.
Rose, G. (1998). Neoclassical Realism and Theories of Foreign Policy. World Politics, 51(1), 144–172.
Rosenau, J. N. (Ed.). (1974). Comparing Foreign Policies: Theories, Findings, and Methods. New York, CA: Wiley.
Rynning, S., & Guzzini, S. (2002). Realism and Foreign Policy Analysis. In F. Charillon (Ed.), Politique etrangere: Nouveaux regards. Paris: Universitaires de France.
Sambanis, N. (2004). What Is Civil War? Conceptual and Empirical Complexities of an Operational Definition. Journal of Conflict Resolution, 48(6), 814–858.
Schneider, S. L. (2007). Experimental and Quasi-experimental Designs in Behavioral Research: On Context, Crud, and Convergence. In W. Outhwaite & S. P. Turner (Eds.), The Sage Handbook of Social Science Methodology (pp. 172–189). London: Sage.
Simons, H. (2009). Case Study Research in Practice. London: Sage.
Skocpol, T. (1979). States and Social Revolutions: A Comparative Analysis of France, Russia, and China. New York, NY: Cambridge University Press.
Smelser, N. J. (1973). The Methodology in the Social Sciences. In D. P. Warwick & S. D. Osherson (Eds.), Comparative Research Methods (pp. 42–86). Englewood Cliffs, NJ: Prentice-Hall.
Smith, S., Hadfield, A., & Dunne, T. (Eds.). (2008). Foreign Policy: Theories, Actors, Cases. Oxford: Oxford University Press.
Snyder, G. H. (1984). The Security Dilemma in Alliance Politics. World Politics, 36(4), 461–495.
Stake, R. E. (1995). The Art of Case Study Research. London: Sage.
Tarrow, S. (1995). The Europeanisation of Conflict: Reflections from a Social Movement Perspective. West European Politics, 18(2), 223–251.
Thies, C. G., & Breuning, M. (2012). Integrating Foreign Policy Analysis and International Relations Through Role Theory. Foreign Policy Analysis, 8(1), 1–4.
Thomas, G. (2011). A Typology of the Case Study in Social Science Following a Review of Definition, Discourse, and Structure. Qualitative Inquiry, 17(6), 511–521.
Van Evera, S. (1997). Guide to Methods for Students of Political Science. Itacha, NY: Cornell University Press.
Vennesson, P. (2008). Case Study and Process Tracing: Theories and Practices. In D. Della Porta & M. Keating (Eds.), Approaches and Methodologies in the Social Sciences. A Pluralist Perspective (pp. 223–239). Cambridge: Cambridge University Press.
Wicks, D. (2012). Deviant Case Analysis. In A. J. Mills, G. Durepos, & E. Wiebe (Eds.), Encyclopedia of Case Study Research (pp. 290–291). London: Sage.
Wieviorka, M. (1992). Case Studies: History or Sociology? In C. C. Ragin & H. S. Becker (Eds.), What Is a Case? Exploring the Foundations of Social Inquiry (pp. 159–172). Cambridge: Cambridge University Press.
Wolf, E. R. (1968). Peasant Wars of the Twentieth Century. New York, NY: Harper & Row.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2019 The Author(s)
About this chapter
Cite this chapter
Fermann, G. (2019). Considerations and Recommendations for the Gathering and Analyses of Data. In: Coping with Caveats in Coalition Warfare. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-319-92519-6_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-92519-6_11
Published:
Publisher Name: Palgrave Macmillan, Cham
Print ISBN: 978-3-319-92518-9
Online ISBN: 978-3-319-92519-6
eBook Packages: Political Science and International StudiesPolitical Science and International Studies (R0)