Skip to main content

Probability and Beyond: Including Uncertainties in Decision Analysis

  • Chapter
  • First Online:
Behavioral Operational Research

Abstract

This chapter presents behavioral issues arising from various approaches for including risk and uncertainty in multi-criteria decision analysis (MCDA). The chapter is a behaviorally oriented reassessment and reinterpretation of our earlier reviews on uncertainty modeling in MCDA, updated to include recent developments. We review the limitations of probability models and how these limitations can be partially overcome, while remaining in a conventional probability modeling framework, through the use of debiasing tools. We then focus on an approach outside of the conventional probability framework: the use of scenario planning. While scenario planning is not in its origins a quantitative tool, it is often so adopted in OR, with quantification of alternative performances, preference parameters, and even dubious assignment of scenario probabilities. We discuss different ways in which authors have interpreted these quantities, and assess the behavioral implications of these. Under this heading, we discuss cognitive perceptions of scenarios; the validity of viewing performance under a scenario as a dimension of preference, akin to a criterion; and the implications of treating decision aiding under uncertainty as an extended multi-criterion problem.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Note that these approaches do not employ probability concepts, although they do include other quantitative features which we outline in the next two sections.

References

  • Ackerman, F., & Eden, C. (2012). Making Strategy, Mapping Out Strategic Success. London: Sage.

    Google Scholar 

  • Amer, M., Daim, T. U., & Jetter, A. (2013). A review of scenario planning. Futures, 46, 23–40.

    Article  Google Scholar 

  • Arkes, H. (1991). Costs and benefits of judgment errors: Implications for debiasing. Psychological Bulletin, 110(3), 486–498.

    Article  Google Scholar 

  • Belton, V., & Stewart, T. (2002). Multiple Criteria Decision Analysis: An Integrated Approach. Boston: Kluwer Academic.

    Book  Google Scholar 

  • Bradfield, R., Wright, G., Burt, G., Cairns, G., & Van Der Heijden, K. (2005). The origins and evolution of scenario techniques in long range business planning. Futures, 37(8), 795–812.

    Article  Google Scholar 

  • Bryson, S., Grime, M., Murthy, A., & Wright, G. (2016). Behavioral issues in the practical application of scenario thinking: Cognitive biases, effective group facilitation and overcoming business-as-usual thinking. In M. Kunc, J. Malpass, & L. White (Eds.), Behavioral Operational Research: Theory, Methodology and Practice (pp. 195–212). London: Palgrave Macmillan.

    Chapter  Google Scholar 

  • Cairns, G., Goodwin, P., & Wright, G. (2016). A decision-analysis-based framework for analysing stakeholder behaviour in scenario planning. European Journal of Operational Research, 249(3), 1050–1062.

    Article  Google Scholar 

  • Cairns, G., Wright, G., Bradfield, R., van der Heijden, K., & Burt, G. (2004). Exploring e-government futures through the application of scenario planning. Technological Forecasting and Social Change, 71(3), 217–238.

    Article  Google Scholar 

  • Derbyshire, J. (2017). Potential surprise theory as theoretical foundation for scenario planning. Technological Forecasting and Social Change, 124, 77–87.

    Article  Google Scholar 

  • Derbyshire, J., & Wright, G. (2014). Preparing for the future: Development of an antifragile methodology that complements scenario planning by omitting causation. Technological Forecasting and Social Change, 82, 215–225.

    Article  Google Scholar 

  • Derbyshire, J., & Wright, G. (2017). Augmenting the intuitive logics scenario planning method for a more comprehensive analysis of causation. International Journal of Forecasting, 33(1), 254–266.

    Article  Google Scholar 

  • Durbach, I. N. (2014). Outranking under uncertainty using scenarios. European Journal of Operational Research, 232(1), 98–108.

    Article  Google Scholar 

  • Durbach, I. N., & Stewart, T. (2012). Modelling uncertainty in multi-criteria decision analysis. European Journal of Operational Research, 223(1), 1–14.

    Article  Google Scholar 

  • Favato, G., & Vecchiato, R. (2017). Embedding real options in scenario planning: A new methodological approach. Technological Forecasting and Social Change, 124, 135–149.

    Article  Google Scholar 

  • French, S. (1995). Uncertainty and imprecision: Modelling and analysis. Journal of the Operational Research Society, 46, 70–79.

    Article  Google Scholar 

  • French, S., Maule, J., & Papamichail, N. (2009). Decision Behaviour, Analysis and Support. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Garthwaite, P., Kadane, J., & O’Hagan, A. (2005). Statistical methods for eliciting probability distributions. Journal of the American Statistical Association, 100(470), 680–701.

    Article  Google Scholar 

  • Gilovich, T., Griffin, D., & Kahneman, D. (2002). Heuristics and Biases: The Psychology of Intuitive Judgment. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Goodwin, P., & Wright, G. (2009). Decision Analysis for Management Judgement (4th ed.). Chichester: Wiley.

    Google Scholar 

  • Greco, S., Matarazzo, B., & Slowinski, R. (2001). Rough sets theory for multicriteria decision analysis. European Journal of Operational Research, 129, 1–47.

    Article  Google Scholar 

  • Johnson, J., & Bruce, A. (2001). Calibration of subjective probability judgments in a naturalistic setting. Organizational Behavior and Human Decision Processes, 85(2), 265–290.

    Article  Google Scholar 

  • Kahneman, D., & Egan, P. (2011). Thinking, Fast and Slow (Vol. 1). New York: Farrar, Straus and Giroux.

    Google Scholar 

  • Keeney, R., & Raiffa, H. (1993). Decisions with Multiple Objectives: Preferences and Value Tradeoffs. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Kynn, M. (2008). The heuristics and biases bias in expert elicitation. Journal of the Royal Statistical Society: Series a (Statistics in Society), 171(1), 239–264.

    Google Scholar 

  • Larrick, R. (2007). Debiasing. In D. Koehler & N. Harvey (Eds.), Blackwell Handbook of Judgment and Decision Making (pp. 316–338). Oxford: Blackwell.

    Google Scholar 

  • Lehr, T., Lorenz, U., Willert, M., & Rohrbeck, R. (2017). Scenario-based strategizing: Advancing the applicability in strategists’ teams. Technological Forecasting and Social Change, 124, 214–224.

    Article  Google Scholar 

  • Ludolph, R., & Schulz, P. J. (2018). Debiasing health-related judgments and decision making: A systematic review. Medical Decision Making, 38(1), 3–13.

    Article  Google Scholar 

  • Maier, H. R., Guillaume, J. H., van Delden, H., Riddell, G. A., Haasnoot, M., & Kwakkel, J. H. (2016). An uncertain future, deep uncertainty, scenarios, robustness and adaptation: How do they fit together? Environmental Modelling & Software, 81, 154–164.

    Article  Google Scholar 

  • Montibeller, G., Gummer, H., & Tumidei, D. (2006). Combining scenario planning and multi-criteria decision analysis in practice. Journal of Multi-criteria Decision Analysis, 14, 5–20.

    Article  Google Scholar 

  • Montibeller, G., & von Winterfeldt, D. (2015a). Biases and debiasing in multi-criteria decision analysis. In 2015 48th Hawaii International Conference on System Sciences (HICSS) (pp. 1218–1226).

    Google Scholar 

  • Montibeller, G., & von Winterfeldt, D. (2015b). Cognitive and motivational biases in decision and risk analysis. Risk Analysis, 35(7), 1230–1251.

    Google Scholar 

  • Nemeth, B., Dew, N., & Augier, M. (2018). Understanding some pitfalls in the strategic foresight processes: The case of the Hungarian Ministry of Defense. Futures, 101, 92–102.

    Article  Google Scholar 

  • O’Hagan, A., Buck, C. E., Daneshkhah, A., Eiser, J. R., Garthwaite, P. H., Jenkinson, D. J., et al. (2006). Uncertain Judgements: Eliciting Experts’ Probabilities. Chichester: Wiley.

    Google Scholar 

  • Ram, C., Montibeller, G., & Morton, A. (2010). Extending the use of scenario planning and MCDA for the evaluation of strategic options. Journal of the Operational Research Society, 62(5), 817–829.

    Article  Google Scholar 

  • Schwarz, J. O., Ram, C., & Rohrbeck, R. (2019). Combining scenario planning and business wargaming to better anticipate future competitive dynamics. Futures, 105, 133–142.

    Article  Google Scholar 

  • Shanteau, J. (1992). Competence in experts: The role of task characteristics. Organizational Behavior and Human Decision Processes, 53, 252–266.

    Article  Google Scholar 

  • Soste, L., Wang, Q. J., Robertson, D., Chaffe, R., Handley, S., & Wei, Y. (2015). Engendering stakeholder ownership in scenario planning. Technological Forecasting and Social Change, 91, 250–263.

    Article  Google Scholar 

  • Spaniol, M. J., & Rowland, N. J. (2018). The scenario planning paradox. Futures, 95, 33–43.

    Article  Google Scholar 

  • Spetzler, C., & Stael von Holstein, C.-A. (1975). Probability encoding in decision analysis. Management Science, 22(3), 340–358.

    Article  Google Scholar 

  • Stewart, T. (2005). Dealing with uncertainties in MCDA. In J. Figueira, S. Greco, & M. Ehrgott (Eds.), Multiple Criteria Decision Analysis: State of the Art Surveys (pp. 467–496). Berlin: Springer.

    Google Scholar 

  • Stewart, T. J., & Durbach, I. (2016). Dealing with uncertainties in MCDA. In S. Greco, J. Figueira, & M. Ehrgott (Eds.), Multiple Criteria Decision Analysis (pp. 467–496). New York: Springer.

    Chapter  Google Scholar 

  • Stewart, T. J., French, S., & Rios, J. (2013). Integrating multicriteria decision analysis and scenario planning review and extension. Omega, 41(4), 679–688.

    Article  Google Scholar 

  • Taleb, N. N. (2012). Antifragile: Things That Gain from Disorder (Vol. 3). New York: Random House Incorporated.

    Google Scholar 

  • Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124–1131.

    Article  Google Scholar 

  • Van der Heijden, K. (1996). Scenarios: The Art of Strategic Conversation. New York: Wiley.

    Google Scholar 

  • von Winterfeldt, D., & Edwards, W. (1986). Decision Analysis and Behavioural Research. London: Cambridge University Press.

    Google Scholar 

  • Wright, G., Bradfield, R., & Cairns, G. (2013). Does the intuitive logics method—and its recent enhancements—produce “effective” scenarios? Technological Forecasting and Social Change, 80(4), 631–642.

    Article  Google Scholar 

  • Yang, J. (2001). Rule and utility based evidential reasoning approach for multiattribute decision analysis under uncertainties. European Journal of Operational Research, 131(1), 31–61.

    Article  Google Scholar 

  • Zimmerman, H.-J. (1987). Fuzzy Sets, Decision Making, and Expert Systems. Boston: Kluwer Academic.

    Book  Google Scholar 

  • Zimmerman, H.-J. (2000). An application-oriented view of modeling uncertainty. European Journal of Operational Research, 122, 190–198.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ian N. Durbach .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 The Author(s)

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Durbach, I.N., Stewart, T.J. (2020). Probability and Beyond: Including Uncertainties in Decision Analysis. In: White, L., Kunc, M., Burger, K., Malpass, J. (eds) Behavioral Operational Research. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-030-25405-6_5

Download citation

Publish with us

Policies and ethics