Abstract
The aim of this chapter is to provide guidance regarding the various types and sources of uncertainty that influence the outcome of a multi-criteria decision analysis (MCDA) model. For each MCDA step, i.e., structuring, scoring, weighting, and aggregating, we will describe sources of uncertainty and point to methods to deal with these uncertainties. Also the use of sensitivity analyses and the relevance of qualifying and quantifying uncertainty in MCDA will be discussed. The consideration of uncertainty is a difficult but important balancing act between capturing the complex uncertainties of the decision and keeping the MCDA comprehensible for decision makers.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Belton V, Pictet J (1997) A framework for group decision using a MCDA model: sharing, aggregating or comparing individual information? J Decis Sys 6(3):283–303. Available at: http://www.tandfonline.com/doi/abs/10.1080/12460125.1997.10511726. Accessed 18 Feb 2014
Belton V, Stewart TJ (2002) Multiple criteria decision analysis: an integrated approach, 2nd edn. Kluwer Academic Publishers, Dordrecht
Beynon M, Curry B, Morgan P (2000) The Dempster-Shafer theory of evidence: an alternative approach to multicriteria decision modelling. Omega 28(1):37–50
Bojke L, Soares M (2014) Decision analysis: eliciting experts’ beliefs to characterize uncertainties. Elsevier Ltd. Available at: http://www.sciencedirect.com/science/article/pii/B9780123756787014061
Bojke L et al (2010) Eliciting distributions to populate decision analytic models. Value Health 13(5):557–564
Bouyssou D (1990) Building criteria: a prerequisite for MCDA. In: Readings in multiple criteria decision aid. Springer, Berlin, pp 58–80
Briggs AH et al (2012) Model parameter estimation and uncertainty: a report of the ISPOR-SMDM modeling good research practices task force-6. Value Health 15(6):835–842. Available at: http://www.ncbi.nlm.nih.gov/pubmed/22999133
Broekhuizen H et al (2015a) A review and classification of approaches for dealing with uncertainty in multi-criteria decision analysis for healthcare decisions. Pharmacoeconomics 33(5):445–455
Broekhuizen H et al (2015b) Estimating the value of medical treatments to patients using probabilistic multi criteria decision analysis. BMC Med Info Decis Making 15(1):1–10. Available at: http://dx.doi.org/10.1186/s12911-015-0225-8
Caster O et al (2012) Quantitative benefit-risk assessment using only qualitative information on utilities. Med Decis Making 32(6):E1–E15. Available at: http://www.ncbi.nlm.nih.gov/pubmed/22936214 [Accessed 3 Dec 2012]
Choo EU, Schoner B, Wedley WC (1999) Interpretation of criteria weights in multicriteria decision making. Comput Ind Eng 37(3):527–541. Available at: http://linkinghub.elsevier.com/retrieve/pii/S036083520000019X
Cooperberg MR et al (2012) Primary treatments for clinically localised prostate cancer: a comprehensive lifetime cost-utility analysis. BJU Int 111(3):437–450
Bana E Costa, C. A, De Corte J.-M, Vansnick J.-C (2012) Macbeth. Inter J Info Tech Decision Making 11(02):359–387. Available at: http://www.worldscientific.com/doi/abs/10.1142/S0219622012400068
Durbach IN, Stewart TJ (2012) Modeling uncertainty in multi-criteria decision analysis. Eur J Oper Res 223(1):1–14. Available at: http://linkinghub.elsevier.com/retrieve/pii/S0377221712003591. Accessed 27 Jan 2014
Fenton N, Neil M (2001) Making decisions: using Bayesian nets and MCDA. Knowl Based Syst 14(7):307–325. Available at: http://www.scopus.com/inward/record.url?eid=2-s2.0-0035505967&partnerID=tZOtx3y1. Accessed 18 Feb 2014
French S (1995) Uncertainty and imprecision: modelling and analysis. J Oper Res Soc 46(1):70–79. Available at: http://www.jstor.org/stable/2583837
Hayes J et al (2013) Observation versus initial treatment for men with localized, low-risk prostate cancer. Ann Intern Med 158(12):853–860
IJzerman MJ, Van Til JA et al (2012) A comparison of analytic hierarchy process and conjoint analysis methods in assessing treatment alternatives for stroke rehabilitation. Patient 5(1):45–56. Available at: http://www.ncbi.nlm.nih.gov/pubmed/22185216
IJzerman MJ, Til JA, Snoek GJ (2012) Comparison of two multi-criteria decision techniques for eliciting treatment preferences in people with neurological disorders. Patient Patient-Centered Out Res 1(4):265–272. Available at: http://dx.doi.org/10.2165/1312067-200801040-00008
Ju-Long D (1982) Control problems of grey systems. Syst Control Letters 1(5):288–294. Available at: http://linkinghub.elsevier.com/retrieve/pii/S016769118280025X
Lahdelma R, Hokkanen J (1998) SMAA-stochastic multiobjective acceptability analysis. Eur J Oper 2217(97):137–143. Available at: http://www.sciencedirect.com/science/article/pii/S037722179700163X. Accessed 26 Mar 2012
Liberatore MJ, Nydick RL (2008) The analytic hierarchy process in medical and health care decision making: a literature review. Eur J Oper Res 189(1):194–207
O’Hagan A et al (2006) Uncertain judgements: eliciting expert probabilities. John Wiley & Sons Ltd, Chichester. Available at: http://eu.wiley.com/WileyCDA/WileyTitle/productCd-0470029994.html
Phillips LD (1999) Group elicitation of probability distributions: are many heads better than one? In: Shanteau J, Mellors B, Schum D (eds) Decision science and technol- ogy: reflections on the contributions of ward edwards. Kluwer Academic Publishers, Norwell, p 313–330. Available at: http://eprints.lse.ac.uk/10520/
Rice J (2006) Mathematical statistics and data analysis. Thomson Brooks/Cole Belmont, CA, USA
Taner M, Sezen B, Antony J (2007) An overview of six sigma applications in healthcare industry. Int J Health Care Qual Assur 20(4):329–340
Tervonen T et al (2011) A stochastic multicriteria model for evidence-based decision making in drug benefit-risk analysis. Stat Med 30(12):1419–1428. Available at: http://www.ncbi.nlm.nih.gov/pubmed/21268053. Accessed 26 Mar 2012
van Til J et al (2014) Does technique matter; a pilot study exploring weighting techniques for a multi-criteria decision support framework. Cost Eff Res Allocation 12:22
van Valkenhoef G et al (2012) Multicriteria benefit-risk assessment using network meta-analysis. J Clin Epidemiol 65(4):.394–403. Available at: http://www.ncbi.nlm.nih.gov/pubmed/22197518
Wen S, Zhang L, Yang B (2014) Two approaches to incorporate clinical data uncertainty into multiple criteria decision analysis for benefit-risk assessment of medicinal products. Value Health 17(5):619–628. Available at: http://www.ncbi.nlm.nih.gov/pubmed/25128056. Accessed 21 Aug 2014
Zanakis SH et al (1998) Multi-attribute decision making: a simulation comparison of select methods. Eur J Oper Res 107(3):507–529
Zhou P, Ang BW (2009) Comparing MCDA aggregation methods in constructing composite indicators using the Shannon-Spearman measure. Social Indic Res 94(1):83–96
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this chapter
Cite this chapter
Groothuis-Oudshoorn, C.G.M., Broekhuizen, H., van Til, J. (2017). Dealing with Uncertainty in the Analysis and Reporting of MCDA. In: Marsh, K., Goetghebeur, M., Thokala, P., Baltussen, R. (eds) Multi-Criteria Decision Analysis to Support Healthcare Decisions. Springer, Cham. https://doi.org/10.1007/978-3-319-47540-0_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-47540-0_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-47538-7
Online ISBN: 978-3-319-47540-0
eBook Packages: MedicineMedicine (R0)