# Visualising multi-criteria weight elicitation by multiple stakeholders in complex decision systems

- 19 Downloads

## Abstract

An efficient and transparent weight elicitation technique is proposed for inclusion into the adaptive, systemic, control and multi-criteria-based methodology, in short ASCM, the purpose of which is piloting in real time complex systems by combining system dynamics (SD) and multi-criteria decision analysis (MCDA). Piloting policies are established and revised on a regular basis and/or constant real-time observation by means of SD simulations; at each revision step groups of stakeholders choose by means of MCDA tools the best policy to be implemented for the ensuing time periods when adaptations are necessary to account for the actual system evolution. An essential but difficult issue at each policy revision step is the weight elicitation process of multiple criteria by the multiple stakeholder groups (SH). The proposed procedure with a strong mathematical background does not require excessive cognitive effort for SH with different priorities and decisional powers. It consists in a two-step approach defining firstly importance classes on ordinal Likert scales, and secondly profiles on those scales for the criteria. It appears to be simple though rigorous; it easily allows fast sensitivity analyses when confronting different opinions. A didactic example and a fishery-management case study illustrate these properties by means of visualisation tools facilitating consensus-seeking among SH.

## Keywords

Complex systems Multiple criteria Weight elicitation Multiple stakeholders Visualisation tools## Mathematics Subject Classification

90B50## Notes

## References

- Ahn BS (2017) Approximate weighting method for multiattribute decision problems with imprecise parameters. Omega 72:87–95CrossRefGoogle Scholar
- Arnold BC, Balakrishnan N, Nagaraja N (1992) A first course in order statistics. Wiley, New YorkGoogle Scholar
- Barron FH (1992) Selecting a best multiattribute alternative with partial information about attribute weights. Acta Physiol (Oxf) 80(1–3):91–103Google Scholar
- Barron FH, Barrett BE (1996) Decision quality using ranked attribute weights. Manag Sci 42(21):1515–1523CrossRefGoogle Scholar
- Behzadian M, Kazemzadeh RB, Albadvi A, Aghdasi M (2010) PROMETHEE: a comprehensive literature review on methodologies and applications. Eur J Oper Res 200(1):198–215. https://doi.org/10.1016/j.ejor.2009.01.021 CrossRefGoogle Scholar
- Brans JP, Kunsch PL (2010) Ethics in operations research and sustainable development. Int Trans Oper Res (ITOR) 17:427–444CrossRefGoogle Scholar
- Brans JP, Mareschal B (2016) PROMETHEE methods. In: Figueira J, Greco S, Ehrgott M (eds) Multiple criteria decision analysis: state of the art surveys, 2nd edn. Springer, LondonGoogle Scholar
- Brans JP, Vincke P (1985) A preference ranking organization method. Manag Sci 31(6):647–656CrossRefGoogle Scholar
- Brans JP, Macharis C, Kunsch PL, Chevalier A, Schwaninger M (1998) Combining multicriteria decision aid and system dynamics for the control of socio-economic processes. An iterative real-time procedure. Eur J Oper Res 109:428–441CrossRefGoogle Scholar
- Brans JP, Kunsch PL, Mareschal B (2001) Management of the future. A system dynamics and MCDA approach. In: Bouyssou D, Jacquet-Lagrèze E, Perny P, Slowinski R, Vanderpooten D, Vincke P (eds) Special volume dedicated to Professor Bernard Roy. Kluwer Academic Publishers, Dordrecht, pp 483–502Google Scholar
- Figueira J, Roy B (2002) Determining the weights of criteria in the ELECTRE type methods with a revised Simos’ procedure. Eur J Oper Res 139:317–326CrossRefGoogle Scholar
- Figueira J, Greco S, Ehrgott M (2016) Multiple criteria decision analysis: state of the art surveys, 2nd edn. Springer, BostonGoogle Scholar
- Ishizaka A, Nemery Ph (2013) Multi-criteria decision analysis. Methods and software. Wiley, ChichesterCrossRefGoogle Scholar
- Klimberg R, Cohen RM (1999) Experimental evaluation of a graphical display system to visualizing multiple criteria solutions. Eur J Oper Res 119(1):191–208CrossRefGoogle Scholar
- Kunsch PL, Ishizaka A (2018) Multiple-criteria performance ranking based on profile distributions: an application to university research evaluations. Math Comput Simul 154:48–64. https://doi.org/10.1016/j.matcom.2018.05.021 CrossRefGoogle Scholar
- Kunsch PL, Kavathatzopoulos I, Rauschmayer F (2009) Modelling complex ethical decision problems with operations research. Omega Spec Issue Ethics and Oper Res 37(6):1100–1108Google Scholar
- Mareschal B (2014) Visual PROMETHEE 1.4 Academic Edition (freeware) http://www.promethee-gaia.net/software.html
- Miettinen K (2014) Survey of methods to visualize alternatives in multiple criteria decision making problems. OR Spectr 36(1):3–37. https://doi.org/10.1007/s00291-012-0297-0 CrossRefGoogle Scholar
- Miller GA (1956) The magic number seven plus or minus two: some limits on our capacity for processing information. Psychol Rev 13:81–97CrossRefGoogle Scholar
- Simos J (1990) Evaluer l’impact sur l’environnement: Une approche originale par l’analyse multicritère et la négociation. (Evaluate the impact on the environment. A new approach based on multi-criteria analysis and negotiation), Presses Polytechniques et Universitaires Romandes, Lausanne, SwitzerlandGoogle Scholar
- Sterman JD (2000) Business dynamics—systems thinking and modeling for a complex world. Irwin McGraw-Hill, BostonGoogle Scholar
- Stillwell WG, Seaver DA, Edwards W (1981) A comparison of weight approximation techniques in multiattribute utility decision making. Organ Behav Hum Perform 38:62–77CrossRefGoogle Scholar
- Ventana Systems, Inc. RightChoice © (2001) www.ventanasystems.co.uk/services/software/rightchoice
- Ventana Systems, Inc. Vensim © (2010) User Guide & Software www.vensim.com
- Wang J, Zionts S (2015) Using ordinal data to estimate cardinal values. J Multi-Criteria Decis Anal 22:185–196CrossRefGoogle Scholar