Skip to main content

Composite Indicators for Sustainability Assessment: Methodological Developments

  • Conference paper
  • First Online:
  • 735 Accesses

Abstract

Problems such as climate change, environmental pollution and depletion of natural resources pave the way of sustainable development. Past two decades have seen the development of numerous indicators for sustainable development to support policy analysis and decision making. Recently, composite indicators have evolved as a popular analytical tool for sustainability assessment. The construction of composite sustainability indicators involves not only the determination of underlying indicators but also their weighting and aggregation. This chapter provides a systematic and up-to-date review of recent methodological developments in constructing composite sustainability indicators, which range from normalization methods to aggregation models. The pros and cons of each method/model have been discussed. Other fundamental aspects, e.g. the principles of selecting aggregation function and robustness analysis, are also discussed.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Allen, R., Athanassopoulos, A., Dyson, R.G., Thanassoulis, E., 1997. Weights restrictions and value judgements in data envelopment analysis: Evolution, development and future directions. Annals of Operations Research 73, 13–34.

    Google Scholar 

  • Athanassoglou, S., 2015. Revisiting worst-case DEA for composite Indicators. Social Indicators Research 128(3), 1259–1272.

    Google Scholar 

  • Ayres, R.U., van den Bergh, J.C.J.M., Gowdy, J., 1998. Viewpoint: Weak versus strong sustainability. Tinbergen Institute Discussion Paper (No. 98-103/3).

    Google Scholar 

  • Baumgärtner, S. Quaas, M., 2010. What is sustainability economics? Ecological Economics 69(3), pp. 445–450.

    Google Scholar 

  • Becker, J., 2005. Measuring progress towards sustainable development: An ecological framework for selecting indicators. Local Environment 10, 87–101.

    Google Scholar 

  • Blancard, S., Hoarau, J.-F., 2013. A new sustainable human development indicator for small island developing states: A reappraisal from data envelopment analysis. Economic Modelling 30, 623–635.

    Google Scholar 

  • Blancas, F. J., Caballero, R., González, M., Lozano-Oyola, M., Pérez, F. 2010. Goal programming synthetic indicators: An application for sustainable tourism in Andalusian coastal counties. Ecological Economics 69(11), 2158–2172.

    Google Scholar 

  • Booysen, F., 2002. An overview and evaluation of composite indices of development. Social Indicators Research 59, 115–151.

    Google Scholar 

  • Botta, E., Kozluk, T. 2014. Measuring environmental policy stringency in OECD countries: A composite index approach. OECD Economics Department Working Papers, No. 1177, OECD Publishing, Paris.

    Google Scholar 

  • Böhringer, C., Jochem, P.E., 2007. Measuring the immeasurable—A survey of sustainability indices. Ecological Economics 63, 1–8.

    Google Scholar 

  • Cai, H., Chen, Y., Gong, Q., 2016. Polluting thy neighbor: Unintended consequences of China’s pollution reduction mandates. Journal of Environmental Economics and Management 76, 86–104.

    Google Scholar 

  • Chen, S., Chen, X., Xu, J., 2016. Impacts of climate change on agriculture: Evidence from China. Journal of Environmental Economics and Management 76, 105–124.

    Google Scholar 

  • Cherchye, L., Kuosmanen, T., 2004. Benchmarking sustainable development: A synthetic meta-index approach. Research Paper, UNU-WIDER, United Nations University.

    Google Scholar 

  • Cherchye, L., Lovell, C.K., Moesen, W., Van Puyenbroeck, T., 2007a. One market, one number? A composite indicator assessment of EU internal market dynamics. European Economic Review 51, 749–779.

    Google Scholar 

  • Cherchye, L., Moesen, W., Rogge, N., Van Puyenbroeck, T., 2007b. An introduction to ‘benefit of the doubt’ composite indicators. Social Indicators Research 82, 111–145.

    Google Scholar 

  • Cherchye, L., Moesen, W., Rogge, N., Van Puyenbroeck, T., Saisana, M., Saltelli, A., Liska, R., Tarantola, S., 2008. Creating composite indicators with DEA and robustness analysis: The case of the Technology Achievement Index. Journal of the Operational Research Society 59, 239–251.

    Google Scholar 

  • Decancq, K., Lugo, M.A., 2013. Weights in multidimensional indices of wellbeing: An overview. Econometric Reviews 32, 7–34.

    Google Scholar 

  • Despotis, D., 2005a. Measuring human development via Data Envelopment Analysis: The case of Asia and the Pacific. Omega 33, 385–390.

    Google Scholar 

  • Despotis, D., 2005b. A reassessment of the Human Development Index via Data Envelopment Analysis. Journal of the Operational Research Society 56, 969–980.

    Google Scholar 

  • Dı́az-Balteiro, L., Romero, C., 2004. In search of a natural systems sustainability index. Ecological Economics 49, 401–405.

    Google Scholar 

  • Dietz, S., Neumayer, E., 2007. Weak and strong sustainability in the SEEA: Concepts and measurement. Ecological Economics 61, 617–626.

    Google Scholar 

  • Domínguez-Serrano, M., Blancas, F.J., 2011. A gender wellbeing composite indicator: The best-worst global evaluation approach. Social Indicators Research 102, 477–496.

    Google Scholar 

  • Dong, F., Mitchell, P.D., Colquhoun, J., 2015. Measuring farm sustainability using data envelope analysis with principal components: The case of Wisconsin cranberry. Journal of Environmental Management 147, 175–183.

    Google Scholar 

  • Ebert, U., Welsch, H., 2004. Meaningful environmental indices: A social choice approach. Journal of Environmental Economics and Management 47, 270–283.

    Google Scholar 

  • Esty, D.C., Levy, M., Srebotnjak, T., De Sherbinin, A., 2005. Environmental sustainability index: benchmarking national environmental stewardship. New Haven: Yale Center for Environmental Law & Policy.

    Google Scholar 

  • Floridi, M., Pagni, S., Falorni, S., Luzzati, T., 2011. An exercise in composite indicators construction: Assessing the sustainability of Italian regions. Ecological Economics 70, 1440–1447.

    Google Scholar 

  • Freudenberg, M. 2003. Composite indicators of country performance: A critical assessment, OECD Science, Technology and Industry Working Papers, No. 2003/16, OECD Publishing, Paris.

    Google Scholar 

  • Fusco, E., 2015. Enhancing non-compensatory composite indicators: A directional proposal. European Journal of Operational Research 242, 620–630.

    Google Scholar 

  • Gómez-Limón, J.A., Riesgo, L., 2009. Alternative approaches to the construction of a composite indicator of agricultural sustainability: An application to irrigated agriculture in the Duero basin in Spain. Journal of Environmental Management 90, 3345–3362.

    Google Scholar 

  • Gómez-Limón, J.A., Sanchez-Fernandez, G., 2010. Empirical evaluation of agricultural sustainability using composite indicators. Ecological Economics 69, 1062–1075.

    Google Scholar 

  • Grupp, H., Schubert, T., 2010. Review and new evidence on composite innovation indicators for evaluating national performance. Research Policy 39, 67–78.

    Google Scholar 

  • Hák, T., Moldan, B., Dahl, A.L., 2012. Sustainability indicators: A scientific assessment. Island Press.

    Google Scholar 

  • Hajkowicz, S., 2006. Multi-attributed environmental index construction. Ecological Economics 57, 122–139.

    Google Scholar 

  • Hatefi, S., Torabi, S., 2010. A common weight MCDA–DEA approach to construct composite indicators. Ecological Economics 70, 114–120.

    Google Scholar 

  • Hatefi, S.M. and Torabi, S.A., 2016. A slack analysis framework for improving composite indicators with applications to human development and sustainable energy indices. Econometric Reviews.

    Google Scholar 

  • He, G., Fan, M., Zhou, M., 2016. The effect of air pollution on mortality in China: Evidence from the 2008 Beijing Olympic Games. Journal of Environmental Economics and Management 79, 18–39.

    Google Scholar 

  • Hope, C., Parker, J., Peake, S., 1992. A pilot environmental index for the UK in the 1980s. Energy Policy 20, 335–343.

    Google Scholar 

  • Hsu, A., de Sherbinin, A. C., Esty, D., Levy, M., 2016. Environmental Performance Index. New Haven, CT: Yale University. Available: www.epi.yale.edu.

  • Intergovernmental Panel on Climate Change (IPCC), 2001. Climate Change 2001: The Scientific Basis. Intergovernmental Panel on Climate Change, Cambridge University Press, Cambridge, UK.

    Google Scholar 

  • Kang, S.M., 2002. A sensitivity analysis of the Korean composite environmental index. Ecological Economics 43, 159–174.

    Google Scholar 

  • Kang, S.M., Kim, M.S., Lee, M., 2002. The trends of composite environmental indices in Korea. Journal of Environmental Management 64, 199–206.

    Google Scholar 

  • Kao, C., 2010. Malmquist productivity index based on common-weights DEA: The case of Taiwan forests after reorganization. Omega 38, 484–491.

    Google Scholar 

  • Kao, C., Wu, W.-Y., Hsieh, W.-J., Wang, T.-Y., Lin, C., Chen, L.-H., 2008. Measuring the national competitiveness of Southeast Asian countries. European Journal of Operational Research 187, 613–628.

    Google Scholar 

  • Krajnc, D., Glavič, P., 2005. A model for integrated assessment of sustainable development. Resources, Conservation and Recycling 43, 189–208.

    Google Scholar 

  • Lovell, C.A.K., 1995. Measuring the macroeconomic performance of the Taiwanese economy. International Journal of Production Economics 39, 165–178.

    Google Scholar 

  • Lovell, C.A.K., Pastor, J.T., Turner, J.A., 1995. Measuring macroeconomic performance in the OECD: A comparison of European and non-European countries. European Journal of Operational Research 87, 507–518.

    Google Scholar 

  • Mahlberg, B., Obersteiner, M., 2001. Remeasuring the HDI by Data Envelopement Analysis. Available at SSRN 1999372.

    Google Scholar 

  • Martinez-Alier, J., Munda, G., O’Neill, J., 1998. Weak comparability of values as a foundation for ecological economics. Ecological Economics 26, 277–286.

    Google Scholar 

  • Mayer, A.L., 2008. Strengths and weaknesses of common sustainability indices for multidimensional systems. Environment International 34, 277–291.

    Google Scholar 

  • Mori, K., Christodoulou, A., 2012. Review of sustainability indices and indicators: Towards a new City Sustainability Index (CSI). Environmental Impact Assessment Review 32, 94–106.

    Google Scholar 

  • Munda, G., 2005. Measuring sustainability: A multi-criterion framework. Environment, Development and Sustainability 7, 117–134.

    Google Scholar 

  • Munda, G., Nardo, M., 2003. On the methodological foundations of composite indicators used for ranking countries. Ispra, Italy: Joint Research Centre of the European Communities.

    Google Scholar 

  • Munda, G., Nardo, M., 2009. Noncompensatory/nonlinear composite indicators for ranking countries: A defensible setting. Applied Economics 41, 1513–1523.

    Google Scholar 

  • Munda, G., Saisana, M., 2011. Methodological considerations on regional sustainability assessment based on multicriteria and sensitivity analysis. Regional Studies 45, 261–276.

    Google Scholar 

  • Murillo, J., Romaní, J., Suriñach, J., 2015. The business excellence attraction composite index (BEACI) in small areas. Design and application to the municipalities of the Barcelona province. Applied Economics 47, 161–179.

    Google Scholar 

  • Nardo, M., Saisana, M., Saltelli, A., Tarantola, S., Giovannini, E., Hoffmann, A., 2008. Handbook on constructing composite indicators: Methodology and User guide. OECD publishing.

    Google Scholar 

  • Ness, B., Urbel-Piirsalu, E., Anderberg, S., & Olsson, L. 2007. Categorising tools for sustainability assessment. Ecological Economics 60(3), 498–508.

    Google Scholar 

  • Neumayer, E., 2001. The human development index and sustainability—A constructive proposal. Ecological Economics 39, 101–114.

    Google Scholar 

  • Neumayer, E., 2013. Weak versus strong sustainability: Exploring the limits of two opposing paradigms. Edward Elgar Publishing.

    Google Scholar 

  • Oxford City Council (OCC), 2016. Oxford Sustainability Index Report 2016. https://www.oxford.gov.uk/downloads/file/2655/oxford_sustainability_index_2016.

  • Pakkar, M.S., 2014. Using Data Envelopment Analysis and Analytic Hierarchy Process to construct composite indicators. Journal of Applied Operational Research 6, 174–187.

    Google Scholar 

  • Parris, T.M., Kates, R.W., 2003. Characterizing and measuring sustainable development. Annual Review of Environment and Resources 28, 559–586.

    Google Scholar 

  • Pollesch, N., Dale, V., 2015. Applications of aggregation theory to sustainability assessment. Ecological Economics 114, 117–127.

    Google Scholar 

  • Pollesch, N., Dale, V., 2016. Normalization in sustainability assessment: Methods and implications. Ecological Economics 130, 195–208.

    Google Scholar 

  • Rogge, N., 2012. Undesirable specialization in the construction of composite policy indicators: The Environmental Performance Index. Ecological Indicators 23, 143–154.

    Google Scholar 

  • Saisana, M., Tarantola, S., Saltelli, A., 2005. Uncertainty and sensitivity techniques as tools for the analysis and validation of composite indicators. Journal of the Royal Statistical Society A 168, 1–17.

    Google Scholar 

  • Sala, S., Ciuffo, B., Nijkamp, P., 2015. A systemic framework for sustainability assessment. Ecological Economics 119, 314–325.

    Google Scholar 

  • Shen, Y., Hermans, E., Brijs, T., Wets, G., 2013. Data Envelopment Analysis for composite indicators: A multiple layer model. Social Indicators Research 114, 739–756.

    Google Scholar 

  • Singh, R.K., Murty, H., Gupta, S., Dikshit, A., 2009. An overview of sustainability assessment methodologies. Ecological Indicators 9, 189–212.

    Google Scholar 

  • Thompson, R.G., Langemeier, L.N., Lee, C.-T., Lee, E., Thrall, R.M., 1990. The role of multiplier bounds in efficiency analysis with application to Kansas farming. Journal of Econometrics 46, 93–108.

    Google Scholar 

  • Tilman, D., Cassman, K.G., Matson, P.A., Naylor, R., Polasky, S., 2002. Agricultural sustainability and intensive production practices. Nature 418, 671–677.

    Google Scholar 

  • Tofallis, C., 2013. An automatic-democratic approach to weight setting for the new Human Development Index. Journal of Population Economics 26, 1325–1345.

    Google Scholar 

  • UNCED, 1992. Rio declaration on environment and development. Report of the United Nations Conference on Environment and Development.

    Google Scholar 

  • UNDP (United Nations Development Programme). 2014. Human development report - Sustaining human progress: Reducing vulnerabilities and building resilience. New York.

    Google Scholar 

  • van den Bergh, J.C.J.M., van Veen-Groot, D.B., 2001. Constructing aggregate environmental-economic indicators: A comparison of 12 OECD countries. Environmental Economics and Policy Studies 4(1), 1–16.

    Google Scholar 

  • Wackernagel, M., & Rees, W. 1998. Our ecological footprint: reducing human impact on the earth (No. 9). New Society Publishers.

    Google Scholar 

  • Wang, H., 2015. A generalized MCDA–DEA (Multi-Criterion Decision Analysis–Data Envelopment Analysis) approach to construct slacks-based composite indicator. Energy 80, 114–122.

    Google Scholar 

  • Wong, Y.-H., Beasley, J., 1990. Restricting weight flexibility in Data Envelopment Analysis. Journal of the Operational Research Society 41(9), 829–835.

    Google Scholar 

  • Yoon, K.P., Hwang, C.-L., 1995. Multiple attribute decision making: An introduction. Sage publications.

    Google Scholar 

  • World Commission on Environment Development (WCED), 1987. Our common future. Oxford University Press.

    Google Scholar 

  • World Energy Council (WEC), 2016. World Energy Trilemma Index: Benchmarking the sustainability of national energy systems. https://trilemma.worldenergy.org/reports/main/2016/2016%20Energy%20Trilemma%20Index.pdf.

  • Zaim, O., Färe, R., Grosskopf, S., 2001. An economic approach to achievement and improvement indexes. Social Indicators Research 56(1), 91–118.

    Google Scholar 

  • Zanella, A., Camanho, A.S., Dias, T.G., 2015. Undesirable outputs and weighting schemes in composite indicators based on Data Envelopment Analysis. European Journal of Operational Research 245, 517–530.

    Google Scholar 

  • Zeleny, M., Cochrane, J.L., 1981. Multiple criteria decision making. Mcgraw-Hill.

    Google Scholar 

  • Zhou, P., Ang, B. W. 2008. Indicators for assessing sustainability performance. In: Handbook of Performability Engineering (905–918). Springer London.

    Google Scholar 

  • Zhou, P., Ang, B., 2009. Comparing MCDA aggregation methods in constructing composite indicators using the Shannon-Spearman measure. Social Indicators Research 94, 83–96.

    Google Scholar 

  • Zhou, P., Ang, B., Poh, K., 2006a. Comparing aggregating methods for constructing the composite environmental index: An objective measure. Ecological Economics 59, 305–311.

    Google Scholar 

  • Zhou, P., Ang, B. W., Poh, K. L. 2006b. Slacks-based efficiency measures for modeling environmental performance. Ecological Economics 60(1), 111–118.

    Google Scholar 

  • Zhou, P., Ang, B., Poh, K., 2007. A mathematical programming approach to constructing composite indicators. Ecological Economics 62, 291–297.

    Google Scholar 

  • Zhou, P., Ang, B., Zhou, D., 2010. Weighting and aggregation in composite indicator construction: a multiplicative optimization approach. Social Indicators Research 96, 169–181.

    Google Scholar 

  • Zhou, P., Delmas, M.A., Kohli, A., 2017. Constructing meaningful environmental indices: A nonparametric frontier approach. Journal of Environmental Economics and Management 85, 21–34.

    Google Scholar 

Download references

Acknowledgements

We are grateful to the financial support provided by the National Natural Science Foundation of China (nos. 71273005 & 71573119) and the Funding of Jiangsu Innovation Program for Graduate Education (KYZZ16_0159).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to P. Zhou .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhou, P., Zhang, L.P. (2018). Composite Indicators for Sustainability Assessment: Methodological Developments. In: Pang, R., Bai, X., Lovell, K. (eds) Energy, Environment and Transitional Green Growth in China. Springer, Singapore. https://doi.org/10.1007/978-981-10-7919-1_2

Download citation

Publish with us

Policies and ethics