Skip to main content

Light and Shade of Multidimensional Indexes

How Methodological Choices Impact on Empirical Results

  • Chapter
  • First Online:

Part of the book series: Social Indicators Research Series ((SINS,volume 48))

Abstract

The aim of this chapter is to discuss and measure the impact on results of three main methodological assumptions in the construction of multidimensional indexes of poverty and well-being – namely, the transformation function, the aggregation procedure and the weighting system chosen. The empirical analysis is based on Jordan DHS (2002, 2007) datasets and integrated by a fieldwork conducted on a sample of students and development experts for eliciting information related to the relative weights attached to several well-being domains considered (education, health, housing, employment and personal security). A robustness analysis has been conducted quantifying the relative and global impact of different combinations of these three methodological choices on poverty estimates both at national and sub-national level.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    An intensive debate has developed at the European institutional level in the last 2 years on how to measure progress and well-being, and many national and international initiatives have been promoted with this regard. See, in particular, the Equality of Human Rights Commission’s work in Britain and its recent report on developing a set of indicators for measuring equality (EHRC 2009), the 2009 French Report of the Stiglitz-Sen-Fitoussi Commission (2009) (http://www.stiglitz-sen-fitoussi.fr) and the initiative “Beyond GDP” promoted by the European Commission and OECD countries (www.beyond-gdp.eu). See also UNDP and the new series of indexes of human development introduced in the 2010 Human Development Report (UNDP 2010).

  2. 2.

    On Millennium Development Goals, see the most recent Global Monitoring Report (World Bank 2010), while about EU indicators see Atkinson et al. (2002) and European Commission (2008). A most recent list of indicators has been adopted by the European Union at the end of 2009 for monitoring what is defined as the social Open Method of Coordination (OMC). For a general discussion on indicators of poverty and social exclusion at a global level, see also Marlier and Atkinson (2010).

  3. 3.

    For a wide, even if non-exhaustive, overview of some of the most widespread well-being indices, see http://composite-indicators.jrc.ec.europa.eu. See also Ravaillon (2010a, b, 2011) for a critical discussion of some prominent composite indexes.

  4. 4.

    These are defined by Ravaillon as “a composite index for which the producer is only constrained by the availability of data in choosing what variables to include and their weights” (Ravaillon 2010a, p. 3).

  5. 5.

    At the best of our knowledge, there are no recent or regular empirical analyses on multidimensional deprivation in Jordan (at least, not in English) even if National Development Plans include poverty reduction and improvement in human development in their political agenda. See also the National Human Development Report (2004). A recent contribution aimed to investigate horizontal inequalities in Jordan with a special attention to Palestinian Refugees is Nimeh (2012).

  6. 6.

    Other aggregation methods that do not allow compensability at all, such as the multi-criteria approach (MCA), are discussed in the OECD-JRC Handbook (2008). One of the innovations of the Human Development Index in the last 2010 Report is the switch from an arithmetic to a geometric mean. Critical comments on the current HDI structure have been raised by Ravaillon (2010a, b); for an intensive debate on this, see also the HDR forum “Let’s talk HD” http://hdr.undp.org/en/humandev/lets-talk-hd/

  7. 7.

    It has been outlined, however, that an unbalanced structure in the composite index can arise if equal weights are given to each single variable when a different number of variables is being considered and subsequently grouped into different dimensions. See, among others, OECD-JRC (2008).

  8. 8.

    There are other preliminary and fundamental choices in the construction of a composite index, such as the selection of a set of dimensions and related variables that we do not discuss in detail here for space reasons (but see Sect. 3 about the selection criteria adopted in our empirical analysis). Some theoretical frameworks, such as the capability approach, devote special attention to the selection of relevant domains to be considered (Robeyns 2003; Nussbaum 2003; Sen 2004), but as a matter of fact, in most cases, these choices are largely constrained by the availability of data.

  9. 9.

    See www.gesis.org/en/social_monitoring/social_indicators/index

  10. 10.

    The analysis presented here is part of a broader research project aimed to investigate multidimensional poverty at national and regional level from a jointly human rights and human development perspective. For that project, we referred to both national household surveys (1996, 2003) as well as to DHS micro-data (1997, 2002, 2007). Although coming from different sources, the design of a composite indicator for a large span of time has been possible because of the relatively good comparability of these five datasets.

  11. 11.

     A Jordan 2009 DHS has recently been released but reports a smaller set of variables not sufficient to cover in an appropriate manner our chosen dimensions, while for the 2 years here considered, the datasets are more complete and perfectly comparable in terms of variables definition and sampling.

  12. 12.

     governorates are first-level sub-national administrative units. There are 12 governorates in Jordan equally distributed in the Northern, Central and Southern regions of the country.

  13. 13.

     The distribution of observations among the 12 governorates is consistent throughout the 2 years even if a slight over-representation of rural areas occurs in 2007. In general, the surveys design in the last 15 years registered an increase of the number of households interviewed and a higher representation of rural areas.

  14. 14.

     There are different reasons that require making a direct connection between individual and household well-being. On one hand, the household remains the major source of social relations, decision-making and risk pooling. Moreover, some variables, like for instance those related to housing conditions, are collected at the household level.

  15. 15.

     For similar reasons, we have not included asset indexes in the construction of our composite measures.

  16. 16.

     For employment and health indicators, we refer to the narrow concept of family because for these indicators only parents and children are considered as unit of analysis.

  17. 17.

     According to the high level of preoccupation that concerns unemployment in Jordan, our assumption is that a higher participation to the labour market contributes to a higher well-being. The participation of women to the labour market is very low in Jordan, around 15–20%. The woman usually does not work due to higher fertility rates and also because of cultural reasons. Therefore, a situation where only the woman works could represent a very extreme situation of poverty, when her participation to the labour market goes against cultural beliefs. Indeed, one could argue that this situation is worse than one where no one works. However, data confirm that women working enjoy more decisional power in the family, and one source of earning guarantees more protection against poverty than no source at all. Thus, we consider those families where no one is working as those with maximum deprivation.

  18. 18.

     The two elementary indicators HOU1 and HOU5 have been aggregated using an arithmetic mean, but results are robust against other aggregation methods tested. See Table A.4 in the Annex for details.

  19. 19.

     Among the few exceptions – according to our knowledge – there are the Vulnerability and Poverty Assessments surveys run in the Maldives Republic in 1997 and 2004 by the Minister of Planning and National Development (MPND) with the UNDP collaboration. These surveys provide a wide range of information regarding living conditions and socio-economic characteristics at both household and individual level, allowing the performance of multidimensional poverty and well-being assessments. Moreover, the surveys gather information on the importance attached to a predefined list of living standard dimensions by both individuals and the Island Communities – the latter being represented by Island Development Committees and Women’s Development Committees. These datasets are freely downloadable on the MPND website (www.frdp-maldives.gov.mv/hies/VPA.htm). See also de Kruijk and Rutten (2007).

  20. 20.

     In order to facilitate the complete freedom of expression of the students, the questionnaire has been translated and submitted in Arabic. The total sample of 987 units included students, coming from the faculties of law (197), business (256), medicine (129), education (198) and architecture (207). The questionnaires have been distributed by a team of four people during the week of 21st–25th of February 2010. Arabic speakers have introduced the aim of the research to each class that has been visited and have given important support in explaining the questionnaire to the students and in replying to questions and doubts. Although the sample of interviewed citizens is not representative of the Jordan population, the significance of the collected opinions may be considered equally relevant, as current university students are likely to be part of the “leading group” of Jordan’s future.

  21. 21.

     The sample included: the Jordanian Government (Ministry of Planning, Ministry of Social Affairs, National Aid Fund), Jordanian NGOs, semi-governmental organizations such as the Higher Council for Human Rights, International and Bilateral Organizations (UNDP, UNICEF, USAID) and academic experts of the University of Jordan. The importance of involving policymakers or citizens for determining weights has been outlined by many scholars, including McGillivray and Noorbakhsh (2006) and Ravaillon (2010a).

  22. 22.

     See OECD-JRC (2008), Mascherini and Hoskins (2008).

  23. 23.

     We follow here Esposito et al.’s methodology adopted for measuring different aspects related to literacy in Mozambique (see Esposito et al. 2011).

  24. 24.

     Despite the fact that experts’ and students’ samples are not directly comparable, this exercise highlights major differences in perception and preference for weights assignment among the different dimensions.

  25. 25.

     There are also some slight gender differences: male students give more importance to housing and personal security while female students worry more about health.

  26. 26.

     The application of this methodology to the measurement of multidimensional poverty and well-being is not new even though it probably remains not sufficiently exploited. See, among other, Cerioli and Zani (1990), Cheli and Lemmi (1995), Chiappero-Martinetti (1996, 2000), Addabbo et al. (2004), Baliamoune (2004), Berenger and Verider-Chouchane (2007), Lelli (2001), Roche (2008).

  27. 27.

     With this specification, the membership degree can also be seen as the individual poverty gap with respect to each specific domain.

  28. 28.

     In this sense, Cheli and Lemmi (1995) define their method as a totally fuzzy and relative approach (TFR). For other possible transformation functions, see the OEDC-JRC (2008) and Jacobs et al. (2004).

  29. 29.

     In case of qualitative variables, the implicit assumption is that there is equidistance between modalities of the variables. For example, passing from illiteracy to primary schooling has exactly the same value as passing from a bachelor degree to a master degree.

  30. 30.

     See Cheli and Lemmi (1995).

  31. 31.

     On the properties of this class of operators and more generally on fuzzy set operations, see Klir and Yuan (1995), Calvo et al. (2002). For their application to poverty and well-being analysis, see Chiappero-Martinetti (2000, 2006).

  32. 32.

     See Table A.7 in the Annex for a glossary of the multidimensional indexes corresponding to the different methodological choices.

  33. 33.

     The FGT parametric class of poverty measures, formulated by Foster et al. (1984) may be written as follows:\(FGT=\frac{1}{n}{\left(\frac{z-{y}_{j}}{z}\right)}^{\alpha }\)with α  ≥  0; α  =  0 corresponds to the head-count ratio, α  =  1 to the Poverty Gap Index and α  =  2 to the Squared Poverty Gap.

  34. 34.

     Poverty measure at governatorate level are reported in the Annex (Tables A.8, A.9, A.10 and A.11).

  35. 35.

     Worst and best performers are identified by the average ranking deriving from all ranking positions calculated by different multidimensional indexes for the PGI Index 2007 (values reported in Table A.9 in the Annex). Best and worst performers are held constant for all methodological comparisons.

  36. 36.

     For reason of simplicity, we do not distinguish here between students’ and experts’ weights that however, as discussed in Sect. 3 are not so remarkably different.

  37. 37.

     However, looking at a wider span time, such as from 1996 to 2007 (see footnote 9), poverty in Jordan has in overall decreased in a rather substantial manner. Improvements have mainly occurred in education and health while for employment and housing the Jordan performance appears to be rather stagnant. Security is a dimension where poverty appears to have increased, yet.

  38. 38.

     It has already been remarked that the FUA indicators assume the value of the least favourable of the five considered dimensions while FIA indicators assume the value of the most favourable of the considered dimensions.

  39. 39.

     For Fig. 5.5, all poverty estimates except those deriving from fuzzy indicators have been used. Results do not change in substance if fuzzy indicators are included, however: they tend to enter as outliers for each governatorate and therefore just make the distributional analysis of poverty estimates less clear.

References

  • Addabbo, T., Di Tommaso, M. L., & Facchinetti, G. (2004). To what extent fuzzy set theory and structural equation modelling can measure functionings? An application to child well being (Child Working Papers, n. 30/2004).

    Google Scholar 

  • Alkire, S. (2002). Valuing freedoms: Sen’s capability approach and poverty reduction. Oxford: Oxford University Press.

    Google Scholar 

  • Atkinson, T., Cantillon, B., Marlier, E., & Nolan, B. (2002). Social indicators: The EU and social inclusion. Oxford: Oxford University Press.

    Google Scholar 

  • Baliamoune, M. (2004). On the measurement of human well-being: fuzzy set theory and Sen’s capability approach (Research paper 2004/16). Helsinki: Wider.

    Google Scholar 

  • Berenger, V., & Verider-Chouchane, A. (2007). Multidimensional measures of well-being: Standard of living and quality of life across countries. World Development, 35(7), 1259–1276.

    Article  Google Scholar 

  • Bruni, L., & Porta, P. L. (Eds.). (2005). Economics and happiness: Framing the analysis. Oxford: Oxford University Press.

    Google Scholar 

  • Burchardt, T. (2008). Monitoring inequality: Putting the capability approach to work. In G. Craig, T. Burchardt, & D. Gordon (Eds.), Social justice and public policy: Seeking fairness in diverse societies. Bristol: Policy.

    Google Scholar 

  • Calvo, T., Mayor, G., & Mesiar, R. (Eds.). (2002). Aggregations operators: New trends and applications. Heidelberg: Physica-Verlag/Springer.

    Google Scholar 

  • Cerioli, A., & Zani, S. (1990). A fuzzy approach to the measurement of poverty. In C. Dagum & M. Zenga (Eds.), Income and wealth distribution, inequality and poverty. Berlin: Springer.

    Google Scholar 

  • Cheli, B., & Lemmi, A. (1995). A “totally” fuzzy and relative approach to the multidimensional analysis of poverty. Economic Notes by Monte dei Paschi Siena, 24(1), 115–134.

    Google Scholar 

  • Chiappero-Martinetti, E. (1996). Standard of living evaluation based on Sen’s approach: Some methodological suggestions. Notizie di Politeia, 12(43/44), 37–53.

    Google Scholar 

  • Chiappero-Martinetti, E. (2000). A multidimensional assessment of well-being based on Sen’s functioning approach. Rivista Internazionale di Scienze Sociali, CVIII(2), 207–239.

    Google Scholar 

  • Chiappero-Martinetti, E. (2006). Capability approach and fuzzy set theory: Description, aggregation and inference issues. In A. Lemmi & G. Betti (Eds.), Fuzzy set approach to multidimensional poverty measurement. New York: Springer.

    Google Scholar 

  • de Kruijk, H., & Rutten, M. (2007). Weighting dimensions of poverty based on people’s priority: Constructing a composite poverty index for the Maldives (Working Paper 35). Q-squared, University of Toronto.

    Google Scholar 

  • Decancq, K., & Lugo, M. A. (2010). Weights in multidimensional indices of well-being: An overview (OPHI Working Paper n. 18) (pp. 502–522). Oxford: Oxford Poverty Human Development Initiative.

    Google Scholar 

  • Di Tella, R., & MacCullogh, R. (2006). Some uses of happiness data in economics. Journal of Economic Perspective, 20(1), 25–46.

    Article  Google Scholar 

  • Easterlin, R. A. (2000, July). Income and happiness: Towards a unified theory. The Economic Journal, 111(473), 465–484.

    Article  Google Scholar 

  • EHRC. (2009). Developing the equality measurement framework: Selecting the indicators. London: Equality of Human Rights Commission.

    Google Scholar 

  • Esposito, L., Kebede, B., & Maddox, B. (2011). Literacy practices and schooling: A case study from Mozambique. World Development, 39(10), 1796–1807.

    Google Scholar 

  • European Commission. (2008). Portfolio of overarching indicators and streamlined social inclusion, pensions and health portfolios. Brussels: Employment, Social Affairs and Equal Opportunities DG, Social Protection and social integration.

    Google Scholar 

  • Foster, J., Greer, J., & Thorbecke, E. (1984). A class of decomposable poverty measures. Econometrica, 52(3), 761–766.

    Google Scholar 

  • Frey, B., & Stutzer, A. (2000). Happiness and economics. Princeton: Princeton University Press.

    Google Scholar 

  • Fukuda-Parr, S., & Kumar, S. (Eds.). (2003). Readings in human development. New Delhi: Oxford University Press.

    Google Scholar 

  • Jacobs, R., Smith, P., & Goddard, M. (2004). Measuring performance: An examination of composite performance indicators (Technical Paper 29). York: Centre for Health Economics, York University.

    Google Scholar 

  • Kahneman, D. (2000). Experienced utility and objective happiness: A moment-based approach. In D. Kahneman & A. Tversky (Eds.), Choices, values and frames. New York: Cambridge University Press/Russel Sage Foundation.

    Google Scholar 

  • Kahneman, D., & Krueger, A.B. (2006). Developments in the measurement of subjective well-being. Journal of Economic Perpsective, 20(1), 3–24.

    Google Scholar 

  • Kahneman, D., Diener, E., & Schwarz, N. (Eds.). (1999). Well-being: The foundations of hedonic psychology. New York: Russel Sage Foundation.

    Google Scholar 

  • Klir, G. J., & Yuan, B. (1995). Fuzzy sets and fuzzy logic: Theory and applications. Upper Saddle River: Prentice Hall.

    Google Scholar 

  • Layard, R. (2005). Happiness: Lessons from a new science. London: Penguin.

    Google Scholar 

  • Lelli, S. (2001). Factor analysis vs. fuzzy sets theory: Assessing the influence of different techniques on Sen’s functioning approach (Centre of Economic Studies Discussion Paper). Leuven: KU Leuven.

    Google Scholar 

  • Marlier, E., & Atkinson, T. (2010). Indicators of poverty and social exclusion in a global context [Special issue on poverty measurement]. Journal of Policy Analysis and Management, 29(2), 285–304.

    Google Scholar 

  • Mascherini, M., & Hoskins, B. (2008). Retrieving expert opinion on weights for the active citizenship composite indicator. Ispra: European Commission, Joint Research Centre, Institute for the Protection and Security.

    Google Scholar 

  • McGillivray M., & Noorbakhsh, F. (2006). Composite indexes of human well-being: Past, present and future. In M. McGillivray (Ed.), Human well-being: Concept and measurement (pp. 113–134). WIDER publication, Studies in Development Economics and Policy Series. London: Palgrave Macmillan.

    Google Scholar 

  • Nimeh, Z. (2012). Social citizenship rights: Inequality and exclusion. Maastricht Graduate School of Governance Dissertation Series 27.

    Google Scholar 

  • Nussbaum, M. (2000). Women and human development: The capability approach. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Nussbaum, M. (2003). Capabilities as fundamental entitlements: Sen and social justice. Feminist Economics, 9(2–3), 33–59.

    Article  Google Scholar 

  • Nussbaum, M., & Sen, A. K. (Eds.). (1993). The quality of life, wider studies in development economics. Oxford: Clarendon.

    Google Scholar 

  • OECD-JRC. (2008). Handbook of constructing composite indicators: Methodology and user guide. Paris: OECD.

    Google Scholar 

  • Ravaillon, M. (2010a). The mashup indices of development (Policy Research Working Paper n. 5432). Washington, DC: World Bank.

    Google Scholar 

  • Ravaillon, M. (2010b). Troubling tradeoffs in the human development index (Policy Research Working Paper 5434). Washington, DC: World Bank.

    Google Scholar 

  • Ravaillon, M. (2011). On multidimensional indices of poverty (Policy Research Working Paper, n. 5580). Washington, DC: World Bank.

    Google Scholar 

  • Robeyns, I. (2003). Sen’s capability approach and gender inequality: Selecting relevant capabilities. Feminist Economics, 9(2–3), 61–92.

    Article  Google Scholar 

  • Robeyns, I. (2005). The capability approach: A theoretical survey. Journal of Human Development, 6(1), 93–117.

    Article  Google Scholar 

  • Roche, J. M. (2008). Monitoring inequality among social groups: A methodology combining fuzzy set theory and principal component analysis. Journal of Human Development, 9(3), 427–452.

    Article  Google Scholar 

  • Sen, A. K. (1999). Development as freedom. New York: Anchor Books.

    Google Scholar 

  • Sen, A. K. (2004). Capabilities, lists and public reason: Continuing the conversation. Feminist Economics, 10(3), 77–80.

    Article  Google Scholar 

  • Stiglitz, J., Sen, A. K., & Fitoussi, J. P. (2009). Report of the Commission on the measurement of economic performance and social progress. Avaiable at www.stiglitz-sen-fitoussi.fr.

  • UNDP. (2010). Human development report 2010 – The real wealth of nations: Pathways to human development. New York: Palgrave Macmillan.

    Google Scholar 

  • Veenhoven, R. (2000). Freedom and happiness: A comparative study in forty-four nations in the early 1990s. In E. Diener & M. Eunkook (Eds.), Culture and subjective well-being (pp. 257–288). Cambridge: MIT.

    Google Scholar 

  • World Bank. (2010). Global monitoring report 2010: The MDGs after the crisis. Washington, DC: World Bank.

    Book  Google Scholar 

Download references

Acknowledgements

This paper has been developed within the Research Project on Human Rights and Human Development funded by the Italian Ministry of Higher Education and Research (FIRB RBIN06ZFSE). We would like to thank Ekhlas Sweis and the students of the master in human rights of the University of Jordan (UJ) for their kind support during the fieldwork conducted at the UJ in Amman and Zina Nimeh and Zaid Eyadat for their help in selecting and contacting experts and for the support provided during the interviews. Special thanks go to Lucio Esposito for his suggestions during the preparation of the questionnaires and to Achin Chakraborty for precious comments. We are very grateful to the STAT-TEAM (Alberto Cardaci, Francesca Gatti, Toa Giroletti and Francesco Maffoni) for the precious research assistance on data analysis. Helpful comments have been received by the participants at the 2010 HDCA Conference in Amman.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Enrica Chiappero-Martinetti .

Editor information

Editors and Affiliations

Annexes

Annexes

Table A.1 Educational attainment indicator at individual level
Table A.2 Indicator for employment condition at family level
Table A.3 Health condition indicator for children (0–4 years) at family level
Table A.4 Housing conditions indicator at family level
Table A.5 Personal security indicator at individual level
Table A.6 Synthesis of ranks between dimensions, according to the ranking criterion adopted
Table A.7 Glossary of multidimensional indexes and abbreviations
Table A.8 Poverty estimates, PGI by governatorate, 2002
Table A.9 Poverty estimates, PGI by governatorate, 2007
Table A.10 Poverty estimates, SPG by governatorate, 2002
Table A.11 Poverty estimates, SPG by governatorate, 2007
Fig. A.1
figure a

Variable map for the composite multidimensional poverty index

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer Science+Business Media B.V.

About this chapter

Cite this chapter

Chiappero-Martinetti, E., von Jacobi, N. (2012). Light and Shade of Multidimensional Indexes. In: Maggino, F., Nuvolati, G. (eds) Quality of life in Italy. Social Indicators Research Series, vol 48. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-3898-0_5

Download citation

Publish with us

Policies and ethics