# Partitioning Variance Into Constituents in Multiple Regression Models: Commonality Analysis

• Burhanettin Ozdemir
Conference paper
Part of the Springer Proceedings in Mathematics & Statistics book series (PROMS, volume 89)

## Abstract

Commonality analysis is a method of partitioning the explained variance in a multiple regression analysis into variance constituents associated with each independent variable uniquely and variance associated with common effects of one or more independent variables in various combinations. By partitioning variance, commonality analysis helps to determine accurately the degree of multicollinearity between the independent variables, suppressor variable and related importance of independent variables. In addition, commonality analysis provides regression effects (R 2) of all possible simple and multiple regression models that can be constructed by the independent variables and thus helps researchers choose the most appropriate regression model. The purposes of this study are to (a) provide a general overview of multiple regression analysis and its application, (b) explain how to conduct commonality analysis in a regression model, and (c) determine the degree of multicollinearity between independent variables and suppressor variable in the model by means of commonality analysis results. For these purposes, OBBS data set which was collected during a project in Turkey was used to provide a heuristic example. In this example, three independent variables that are assumed to predict students’ academic performance were selected to create model and then multiple regression analysis and commonality analysis were conducted.

## Keywords

Variance analysis Commonality analysis Multiple regression models

## References

1. Amado AJ (2003) Partitioning predicted variance into constituent parts: a primer on regression commonality analysis. Res Schools 10(1):91–97Google Scholar
2. Courville T, Thompson B (2001) Use of structure coefficients in published multiple regression articles: B is not enough. Educ Psychol Meas 61:229–248. doi:
3. Eğitim, Araştırma ve Geliştirmesi Daire Başkanlığı (EARGED) (2010) İlköğretim ÖBBS raporu 2005. Ankara, Milli Eğitim Bakanlığı. http://yegitek.meb.gov.tr/dosyalar/obbs/2005/matematik.pdf
4. Gill CS, Barrio Minton CA, Myers JE (2010) Spirituality and religiosity: factors affecting wellness among low-income, rural women. J Couns Dev 77:293–303
5. Harlow LL (2005) What is multivariate thinking? The essence of multivariate thinking. Lawrence Erlbaums, Mahwah, pp 3–27Google Scholar
6. Mood AM (1971) Partitioning variance in multiple regression analyses as a tool for developing learning models. Am Educ Res J 8:191–202
7. Nimon K, Gavrilova M (2010, February) Commonality analysis: Demonstration of an SPSS solution for regression analysis. Poster presented at the 2010 Conference, University of Illinois at Urbana-ChampaignGoogle Scholar
8. Nimon K, Reio TG Jr (2011) Regression commonality analysis: a technique for quantitative theory. Hum Resource Dev Rev 10:329. doi:
9. Nimon K, Lewis M, Kane R, Haynes RM (2008) An R package to compute commonality coefficients in the multiple regression case: an introduction to the package and a practical example. Behav Res Methods 40:457–466. doi:
10. Nimon K, Gavrilova M, Roberts JK (2010) Regression results in human resource development research: Are we reporting enough? In: Graham C, Dirani K (eds) Proceedings of the human resource development 2010 international conference, AHRD, Knoxville, TN, pp. 803–812Google Scholar
11. Pedhazur EJ (1997) Multiple regression in behavioral research: explanation and prediction, 3rd edn. Harcourt Brace, Ft Worth
12. Seibold DR, McPhee RD (1979) Commonality analysis: a method for decomposing explained variance in multiple regression analysis. Hum Commun Res 5:355–363
13. Smith RL, Ager JW Jr, Williams DL (1992) Suppressor variables in multiple regression/correlation. Educ Psychol Meas 52:17–29. doi:
14. Sorice MG, Conner JR (2010) Predicting private landowner intentions to enroll in an incentive program to protect endangered species. Hum Dimens Wildl 15(2):77–89
15. Stevens JP (2009) Applied multivariate statistics for the social sciences, 5th edn. Routledge, New YorkGoogle Scholar
16. Thompson B (1995) Stepwise regression and stepwise discriminant analysis need not apply here: a guidelines editorial. Educ Psychol Meas 55(4):525–534
17. Thompson B (2006) Foundations of behavioral statistics: an insight-based approach. The Guilford Press, New YorkGoogle Scholar
18. Thompson B, Borrello GM (1985) The importance of structure coefficients in regression research. Educ Psychol Meas 45:203–209Google Scholar
19. Warne RT (2011) Beyond multiple regression: using commonality analysis to better understand R2 results. Gift Child Q 55:313–318. doi:
20. Zientek LR, Thomspon B (2006) Commonality analysis: partitioning variance to facilitate better understanding of data. J Early Interv 28(4):299–307